PubMed today launches a pilot version of PubMed Commons,
“a system that enables researchers to share their opinions about scientific publications. Researchers can comment on any publication indexed by PubMed, and read the comments of others.”
In general, we’re big fans of post-publication peer review, as Retraction Watch readers know. Once it’s out of its pilot phase — and we hope that’s quite soon — PubMed Commons comments will be publicly available. So this is a step forward — but only a tentative one. That’s because of the first bullet point in the terms of service commenters agree to:
Only those individuals listed as an author on a PubMed citation may make comments in PubMed;
If possible, provide detailed references to papers (eg. page numbers, figure pointers) and unpublished data; refer to external websites if a longer comment or reference to other work is necessary;
Do not describe or share unpublished work by others;
Comments should not contain discriminatory, racist, offensive, inflammatory, or unlawful language;
Comments should not contain partisan political views;
Comments should not have explicit commercial endorsements.
So PubMed Commons isn’t exactly a town commons, unless you happen to live in a town whose residents are all scientists.
Stanford’s Rob Tibshirani, who was involved in organizing PubMed Commons, wrote in a blog post prepared in advance of the launch:
“One would like the system to be inclusive as possible but many scientists would not be interested in posting comments in a system with a high proportion of irrelevant or uninformed comments. NIH also needed a rule for who could post that would be pretty clear cut and not based on e.g. some judgment of the experience or knowledge of the participants. The decision was made that comments could only be posted by authors of papers in PubMed. This would make the situation symmetric in that all people who comment can have their own work commented on. It would also include a large number of potential participants and would meet NIH’s need for something unambiguous. Unfortunately it would leave out many people who could add valuable input, including many graduate students, patient advocates, and science journalists. I’m a little worried about this restriction, as I want to make the system open to as many users as possible. But hopefully that is a pretty wide net, and it may be widened further in the future.”
We’re a bit worried about this restriction, too.