Task Force on Social Networking Software

Medical Library Association

“blog-based peer review”

Filed under: blogging,blogs,blogs,Current Awareness — Marie_Kennedy at 9:22 pm on Monday, January 28, 2008

The Chronicle of Higher Ed has a couple of articles following the status of a book that is being peer-reviewed in the traditional sense and in addition is also being “reviewed” via blog.  Part 1 of the Chronicle article describes the motivation and process for the blog-based review, and Part 2 collections reactions from those that read the article.

Have a look at the site where the first chapter of the book is being commented on at http://grandtextauto.org/2008/01/22/expressive-processing-an-experiment-in-blog-based-peer-review/  and then follow future chapters at posts that begin with EP.  One can see that the comments that have been left so far are quite different than a traditional peer review.  A peer review generally summarizes the piece being reviewed and points out a few things that the writer should reconsider, change, or add to.  The comments on this blog are very specific, down to the paragraph level.  The comments are not anonymous, though they could be.

This process advances the idea of openness in peer review and creates a collegiality that encourages conversation about aspects of the book.  There’s a give and take, a grass-roots mood that is common on blogs, that may actually produce a better product in the end.  I’ll stay tuned to this and post updates when the author finishes the peer- and blog-review process to see which produces better quality, the wisdom-of-the-crowds approach or the few-experts approach.

In the meantime, what are your thoughts?  Does peer review get muddied by including non experts, or should peer review be opened up to include anyone who wants a say?

2 Comments

Comment by chris blanchard

February 14, 2008 @ 12:08 am

Marie – you ask a great question at the end, but I think it is a questions that needs to be parsed. “Peer review” has a specific meaning to those in academe, as you know. So peer review can’t really be muddied by including non-experts – because then it isn’t peer review, it’s just open comment. I am certainly not qualified to assess whether an article on thermodynamics is a great addition to the field, whether the author conducted the appropriate tests, whether the findings were supportable, whether the author reviewed and demonstrates an understanding of the literature in the field, etc. These are the functions of peer review. But there’s no reason I couldn’t read the article and pass it on to someone who IS interested in that topic and qualified to REVIEW it. That is one of the beauties of the Internet.

So there is no reason why we shouldn’t open scholarship up to both comment AND peer review, by posting more scholarship on-line. The “Internets” can greatly facilitate the process in both cases, and I think the vote by the Harvard FAS faculty yesterday, is only going to hasten the move to more open access, more online peer-review, more self publishing, more user generated content, etc.

Comment by Marie

February 20, 2008 @ 12:29 am

I like the way you’ve parsed the question I asked. Thanks for your comments!

RSS feed for comments on this post.

Sorry, the comment form is closed at this time.