Fixing peer review for academic publishers

A guest post from Amanda Briggs, Director of new scholarly publisher, GSE Research

Scholarly publishing has probably gone through more changes in the last 10 years than in the previous five centuries. For the scholars of the Renaissance, moveable type and cheap paper were the revolutionary technologies enabling the spread of ideas, theories and information in the sciences, philosophy, politics and humanities. From the learned (and often subversive) treatises coming out of the great universities to the scandal sheets and incendiary pamphlets that circulated in the coffee shops, printed text was the great enabler of intellectual exchange for 500 years. And then came the web and user-friendly internet interfaces and the very notions of information and scholarly discourse got shaken to their core.

These technologies were revolutionary and everyone in the orbit of scholarly publishing acknowledges as much. Forward-looking organizations also recognize that this revolution, far from being over is actually gathering pace. As publishers we need to be always pushing the boundaries and thinking ahead to the next generation delivery mechanisms and technological developments.

But is the scholarly publishing industry changing as rapidly in other dimensions as it is technologically? Yes, the phenomenal rise of online publication has had some impact, but the philosophical underpinnings of disseminating academic research sometimes seems to be more firmly rooted in the 17th century than in the 21st. The online structures of peer reviewed journals – the primary engines for publishing scholarly research – are indistinguishable from their historical paper predecessors; a fixed number of papers is organized into volumes (usually on an annual basis) and issues with page layouts which mirror the print equivalent of the journal. Many publishers today use sophisticated electronic submission and review systems but the process of peer review remains unchanged and the proxy measures used to evaluate the quality of published research are still broadly those imagined for a paper-based world.

This seems to us at GSE Research to be a terrible missed opportunity, which is why, as a brand new research publisher, we want to try and break through some of those constraints and find new and interesting ways of exploiting the potential of developments like the semantic web, social networking, data mining and the vast virtual spaces of the internet to host an almost infinite volume of information, and why we are turning to switched on, forward-thinking technological innovators like Publishing Technology to work with us to help unlock that potential.

We believe that online publishing offers myriad possibilities to both creators and consumers of research to choose for themselves how they wish to disseminate, discover and respond to academic papers; even to move away from concepts like ‘academic papers’ and to invent new formats more appropriate for the delivery of new knowledge. We don’t know what all these will be yet. Some will stem from technological developments we haven’t even seen, yet more will emerge almost randomly from individuals’ choices about how they interact with technology.

GSE Research is working with Publishing Technology because we want to be in the front line of discovering those developments and offering as much choice as we can to our communities. With cutting edge technology and an open minded publishing philosophy, we believe that we can help shape the future of scholarly publishing for the 21st century.

Follow us @gseresearch to watch our journey take shape.

Image credit: nuttakit

This entry was posted in Publishing Technology, Semantic Web and tagged , , , , , , , , , , , , , , . Bookmark the permalink.

2 Responses to Fixing peer review for academic publishers

  1. David Lamond says:

    Amanda from GSE Research makes a number of very important points – we do need to take advantage of the range of new technologies available to us, rather than operate as if it’s still all about the limitations of hard copy journal issues. The notion that knowledge is “better” because it’s published in an A*/4* journal rather than a B/2* journal is not a tenable position. On the flip side though, just as one would argue that a clanging dustbin does not have the quality of a Beethoven sonata (no, someone liking it does not make it so), we need to revisit what constitutes publishable knowledge – we publish and acknowledge “knowledge” because it makes a contribution to the body of knowledge in which we are interested. This is perhaps the real “elephant in the room” when it comes to confronting the publishing conundrum of the 21st century?

    • Richard Ridge says:

      I think it’s true that since online delivery has facilitated an explosion in the volume of scholarly content, researchers accordingly face problems in filtering the quality of relevance thereof, even in the context of material that has already gone through both peer review and an editorial process. It seems to me that there are approaches from outside academic publishing that could answer this.

      A lot of online services contain their own definition of how to prioritise content in search and browse pages.
      Google’s PageRank originally used back links as a proxy for the traditional academic citation (i.e. more linked to content is more interesting) and has since supplemented PageRank with a complex set of additional factors, like the internal link density within a site, site performance and possibly usage of the plus button. Flick’s interestingness algorithm uses the volume of views, comments, favorites, notes and gallery additions to determine how popular content is. Amazon factor the ratings encoded in their reviews in order to determine popularity. It does seem to me that while academic publishing is very concerned with usage and impact factor, these are very crude measures and some sort of complex multivariate algorithm would be the obvious solution to these issues, particularly if it used sentiment analysis to determine the main flaw in using citations as a metric i.e. the fact that they contain no indication of whether the citations expressed agreement or disagreement.

Leave a Reply

Your email address will not be published.

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>