The peer review system no longer works to guarantee academic rigor—a different approach is needed

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

The peer review system no longer works to guarantee academic rigor—a different approach is needed

Credit: Pixabay/CC0 Public Domain

Peer review is a central feature of academic work. It’s the process through which research ends up published in an academic journal: independent experts scrutinize the work of another researcher in order to recommend if it should be accepted by a publisher and if and how it should be improved.

Peer review is often assumed to guarantee quality, but it doesn’t always work well in practice. Every academic has their own peer-review horror stories, ranging from years-long delays to multiple tedious rounds of revisions. The cycle continues until the article is accepted somewhere or until the author gives up.

On the other side, the work of reviewing is voluntary and also invisible. Reviewers, who often remain anonymous, go unrewarded and unrecognized, even though their work is an essential part of research communication. Journal editors find recruiting peer reviewers is increasingly difficult.

And we know peer review, however much it is lauded, often does not work. It is

This is the hidden content, please

• Sign In
• or
• Sign Up

, and too

This is the hidden content, please

• Sign In
• or
• Sign Up

, or even

This is the hidden content, please

• Sign In
• or
• Sign Up

, to creep through.

Clearly the peer-review system is broken. It is slow, inefficient and burdensome, and the incentives to carry out a review are low.

Publish first

In recent years, alternative ways to scrutinize research have emerged which attempt to fix some of the problems with the peer-review system. One of these is the “publish, review, curate” model.

This reverses the traditional review-then-publish model. An article is first published online, then peer reviewed. While this approach is

This is the hidden content, please

• Sign In
• or
• Sign Up

to understand how it compares with traditional publishing,

This is the hidden content, please

• Sign In
• or
• Sign Up

about its promise, suggesting that increased transparency in the review process would speed scientific progress.

We have set up a platform using the publish, review, curate model for the field of metaresearch—research about the research system itself. Our aims are both to innovate peer review in our field and to study this innovation as a metaresearch experiment of sorts. This initiative will help us to understand how we can improve peer review in ways that we hope will have implications for other fields of research.

The platform, called

This is the hidden content, please

• Sign In
• or
• Sign Up

(MetaResearch Open Review), has just been launched. It is a partnership between an academic society, the Association for Interdisciplinary Meta-Research and Open Science, and a non-profit metaresearch accelerator, the Research on Research Institute.

In the case of MetaROR, authors first publish their work on a preprint server. Preprints are versions of research papers made available by their authors before peer review as a way of accelerating the dissemination of research. Preprinting has been common in a few academic disciplines for decades, but increased in others

This is the hidden content, please

• Sign In
• or
• Sign Up

as a way of getting science into the public domain faster. MetaROR, in effect, builds a peer-review service on top of preprint servers.

Discover the latest in science, tech, and space with over 100,000 subscribers who rely on Phys.org for daily insights.
Sign up for our

This is the hidden content, please

• Sign In
• or
• Sign Up

and get updates on breakthroughs,
innovations, and research that matter—daily or weekly.

Authors submit their work to MetaROR by providing MetaROR with a link to their preprinted article. A managing editor then recruits peer reviewers who are experts on the article’s object of study, its research methods, or both. Reviewers with competing interests are excluded whenever possible, and disclosure of competing interests is mandatory.

Peer review is conducted openly, with the reviews made available online. This makes the work of reviewers visible, reflecting the fact that review reports are contributions to scholarly communication in their own right.

We hope that reviewers will increasingly see their role as engaging in a scholarly conversation in which they are a recognized participant, although MetaROR still allows reviewers to choose whether to be named or not. Our hope is that most reviewers will find it beneficial to sign their reviews and that this will significantly reduce the problem of anonymous, dismissive or otherwise bad-****** reviews.

Since articles submitted to MetaROR are already publicly available, peer review can focus on engaging with an article with a view to improving it. Peer review becomes a constructive process, rather than one that valorizes gatekeeping.

This is the hidden content, please

• Sign In
• or
• Sign Up

suggests preprints and final articles actually differ surprisingly little, but improvements can often be made. The publish, review, curate model helps authors engage with reviewers.

Following the review process, authors are left to decide whether to revise their article and how. In the MetaROR model, authors can also choose to submit their article to a journal. To offer authors a streamlined experience, MetaROR is collaborating with several journals who commit to using MetaROR reviews in their own review process.

Like other publish, review, curate platforms, MetaROR is an experiment. We will need to evaluate it to understand its successes and failures. We hope others will too, so we can learn how best to organize the dissemination and evaluation of scientific research—without, we hope, too many peer-review horror stories.

Provided by
The Conversation

This article is republished from

This is the hidden content, please

• Sign In
• or
• Sign Up

under a Creative Commons license. Read the

This is the hidden content, please

• Sign In
• or
• Sign Up

.

Citation:
Opinion: The peer review system no longer works to guarantee academic rigor—a different approach is needed (2024, November 23)
retrieved 23 November 2024
from

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

This is the hidden content, please

• Sign In
• or
• Sign Up

#peer #review #system #longer #works #guarantee #academic #rigora #approach #needed

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up