Nature is expanding Registered Reports to all the fields in which we publish
Skip to main content
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain<br>the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in<br>Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles<br>and JavaScript.
Advertisement
Nature is expanding Registered Reports to all the fields in which we publish
Download PDF
Bluesky
You have full access to this article via your institution.
Download PDF
Registered Reports avoid the ‘file-drawer problem’, in which negative or inconclusive results never see the light of day.Credit: Getty<br>Do algorithms used by social-media platforms amplify posts that are emotive, toxic, political or perceived as moralizing? And, if they do, does that affect how users see their social world? William Brady, a social psychologist at Northwestern University in Evanston, Illinois, and his colleagues wanted to test these questions during the 2024 US presidential election. To maximize their study’s rigour, they did something rare in science publishing1: they submitted their topic and research plan for peer review before they had gathered a single data point.<br>Read the paper: Redesigning algorithms to intervene on social norm misperceptions during a national election
The resulting Registered Report is the first completed study2 of this kind published in Nature since we began inviting them in 2023. Today, we are issuing new guidelines that expand the types of research — and research field — that can use the Registered Report format.<br>Until now, submissions for Registered Reports were considered only for confirmatory research — essentially types of study that test hypotheses — and only in cognitive neuroscience and the behavioural and social sciences. From now on, we will welcome Registered Reports across the fields in which we publish, extending beyond hypotheses-testing studies to include those that, for example, gather large amounts of data or compare scientific methods.<br>What exactly are Registered Reports? Authors propose a topic of study, explain its importance and set out their plans for data collection and analysis — including hypotheses, where applicable. These are reviewed before data are collected or, in the case of secondary analyses, before existing data are accessed. Once a proposal has undergone rigorous peer review, and editors and referees are convinced that the question is of significant and broad interest and that the data and design are the best possible way to provide answers, then the journal commits to publishing the study, whatever the outcome.<br>This approach has many benefits. It strengthens a study’s methods, including data collection and analysis. Reviewers are more involved in the research process because they can make suggestions about the design and analyses. In fact, the reviewers help to shape a project rather than commenting at the end, as is the case for conventionally published research.<br>Nature welcomes Registered Reports
Importantly, the process ensures that all results are published. Registered Reports thus avoid the ‘file-drawer problem’, in which negative or inconclusive results never see the light of day. Because authors must stick to the precise analysis they outlined in advance, the format can, in some cases, help to reduce P hacking, in which researchers conduct many statistical analyses until they get a significant result.<br>Brady says it was a “no-brainer” to do this research as a Registered Report. His team’s study involved manipulating the feeds of 2,000 users on the social-media platform Bluesky, using three distinct algorithms over eight weeks. The work involved hiring a software engineer and running something similar to a start-up company for a year, without any guarantee of what the study would find. It was made feasible only by the commitment that the work would be published, come what may, he says.<br>Getting reviewer feedback before the experiment began was another benefit. It led the authors to amend the study design to use data from existing Bluesky users rather than fresh volunteers, so as to obtain more-meaningful responses from people genuinely invested in their interactions on the platform. The Registered Report format demanded meticulous planning and a clarity that helped the experimental process to run smoothly. “I basically now tell students, let’s imagine we are going to do a Registered Report, because it helps us plan and it saves you so much time later on,” he says.<br>Registered Reports can be challenging. They are intensive, involving two stages, each of which typically needs multiple rounds of peer review. And it can be a struggle to be locked into a particular analysis. For Brady, there turned out to be many fewer ‘toxic’ posters than anticipated, which meant that...