Do all reviewers see studies in the same order during the screening process?

Roisin Sharma

• July 22, 2026 11:12

Hi!

I'm wondering what the default order is for studies being presented during the screening phase, and whether this is the exact same for all reviewers. 

Is there an option to randomise this per reviewer?

Many thanks!

0

• Official comment

  

  Bashar

  Community manager

  • September 03, 2026 13:32

  Hi Roisin,

  The Sampling feature can help here: it lets you create randomized samples of your references and assign a specific subset to each team member, so each reviewer works through their own randomized group instead of the full list in a shared order.

  You can find more details here: https://help.rayyan.ai/hc/en-us/articles/16759338308113-Organize-Your-Review-Team-Using-Rayyan-to-Divide-the-Work-and-Assign-References

  Thanks on behalf of the Rayyan Community
• 

  Erik Stenlund

  • September 02, 2026 06:53

  I can only answer from my very limited experience, which is this: No, you cannot take for granted that other reviewers have the same order as the one you are seeing. In the review I am working on right now, my first full-scale one, I have given careful instructions to my team about what sorting to use (Title, ascending), where their section starts using number and title, and where it ends. When we have compared notes I have been careful to name each title to ensure we are looking at the same thing, and every time one of us changed their assessment we all resorted our lists. It takes longer to describe than to do it in practice.

  0

Please sign in to leave a comment.