Using Rayyan's Predictions Classifier for Relevance Ranking?

Rayyan's AI-powered Relevance Ranking helps reviewers accelerate their systematic reviews by learning patterns in decision criteria as reviewers make decisions and using that learning to rate the probability that an article will be included.

To use the Rayyan Predictions Classifier, follow the steps below:

1. Make Decisions: Ensure you've made at least 50 inclusion and/or exclusion decisions in your systematic review, with at least 5 decisions of both types (included and excluded).

2. Compute Ratings:

• Click on the Compute Ratings button.
  
  
  
• You will see the message: Ratings are being calculated for review [Review Name] while Rayyan's Artificial Intelligence engine calculates the likelihood of each article to be included in your literature review.

Once it is finished, you will see the message: New ratings available. You'll also see thumbs up/down ratings, in the Ratings column at the right, ranging from 2 thumbs down - near zero likelihood of inclusion to 2 thumbs up- very high likelihood of inclusion, and ? for no recommendation.

3. Sort by Ratings: You can now sort your review by least or most likely to be included by clicking on the sorting arrow besides the Filter by Inclusion facet. When sorting on the rating system, the order is precise - in other words, the exact calculation dictates the order while the visible stars show an approximation.

4. Recompute Ratings: As you make more decisions, you can compute ratings again at any time. The more decisions you make, the more accurate the ratings will be - as Rayyan learns more from each decision.

5. You can also access the ratings directly from the Filters workbench. This allows you to filter by specific ratings, such as "Most Likely to Include" or "Most Likely to Exclude." Additionally, you can check the number of articles that fall under each rating category, providing a clear overview of your review's content distribution based on AI predictions.

Interested in a training session?

We're excited to invite you to join our training sessions on Rayyan! Whether you're new to our platform or looking to enhance your skills, our training sessions are designed to help you get the most out of Rayyan. Register here to secure your spot!

Need Assistance?

Encountering an issue with Rayyan? Start by browsing through our FAQs for quick solutions. If your concern isn't addressed there, reach out to us at support@rayyan.ai. Our dedicated agents are here to assist you promptly. When contacting us, please provide:

• The steps you took leading to the issue.
• The name of your review.
• A screenshot of the error, if possible.