Skip to main content

AI Reviewer (ResearchPilot™)

  • Updated

AI Reviewer is an automated screening assistant that joins your review as a team member. Once activated, it evaluates every article in your dataset against your Inclusion and Exclusion Criteria and generates an Include or Exclude decision for each one — with detailed reasoning. It works at scale, processing large datasets efficiently so your team can focus on validation and edge cases.

How to activate AI Reviewer

  1. Go to the Overview tab of your review.
  2. In the Review Members table, find AI Reviewer — it appears with Inactive status.
  3. Make sure your Inclusion and Exclusion Criteria are defined in the Screening Criteria panel before activating. AI Reviewer applies exactly what you write there.
  4. Click Activate. AI Reviewer is now a member of your review.
  5. Go to the Screening stage and click AI Reviewer in the top toolbar to enable and start it.
Important Define your Inclusion and Exclusion Criteria before activating AI Reviewer. The AI applies your criteria exactly as written — vague or incomplete criteria will produce less reliable results.

Tracking progress

Once started, AI Reviewer posts status updates in Review Chat so you can track its progress without staying on the Screening page:

  • Pending — AI Reviewer is queued and about to begin
  • In Progress — screening is underway
  • Finished Successfully — all articles have been evaluated

Reading AI Reviewer results

Once running, AI Reviewer's decisions appear directly in the article list. Click any article to see the full evaluation in the details panel:

  • Decision — Include or Exclude
  • Summary of Evaluation Criteria — each of your inclusion and exclusion criteria listed with whether it was met (Yes / No / Unknown) and the AI's reasoning. The full evaluation is added as a note on the article.
  • Detailed Evaluation and Justification — a full explanation of how the criteria were applied to the article.
Note AI Reviewer is treated exactly like a human reviewer — its decisions are hidden when Blind Mode is on. Turn Blind Mode off to view AI Reviewer's decisions and reasoning.

AI Reviewer and conflicts

When AI Reviewer's decision differs from a human reviewer's decision, a conflict is created — exactly like a conflict between two human reviewers. This is intentional and beneficial for systematic reviews: conflicts surface articles where the AI and your team disagree, which are often the most important articles to review carefully. Use the Conflict filter in Screening to work through these.

Continue to: AI Analyzer (ResearchPilot™)

Related articles

Comments

0 comments

Article is closed for comments.