Detecting duplicate references/articles in a review

Step 1: Visit the Review Data Screen Ensure you have imported all your references from various sources into Rayyan. Navigate to the Review Data screen to begin the deduplication process.

Step 2: Initiate Duplicate Detection Click the Detect Duplicates button. This will start scanning your dataset for potential duplicates.

Note: Duplicate detection can only be performed once per unique dataset. If you need to rerun it, you must add or delete references from your review first. If you encounter the message “A search must be added or deleted before running duplicate detection again,” it means the deduplication process has already been completed on your current dataset.

Step 3: Detecting Duplicates Process While the detection is running, you’ll see a status message indicating the progress.

Once completed, the system will display the number of duplicates found. You’ll also notice the Possible Duplicates facet is updated.

Step 4: Review and Resolve Duplicates

1. Under the Possible Duplicates facet, click Unresolved to filter unresolved duplicates.

2. Click on a record to review the duplicates.

3. Select Resolve Duplicates.

The system will display the duplicate records side by side, along with a confidence percentage. Compare the duplicates and choose to keep either the left, right, or both articles. For example:

• Selecting Keep Right Article will delete the left article.

• Selecting Keep Left Article will delete the right article.

• Selecting Keep Both Articles will mark both articles as Not Duplicates.

You’ll also see the count of articles grouped as duplicates. Pay close attention to ensure accurate resolution.

Step 5: Refresh Counts After resolving duplicates, the counts in the Possible Duplicates facet will update. You may need to refresh the page to see the latest updates.

Note: When Rayyan identifies duplicates, selecting one to keep automatically moves the other(s) to the Resolved status, ensuring no accidental deletion of all records.

Advanced Deduplication with the Systematic Auto-Resolver

For subscribers, Rayyan offers the Systematic Auto-Resolver, allowing customized deduplication criteria. Follow these steps:

Step 6: Access Systematic Auto-Resolver If your membership includes this feature, click Run Systematic Auto-Resolver. If not, you will be prompted to upgrade your membership.

Step 7: Select Deduplication Criteria Choose from the following exact match criteria:

• Title

• Author

• Journal

• Year

• Pages

• DOI number

• Publication Type

You can also combine criteria for more precise deduplication.

Additional Criteria:

• Overall Similarity Percentage: Deduplicate based on a similarity threshold (e.g., 80% similarity).

• Imported References: Specify which imported dataset to prioritize when duplicates are detected across different searches.

Step 8: Adjust Advanced Settings

• Text Normalization: Converts text to lowercase and ignores punctuation for consistent comparisons (default: off).
  

• Articles Customization Protection: Protects any articles with assigned decisions from being accidentally deleted (default: on).
  

Step 9: Confirm Auto-Resolution If you’ve selected the Overall Similarity Percentage criteria, confirm to proceed. Once confirmed, all duplicates meeting the criteria will be resolved automatically, with one copy moved to Resolved and the rest to Deleted.

Important: This action is irreversible. Ensure your selections are accurate before proceeding.

Step 10: Notifications and Results Rayyan will notify you when the Auto-Resolver starts and completes the process. Once finished:

• Resolved articles will appear under the Resolved filter in the Possible Duplicates facet.

• Deleted duplicates will move to the Deleted filter.

Auto-Resolved duplicates are marked with an icon, distinguishing them from manually resolved records.

Please note that some features are available only with certain memberships. Please always check the memberships page to determine if your current membership includes a specific feature. If you would like to change your membership, please visit change my membership. 

Interested in a training session?

We're excited to invite you to join our training sessions on Rayyan! Whether you're new to our platform or looking to enhance your skills, our training sessions are designed to help you get the most out of Rayyan. Register here to secure your spot!

Need Assistance?

Encountering an issue with Rayyan? Start by browsing through our FAQs for quick solutions. If your concern isn't addressed there, please submit a support request through our Help Center. Our dedicated agents are here to assist you promptly. When contacting us, please provide:

• The steps you took leading to the issue.
• The name of your review.
• A screenshot of the error, if possible.