Detecting duplicate references/articles in a review

Rayyan automatically detects and resolves 100% duplicate articles from searches. Rayyan then offers duplicate resolution for statistically likely duplicates. Rayyan was ranked number one for both accuracy and sensitivity for deduplication. 

To Detect duplicates in Rayyan, follow the steps below:

1. Click Detect duplicates

2. Click Ok.

You will see the message: Duplicate detection is running, please wait.

Note: Detecting duplicates can be performed once on each unique dataset in a review. If you wish to run it again, you will have to add or delete references/articles from your review first. If you see the message: A search must be added or deleted before running duplicate detection again, this means that you have already run duplicate detection on your dataset. Please continue to the next step to resolve the duplicates. 

Once duplicate detection is finished, you will see the message: x duplicates found. You will also see the Possible Duplicates facet in the workbench at the left (you might need to scroll down as the box might be added at the bottom of the workbench).

3. Under Possible Duplicates, click Unresolved to filter by unresolved duplicates.

4. Click on the record you wish to resolve.

5. Click Resolve duplicate.

6. The detected duplicates will be listed on top of each other in the bottom section. A confidence percentage will be displayed for each. Compare the detected duplicates and click Delete if the references were duplicates, or Not duplicate otherwise.

Note: If 2 (n) duplicates are found, you can make a decision (Delete/Not a duplicate) on only 1 (n-1) and the other will be moved to resolved automatically. This is to ensure that you do not delete them all by mistake. 

You can see that the counts will be updated on the Possible Duplicates facet. You might need to refresh the page to get the latest update.