Rayyan: Exploring and Filtering Searches for Eligible Studies for Cochrane Reviews rayyan.qcri.org Ahmed Elmagarmid Zbys Fedorowicz* Hossam Hammady Ihab Ilyas Madian Khabsa Mourad Ouzzani Al-Rayyan is the largest municipality in the state of Qatar. Al Rayyan means 'the source of irrigation' and as per Islam it also means 'a door in heaven' or 'one of the Gates of Paradise' . Rayyan’s goal is to help systematic review authors produce high quality reviews in a quick, easy, and intuitive fashion. Authors create reviews, analyze them, collaborate on them, maintain them over time, and get suggestions for article inclusion & exclusion. *In collaboration with

Rayyan’s Goal Help systematic review authors produce high quality reviews in a quick, easy, and intuitive fashion. Authors create reviews, analyze them, collaborate on them, maintain them over time, and get suggestions for article inclusion & exclusion.

Rayyan’s Key Features Web accessible Support different upload formats Fully cloud-based and secure No need to store anything locally Support different upload formats RefMan, BibTeX, EndNote, …, Text or MS Word Multi-facet navigation and filtering Rayyan extracts and computes facets, e.g., authors, MeSH Authors filter on facets, user-labels, and search keywords Similarity graph navigation Similar entries are clustered Fully tunable similarity thresholds Embedded prediction of Exclude/Include Authors label few examples Rayyan learns and presents predictions through a 5-star rating system Collaboration Invite collaborators, viewers, or translators Actions by collaborators are trackable including Exc/Inc conflicts So why use Rayyan!? FREE, secure and large-scale Designed & developed by & for Cochrane authors No (re-)learning curve Predictions for INCLUDE/EXCLUDE

Beta-testing Tested for reliability & reproducibility on 12 Cochrane Reviews (COHG/Skins/UGPD) Searches ranging from 101 to 5.4k references Both new Reviews & updates Users/testers : Cochrane Review Authors, TSCs, Co-Eds/Information Specialists COHG = Cochrane Oral Health Group SKINS = Cochrane Skins Group UGPD = Cochrane Upper Gastrointestinal & Pancreatic Diseases Group TSCs = Trials Search Coordinators Co Eds = Co Editors

A typical use case Authors UPLOAD searches NAVIGATE searches electronically via `word cloud’ Record, LABEL and SHARE ‘selection’ of studies Receive prompts thru the PREDICTION feature Invite co-authors, TRANSLATORS to collaborate FINALISE included and potentially included studies Store as meta-data

My dashboard

NAVIGATE …ABSTRACT VISIBLE See also INCLUDE UNDECIDE EXCLUDE AND OPTION TO CREATE LABEL

FILTER ‘ INCLUDED’ STUDIES NB STAR RATING PREDICTION FEATURE

WORD CLOUD FILTER SELECTED 154 OUT OF 209

PULL DOWN MENU “ EXCLUDE” SELECT PRESPECIFIED LABEL OR CREATE NEW

CREATE LABEL IN THIS CASE ‘ EXCLUDED’ BECAUSE CITATION REFERS TO EARLIER VERSION OF THIS COCHRANE REVIEW

REVIEW ON HALITOSIS WORD CLOUD IDENTIFIES ‘ MULTIPLE SCLEROSIS’ USE WORD CLOUD TO FILTER 8/188 ENTRIES LABEL STUDIES AS ‘ IRRELEVANT TO REVIEW’ >>> EXCLUDED

SEARCH BOX FREE TEXT / TITLE AUTHOR

Rayyan is YOURS use it! rayyan.qcri.org See you at the breaks for a live demo! So what’s next for Rayyan? Enhanced and New Features More Analytics Enhanced prediction Enhanced support for updates Integration with Cochrane (RevMan) … But more importantly … We want to hear from you!