2 Systematic Reviews - Part II John Gale Information Specialist – Institute of Psychiatry Sonya Lipczynska Information Specialist - Dentistry & Physiotherapy

3 Introduction More advanced search techniques using Ovid databases Reading a search strategy Grey literature: dissertations, conference proceedings, Government reports, unpublished trials etc Selecting studies to include in your review Documenting your search Where to go to get extra help/find out more

4 An example of a search strategy CD pub2/abstract (navigate to Appendices for search strategy via Jump to box under Article tab).

5 Practical exercise Truncation – behavio* therapy Wildcard searching – p?ediatrics Adjacency searching – acute adj5 otitis media Boolean operators – AND/OR/NOT Floating sub-headings Limiting to fields – PT, TW, AB Subject headings vs free-text searching

6 Sources of published search strategies – for some or all of your search concepts Cochrane Library –Cochrane Reviews: Cochrane Database of Systematic Reviews (Appendix or review) –Other Reviews: Database of Abstracts of Reviews of Effect Campbell Collaboration –produce systematic reviews in education, crime and justice, and social welfare (Appendix or review) Other published systematic reviews –Possibly online only in an appendix (may not be in pdf version) –Evaluate the quality – can you do better?can you do better

7 Peer review of search strategies Mcgowan, J., Sampson, M., Lefebvre, C.. An Evidence Based Checklist for the Peer Review of Electronic Search Strategies (PRESS EBC). Evidence Based Library and Information Practice, North America, 5, Mar Available at:. Date accessed: 30 Aug e/view/7402/6436 PRESS EBC can be used to assess your own search strategy as well as those of systematic reviews you are reading or thinking of making part of your own strategy.

8 Using Filters Cochrane filter for RCTs – (section ) SIGN – Centre for Reviews and Dissemination – National Clinical Guideline Centre – (navigate to appendix of specific guideline) McMaster University Hedges Project –

9 Grey Literature There are many definitions of grey literature, but it is usually taken to mean literature that is not formally published in sources such as books or journal articles. (Cochrane Handbook, 2011) Examples of grey literature include: Technical or research reports from government agencies Reports from scientific research groups Working papers from research groups or committees Doctoral dissertations Some conference proceedings and official publications

10 Publication bias Papers with more interesting results are more likely to be: Submitted for publication Accepted for publication Published in a major journal Published in the English language Publication bias and outcome reporting bias: agomelatine as a case example. Howland, R. H. Journal of Psychoscocial Nursing and Mental Health Services 49(9), September 2011

11 Searching grey literature I openGrey (System for Information on Grey Literature) Libraries of specialist research organisations and professional societies Very useful guide produced by the Canadian Agency for Drugs and Technologies in Health (CADTH) available herehere

12 Searching grey literature II HMIC (The Healthcare Management Information Consortium) – DH and Kings Fund – via Databases list (Kings username and password) DH publications including: circulars and press releases Kings Fund research on health and community, care management, organizational development, inequalities in health, user involvement, race and health

13 Searching grey literature III Directory of Open-Access repositories. Cross-searches the open-access repositories of 1000s of universities, world-wide. Many references contain full-text working papers alongside references to journal articles, these and reports. Full-text available where copyright allowswww.opendoar.org Social Science Research Network ,800 abstracts and 365,700 full-text docs. Subject-specific networks, including one for health

14 Trials Registers Metaregisters of Controlled Trials – which bring together several international sources The IFPMA clinical trial portal The International Standard Randomised Controlled Trial Number (ISRCTN) registerThe International Standard Randomised Controlled Trial Number (ISRCTN) register The WHO International Clinical Trials registry US register of clinical trials Other resources available in the Cochrane Handbook

15 Conference Proceedings Need to try and get full-text if possible Can be found on: Medline – search for Congresses and then combine with a topic using AND Web of Science SciVerse Scopus Access all of these from the Library Services database list

16 Theses and Dissertations Some Ovid databases e.g. CINAHL and PsycInfo include dissertations WorldCat dissertations and Theses (OCLC) can be accessed via Kings databases page Senate House – Index to Theses in Great Britain and Ireland covers >500,000 theses British Librarys eThos site – Scirus – you can use the Advanced Search to search just for theses and dissertationsScirus

17 Handsearching Physically searching the contents of journals, conference proceedings and abstracts page by page Can identify articles not yet included in electronic databases Articles or studies not indexed properly BUT its impossible to search all journals so prioritise using the results of your searches of databases such as MEDLINE, EMBASE etc You can also use the reference lists of papers you have found earlier

18 Direct Contact Making direct contact – usually by – with the authors or organisations who are experts in this field Authors often include their contact details in abstracts Can find out about ongoing or unpublished research Papers not on your list which authors might be aware of

19 Relevant internet resources This does NOT mean Google or Google Scholar! Look at specific relevant websites aimed at a particular topic or subject search engines: Royal College and Society webpages for reports and guidance NICE Evidence Search - –NHS search engine to locate evidence in health and social care. TRIP database –clinical search tool to identify the highest quality clinical evidence for clinical practice.

20 Selecting studies and managing references Merge and de-duplicate search results using bibliographic software (make a copy of de-duped) Examine title and abstracts Best practice to retain evidence of what articles have been excluded (and potentially why) Retrieve full text of potentially relevant articles Link together multiple reports

21 How much is enough? Funding/time –A broad search topic or searching more databases/resources etc all increases the amount of time required to sift results. No set timescale – depends on your circumstances and any funding restrictions Focusing on RCTs/observational studies –Widening a SR to include observational studies is likely to increase the number of results you have to sift through. Personal/team knowledge – are all key known papers in your subject area retrieved in the search? –Amend search if not/include further databases – you would expect key papers to be returned by a successful search strategy if indexed in the databases you are searching.

22 Inclusion/Exclusion Criteria Randomised Controlled Trials (RCTs) usually seen as the gold standard [e.g. required for Cochrane SRs on interventions if possible] –This not always possible e.g. Interventions on pregnant women How big was the trial? –Will you only include trials with >5; >10; >50; >100 active participants? Double-blind? Compared to placebo, waiting list or another treatment?

23 Study flow diagrams Flow diagram should present the number of: unique records identified by the searches records excluded after preliminary screening (e.g. of titles and abstracts) records retrieved in full text records or studies excluded after assessment of full text studies meeting eligibility criteria for the review studies contributing to the main outcome check lists and flow diagrams available from the PRISMA web sitePRISMA web site (PRISMA, 2009)

24

25 Documenting your search: Why? This is crucial because: It forms a vital part of the systematic review in its own right Your searches should be able to be evaluated by other researchers and reproduced in the future

26 Documenting your search: What you need to record Information about the databases and interfaces searched including dates covered and when you did your search Full, detailed search strategies (copied and pasted) and the number of records retrieved Details of other searches including conference proceedings, handsearching, contact with experts, reference lists and citation searching and internet searching Youll also need to specify the criteria you use to select trials – beyond the scope of this course! There are examples at [Appendix 2]

27 Reporting Guidelines and Evaluation tools Equator Network: overview of reporting guidelines. Links to:Equator Network –Consolidated Standards Of Reporting Trials - CONSORT website: –Preferred Reporting Items for Systematic Reviews and Meta-Analyses – PRISMA website: statement.orgwww.prisma- statement.org –Meta-analyses of observational studies – MOOSE - article and proposed reporting checklist available at PMID: Critical Appraisal Skills Programme

28 External Resources CRDs Guidance for undertaking reviews in healthcare Cochrane Handbook (for systematic reviewers) Intertasc – search filter resource

29 EndNote courses Keep an eye out on Skills Forge 1:1s available with your Information Specialist whose contact details you can find at:

30 Further information and support Library Services Searching for Literature guide User guides on specific interfaces and databases available at Contact your schools Information Specialist at EndNote pages at

31 Online evaluation form evaluation/index.aspx Go to the Internal Kings webpage Click on the IT Services icon Click Training from the left hand menu Click on the link to Course Evaluation on the left hand menu Click Information skills course evaluation Select todays date for the LIB212 Enhancing skills for systematic reviews Part 2 course and fill in the online form