Presentation on theme: "Systematic Searching of the Literature"— Presentation transcript:
1 Systematic Searching of the Literature Canadian Partnership Against Cancer:Atlantic Clinical Practice Guideline WorkshopOctober 16 and 17, 2008Halifax, Nova ScotiaSeana Collins MA, MLISLibrarian EducatorCapital District Health Authority
2 Systematic SearchingThe systematic identification of evidence is an essential step in clinical guideline development. (NICE Guidelines Manual, April 2008, p. 48)
3 Systematic SearchingThere are several steps involved in developing andexecuting a literature search:1. Formulate an “answerable” question - PICOIdentify key search concepts3. Structure the search strategy using Boolean LogicConsider the question domain: therapy? diagnosis? prognosis? etiology?5. Consider the type of information required to answer the question:background information? foreground information?6. Consider the sources of evidence: (core databases, subject databases etc.)
4 Systematic Searching7. Run a preliminary or “scoping” search (What are the existing guidelines?) 8. Execute a comprehensive literature search (database searching, sources of guidelines, subject specific databases) 9. Evaluate the search results: too broad? too narrow? relevant? 10. Refine the search results using appropriate LIMITERS: age group, gender, publication date range, study design etc. 11. Document search results 12. Manage and capture search results (RefWorks, EndNote, ProCite, Reference Manager, etc.)
5 1. Formulate the Question Begin by composing a clear, well stated question.Ambiguous questions will often lead to ambiguoussearch results.Write down your research topic or questionUnderline or circle the most important conceptsThese will be your search termsExample Question:Use of marijuana for treating cancer.Formulate the research topic into an “answerable” question using PICO.
6 PICOPICO is a tool used in evidence base research methods to help identify key concepts and articulate an “answerable question”. P - Population (patient) What is the patient group or condition being assessed? I - Intervention What is (are) the interventions being considered? C – Comparison Intervention Is there a comparison being considered? O - Outcome What is the expected outcome?
7 PICO Our Research Topic: Use of marijuana for treating cancer. Population = cancer patientsWho are the patients of interest?Is there a particular age group, gender or population?What is the health concern?Intervention = marijuanaWhat therapeutic, diagnostic, preventive or other health care interventions are youinterested in knowing more about?What health care management strategies are you interested in comparing?Comparison = noneIs there a comparison to be evaluated against the intervention?Only used if more than one intervention, or if no intervention is a factor.Outcome = improved quality of lifeWhat is the desired outcome to be evaluated?How will the patient or population be affected, or not affected, by the intervention?
8 1. Formulate the Question Our Question:Use of marijuana for treating cancer.“Answerable” Question:Is marijuana an effective treatment in improving the quality of life for cancer patients?Using PICO to formulate a question can help to identify concepts that can be used to structure your search strategy.
9 2. Identify Key ConceptsIdentify each specific concept in the question to be searched:Using our example our search concepts would be:treatment and cancer and marijuanaOne could simply enter these terms into a database and search:treatment AND cancer AND marijuana;however, this would mean:any papers where the term neoplasms is used in place of cancerwould be missedany papers where the the terms: treat or treatments or therapy isused in place of treatment would be missedYou would also retrieve papers that have a passing reference to thetopic and are not useful (not specific or relevant)
10 2. Identify Key ConceptsUse appropriate thesauri or controlled vocabularies, such as MeSH (PubMed/Cochrane) or other subject listings to translate individual concepts into valid subject headings. (EMTREE Headings, CINAHL Headings)Verify if any of your subject terms can be translated to MeSH subheadings.If an appropriate subject heading can not be found, consider doing a keyword search.When keyword searching, remember to use truncation, when keyword searching for compound words or phrases use quotationsi.e. “health services”.Truncation: Symbols which instruct the database to find all word variants and endings (*,$,#). Example: surg$ will retrieve: surgery, surgeon and surgical.
11 3. Construct the Search Strategy Search terms or “search statements” are organized by conceptsor terms which are then combined using Boolean Operators:AND, OR, NOT.It is very helpful to write out your search strategy with the relevantBoolean Operators (OR, AND, NOT) before executing the search inthe database.Example: cancer OR neoplasms AND treatment OR therapy ANDmarijuanaIdentify similar terms or synonymsConnect search terms using Boolean OperatorsConsider phrase searching, some databases such as PubMed andCochrane Library will search for phrases. Put the terms in “quotationmarks” to indicate a phrase: example: “sleeping sickness”
12 Boolean Logic‘Boolean Logic’ uses the logical relationships OR, AND, NOT, to create relationships between concepts or subject headings.Understanding and application of Boolean logic correctly has become fundamental to all online searching.OR AND NOT
13 3. Construct the Search Strategy It is often very helpful to write out your concepts using a table to assist in organizing your search:Your ConceptmarijuanacancertreatmentMeSHcannabisORneoplasmstherapeuticskeywordsweedcarcinoma*therap*Possible search strategy: (neoplasms OR carcinoma*) AND (therapeutics OR therap*) AND (cannibis OR weed)
14 4. Consider Question Domain Consider the question domain or the clinical study category of your question, this will assist you in assessing the results of your search (applicability).therapy question?Clinical studies that discuss the treatment of diseasesdiagnosis question?Clinical studies addressing disease diagnosisprognosis question?Clinical studies addressing disease prognosisetiology question?Clinical studies addressing causation/harm in disease and diagnostics
15 4. Consider Question Domain The consideration of question domain will assist you in identifying the type of clinical studies that would best answer your question. (RCT, meta-analysis, systematic review, cohort study, practice guideline, etc.)In addition it will assist you to identify key appropriate resources to search for literature on your question.Some information resources are stronger in terms of therapeutics (Cochrane Systematic Reviews) others may be stronger in diagnostic questions (Health Technology Assessment Database).
16 5. Type of InformationConsider the type of information or evidence you are looking for.Is it background information? If so, it is likely that you will need to search/consult a textbook. (Harrison’s Principles of Internal Medicine, MD Consult, 5 Minute Clinical Consult, or a Library Catalogue)Is it foreground information? If so, you will need to search the primary literature, it is likely that you will have to conduct a literature search in a bibliographic database. (PubMed, Cochrane, EMBASE etc.)
17 6. ResourcesWhat are considered to be the core resources for your subject area?are these resources available to you?Identify the subject database most relevant to your research question.What type of database is it? bibliographic? textual? (fulltext)Review how each database works, does it use controlled vocabulary?Consult a Librarian and/or your institution’s Library for a list of resourcesGuidelines:Are there established guidelines for specific resources that must beconsulted for the type of study you are conducting? i.e. CochraneManual (systematic reviews), NICE Guidelines Manual, CMAGuidelines Manual, ADAPTE Manual (guideline adaptation)
18 6. Sources of Evidence Core Databases: Cochrane Database of Systematic Reviews – CDSR (Cochrane reviews)Database of Abstracts of Reviews of Effects – DARE (other reviews)Cochrane Central Register of Controlled Trials – CENTRAL (clinical trials)Health Technology Assessment (HTA) databaseMEDLINE/MEDLINE In-Process (PubMed)EMBASECINAHL (Cumulative Index to Nursing and Allied Health Literature)
19 6. Sources of Evidence Subject Specific Databases: PsycINFOAMEDERICPEDroAGELineOther Sources of Evidence:Guidelines: i.e. National Guidelines ClearinghouseControlled Trial RegistriesUK Clinical Research NetworkNational Research Register (NRR) ArchiveWeb of Science / ScopusConference Papers and Dissertations Indices
20 7. Preliminary SearchIt is essential to run a preliminary search to determine if your topic is well published and to determine the level of published evidence available on your topic.If you are conducting a systematic review of RCTs for example, and only one RCT has been published on your topic, it may impact on the validity of your study.Run the preliminary search in the most comprehensive and relevant database to your topic. (Within biomedicine, and for English speaking researchers, this will likely be PubMed.)Most importantly a preliminary literature search will allow you to review search results and determine whether or not your initial search strategy needs to be adjusted.
21 7. Preliminary SearchBased on the preliminary or scoping search you may decide to limit your search results to a specific population group, or Intervention.Consider:Checking the indexing of the relevant articles retrieved in yoursearch results for additional subject headings or terms that can beincorporated into your search strategy.Scanning the abstracts of the results to determine whether you have used the appropriate subject term(s) and relevant key words.A preliminary search will also save you time and effort in terms of sensitivity versus precision.
22 Sensitivity versus Precision It is important that searches for systematic reviews attempt to identify all the relevant literature. However, there needs to be a trade-off between conducting an exhaustive search that will require additional resources versus undertaking a more modest search that may miss some studies.The preliminary / scoping search can help to identify key studies for a review question that can assist in balancing the search sensitivity.
23 8. Execute Full SearchStart by executing a search using broad subject terms.Use key words, including all relevant synonymous terms and word variants in combination with your subject terms. The goal is to be as comprehensive as possible.You can refine and focus the search after you have a set of broad results to limit.Use limiters and inclusion / exclusion criteria to focus and refine your search.
24 Refine the SearchTo decrease search result numbers, consider the use of limiters.Most databases allow users to limit or refine search results to specific criteria. Some examples include:Publication date(s) rangeLanguagePublication type (i.e. Review, Letter, Comment etc.)Age groupGender (i.e. Male / Female)Study-design (i.e. systematic review, guideline, randomised controlled trial)Using limiters to refine your search can provide you with a method to review a manageable number of abstracts, especially if you are searching a very large database such as PubMed.
25 9. Evaluate Search Results Evaluate your search results, are the results what you expectedbased on your research question?Is the evidence reliable? valid?Are the results applicable to your patient population?If your search results are satisfactory utilize the same concepts toexpand and build on your search results using other subject specificdatabases.Basic literature searching skills are transferable from one resourceto another. The basic principles are the same it is the controlledvocabulary and the resource search interface that may differ fromdatabase to database.
26 9. Evaluate Search Results If your search results are not satisfactory consider the following:Re-assess your search question:Have you used the best subject terms to represent the search concepts?For example: perhaps a broader subject term should be used to capture more results?Have you used a keyword search in combination with your subjectsearch to represent concepts?Are your results too narrow? Are your limiters appropriate? For example, have you excluded useful search results by applying too restrictive limits: publication date range? age group? study-design? etc.Are your results too broad? for example should you exclude similar subjectterms that are often associated with one another. For example:glucosamine NOT condroitindementia NOT Alzheimer’s Disease
27 9. Evaluate Search Results Have you used the most appropriate databases or resources for your search?Have you searched all available sources of guidelines?Consult an expert, ask a Librarian or members of your Guidelines Group to review your search strategy.
28 10. Document the SearchLiterature searches must be thorough, transparent and reproducible.It is essential that literature search methods be documented.Provide the search strategies used for each database so that they can be replicated.
29 10. Document the SearchProvide details of which databases you searched (e.g. MEDLINE, EMBASE, CENTRAL, etc.)Ensure that you record when you searched thedatabase this might include:The name of the database searchedThe name of the host/system/vendor/interface usedThe date when the search was runThe years covered by the search (all Limiters used)Filename for search strategy (e.g. Embasestrategy.txt)Filename for search results (e.g. Embaseresults.txt)
30 11. Manage Search ResultsOnce you have completed the literature search, ensure that all of your search results have been saved, ed, printed, or exported. Each resource will provide this functionality.Note:If the databases you have used provide user accounts orregistration, it is a good practice to take advantage of thisoption. It will allow you to save search strategiesand results for future use,This will also allow you to view your search results at any time to refine, adjust, or update and your search.
31 11. Managing Search Results Capture your research results using bibliographicmanagement software such as RefWorks,EndNote, ProCite, Reference Manager.This will allow you to archive your references,produce a formatted bibliography or list ofreferences in any citation style you may require.
32 11. Managing Search Results In addition to archiving references, referencemanagement software can be used for:Coding the references with additional informationProviding links to the full text of articlesTracking the ordering and/or receipt of documentsLinking to word processing software output styles toautomatically cite while writing.It is essential to document and manage all search results in order to maintain transparency and the ability to replicate search results.
33 Exercise #2:Clinical Scenario: A middle aged woman presents in family clinic complaining of severe joint pain, stiffness, and swollen hands and feet. She has a family history of osteoarthritis and wants to know if taking glucosamine supplements will improve her pain and stiffness. What is the question?
35 “Answerable” Question: In adult patients with osteoarthritis, is glucosamine effective in reducing pain and improving function?Exclusion Criteria: NOT chondroitinPossible Limiters: middle aged women (age group), systematic review, guideline, RCTs