1. Searching for Meaning: Radiology Image Retrieval with ARRS GoldMiner ® Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin, USA

2. goldminer.arrs.org ARRS American Roentgen Ray Society Publisher of AJR Annual meeting April 26 – May 1, 2009

3. Google® Images circa 2006

5. goldminer.arrs.org ARRS GoldMiner ® Image search engine Open access images and articles Built by and for radiologists Powered by a major radiology organization Available freely to all

6. goldminer.arrs.org Overview ARRS GoldMiner ® How it works Get the most for your search New features Advanced search Spell check GoldMiner Global What’s on the horizon

7. goldminer.arrs.org Search term

8. goldminer.arrs.org Click on the thumbnail to view the full-size original image Click on the title to link to the original article

9. goldminer.arrs.org Dynamically filter results by age, sex, and imaging modality

10. goldminer.arrs.org ARRS GoldMiner ® Image search engine Radiology images Peer-reviewed journals Combines search strategies Keywords (text strings) Medical concepts Filters search results Age, sex, and imaging modality

11. goldminer.arrs.org Concept-based Search Semantic knowledge Lexical variants “oesophagus” = “esophagus” = “esophageal” Abbreviations “HCC” = “hepatocellular carcinoma” Synonyms “renal calculi” = “kidney stones” Powered by UMLS® Unified Medical Language System

12. goldminer.arrs.org Concept-based Search GoldMiner understands relationships between concepts For example: “gallstones” is a type of “gallbladder disease” “osteosarcoma” is a “bone tumor”

16. goldminer.arrs.org

17. GoldMiner’s Software Harvester A Web "robot" intelligently crawls journal web sites to gather figures and their text captions Indexer Discovers medical concepts in free-text figure captions Indexes the figures to speed retrieval Search engine Retrieves images to answer your search query

18. goldminer.arrs.org Image Library 7 core journals including AJR, Radiology, and RadioGraphics 250+ peer-reviewed journals Image collection grows weekly

19. goldminer.arrs.org Outstanding Performance Fast retrieval Mean = 0.041 sec Accurate search results High precision and recall (86%+) Image metadata (~85% accuracy) Age, sex, imaging modality

20. goldminer.arrs.org

21. A “How-To” Guide Keep it simple ! Use a search term that represents A disease An imaging finding, or An anatomic feature Filter your search results Limit images by age group, sex, and/or imaging modality

22. goldminer.arrs.org New Features GoldMiner Spelling corrector Advanced search Image Gallery GoldMiner Global 10 languages

23. goldminer.arrs.org Spelling Correction

24. goldminer.arrs.org Advanced Search Combine up to 3 search queries e.g., “Lung metastases” and “colon cancer” Limit to core journals Search by age Age group (“Child”) or specific range Sex Imaging modalities

27. goldminer.arrs.org Image Gallery Instantly add images to a web site All it takes is one line of HTML code! GoldMiner “inlines” relevant images into web pages based on their content

28. GoldMiner inserts up to four relevant images, based on the page’s title and subject The caption pops up when your mouse hovers over an image; click on the image to view it at full size GoldMiner ® Image Gallery at the CHORUS web site (chorus.rad.mcw.edu)

29. goldminer.arrs.org GoldMiner Global Multi-lingual search engine 10 other languages Uses MeSH Medical Subject Headings Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish

30. العربية 日本語 Deutsch Español Русский 中文 Português Italiano Français A customized NLM web interface translates the query term into an English-language MeSH term The ARRS GoldMiner ® server sends a translation request; it uses the English-language query term to retrieve images. Users can search for images using search terms in 10 languages other than English.

31. Searching in Chinese for “Liver Cancer” “ 肝癌 ”

33. goldminer.arrs.org Coming Soon Premium content ARRS Categorical Courses ARRS Case-based Review Content-based image retrieval Imaging modality Find similar images Point-of-care learning Category 1 CME

34. goldminer.arrs.org Premium Content

35. goldminer.arrs.org Image Modality Classifier Use visual info to detect modality 95% accuracy Combine with existing text data “CT”

36. goldminer.arrs.org “Visual Search” for Images

37. goldminer.arrs.org Point of care learning “Just-in-time” knowledge CME credits for clinically directed search ARRS member benefit

38. goldminer.arrs.org Point of Care Learning Learning LogSearch Results

39. goldminer.arrs.org The ARRS GoldMiner ® Team Michael Bruno (Penn State / Hershey) Susanna Lee (Harvard / MGH) Michael Richardson (U. Washington) Daniel Rubin (Stanford) thanks to... ARRS staff

40. goldminer.arrs.org 56+ CME credits Practical sonography Case-based review Subspecialty tracks Great value Members $299