Searching for Meaning: Radiology Image Retrieval with ARRS GoldMiner ® Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin, USA

goldminer.arrs.org ARRS American Roentgen Ray Society Publisher of AJR Annual meeting April 26 – May 1, 2009

Google® Images circa 2006

goldminer.arrs.org ARRS GoldMiner ® Image search engine Open access images and articles Built by and for radiologists Powered by a major radiology organization Available freely to all

goldminer.arrs.org Overview ARRS GoldMiner ® How it works Get the most for your search New features Advanced search Spell check GoldMiner Global What’s on the horizon

goldminer.arrs.org Search term

goldminer.arrs.org Click on the thumbnail to view the full-size original image Click on the title to link to the original article

goldminer.arrs.org Dynamically filter results by age, sex, and imaging modality

goldminer.arrs.org ARRS GoldMiner ® Image search engine Radiology images Peer-reviewed journals Combines search strategies Keywords (text strings) Medical concepts Filters search results Age, sex, and imaging modality

goldminer.arrs.org Concept-based Search Semantic knowledge Lexical variants “oesophagus” = “esophagus” = “esophageal” Abbreviations “HCC” = “hepatocellular carcinoma” Synonyms “renal calculi” = “kidney stones” Powered by UMLS® Unified Medical Language System

goldminer.arrs.org Concept-based Search GoldMiner understands relationships between concepts For example: “gallstones” is a type of “gallbladder disease” “osteosarcoma” is a “bone tumor”

goldminer.arrs.org

GoldMiner’s Software Harvester A Web "robot" intelligently crawls journal web sites to gather figures and their text captions Indexer Discovers medical concepts in free-text figure captions Indexes the figures to speed retrieval Search engine Retrieves images to answer your search query

goldminer.arrs.org Image Library 7 core journals including AJR, Radiology, and RadioGraphics 250+ peer-reviewed journals Image collection grows weekly

goldminer.arrs.org Outstanding Performance Fast retrieval Mean = sec Accurate search results High precision and recall (86%+) Image metadata (~85% accuracy) Age, sex, imaging modality

goldminer.arrs.org

A “How-To” Guide Keep it simple ! Use a search term that represents A disease An imaging finding, or An anatomic feature Filter your search results Limit images by age group, sex, and/or imaging modality

goldminer.arrs.org New Features GoldMiner Spelling corrector Advanced search Image Gallery GoldMiner Global 10 languages

goldminer.arrs.org Spelling Correction

goldminer.arrs.org Advanced Search Combine up to 3 search queries e.g., “Lung metastases” and “colon cancer” Limit to core journals Search by age Age group (“Child”) or specific range Sex Imaging modalities

goldminer.arrs.org Image Gallery Instantly add images to a web site All it takes is one line of HTML code! GoldMiner “inlines” relevant images into web pages based on their content

GoldMiner inserts up to four relevant images, based on the page’s title and subject The caption pops up when your mouse hovers over an image; click on the image to view it at full size GoldMiner ® Image Gallery at the CHORUS web site (chorus.rad.mcw.edu)

goldminer.arrs.org GoldMiner Global Multi-lingual search engine 10 other languages Uses MeSH Medical Subject Headings Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish

العربية 日本語 Deutsch Español Русский 中文 Português Italiano Français A customized NLM web interface translates the query term into an English-language MeSH term The ARRS GoldMiner ® server sends a translation request; it uses the English-language query term to retrieve images. Users can search for images using search terms in 10 languages other than English.

Searching in Chinese for “Liver Cancer” “ 肝癌 ”

goldminer.arrs.org Coming Soon Premium content ARRS Categorical Courses ARRS Case-based Review Content-based image retrieval Imaging modality Find similar images Point-of-care learning Category 1 CME

goldminer.arrs.org Premium Content

goldminer.arrs.org Image Modality Classifier Use visual info to detect modality 95% accuracy Combine with existing text data “CT”

goldminer.arrs.org “Visual Search” for Images

goldminer.arrs.org Point of care learning “Just-in-time” knowledge CME credits for clinically directed search ARRS member benefit

goldminer.arrs.org Point of Care Learning Learning LogSearch Results

goldminer.arrs.org The ARRS GoldMiner ® Team Michael Bruno (Penn State / Hershey) Susanna Lee (Harvard / MGH) Michael Richardson (U. Washington) Daniel Rubin (Stanford) thanks to... ARRS staff

goldminer.arrs.org 56+ CME credits Practical sonography Case-based review Subspecialty tracks Great value Members $299