Presentation is loading. Please wait.

Presentation is loading. Please wait.

Get the Data You Need Via Cross- Disciplinary Conversation Alignment Chunhua Weng 1, Gregory W. Hruby 1, Sunmoo Yoon 2, Alla Babina 1, Feng Liu 1, Jianhua.

Similar presentations


Presentation on theme: "Get the Data You Need Via Cross- Disciplinary Conversation Alignment Chunhua Weng 1, Gregory W. Hruby 1, Sunmoo Yoon 2, Alla Babina 1, Feng Liu 1, Jianhua."— Presentation transcript:

1 Get the Data You Need Via Cross- Disciplinary Conversation Alignment Chunhua Weng 1, Gregory W. Hruby 1, Sunmoo Yoon 2, Alla Babina 1, Feng Liu 1, Jianhua Li 1, David Hanauer 3 1 Department of Biomedical Informatics, Columbia University, New York, NY 2 School of Nursing, Columbia University, New York, NY 3 Department of Pediatrics, University of Michigan, Ann Arbor, MI

2 Big Health Data 2

3 Data Access for Life Scientists 3 Data Patient Privacy Data Governance Knowledge Gaps

4 Example Data Request Forms 4 Form TitleInstitution DISCOVERY Committee Data/Report RequestColumbia University PRIMARY CARE INFORMATION PROJECT DATA REQUEST FORMNYC-Department of Health DATA Request Statement of WorkNYC-Department of Health Internal Hub Data Request FormNYC-Department of Health Enterprise Data WarehouseNorthwestern University Honest Broker OfficeMichigan University CTRI Service Request FormUCSD UCSF MEDICAL CENTER CANCER REGISTRYUCSF Clinical Data Access Request Online FormBoston University Data Request FormKansas Univ. Medical Center Enterprise Data WarehouseVanderbuilt Metting Request with ICTR BMIUniversity of Wisconsin UCH RSS New Procotol ApplicationUniversity of Colorado ……others

5 Data Access for Life Scientists…Hard! 5 Vocabulary Differences Conceptualization Discrepancies Tacit Knowledge Gaps

6 Related Work Hruby GW, Cimino JJ, Patel V, Weng C, Toward a Cognitive Task Analysis for Biomedical Query Mediation, Proc of 2014 AMIA Joint Summits on Translational Science, 7-11 April 2014, San Francisco, CA, in press. Hruby GW, Boland MR, Cimino JJ, Gao J, Wilcox AB, Hirschberg J, Weng C, Characterization of the Biomedical Query Mediation Process, Proc of 2013 AMIA Joint Summits on Translational Science, March 2013, San Francisco, CA,

7 How do researchers and query analysts negotiate data needs via ? 7

8 Methods Participants: query analysts from CUMC – A: > 10 years of experience, no MD – B: novice analyst with a non-US MD – C: 2 years of experience, no MD Eight user-reported critical incidents, including 150 messages Message de-identification Thematic analysis of dialog acts 8

9 Results 9

10 Themes in Dialogue Acts 10 Row LabelsM->QM->RQ->MQ->RR->MR->QR->R Total Need Clarification Data transfer 17 Set up meetings Follow-up Confirmation Initial contact Progress Reporting Request problem specification Middle-point data verification 4 4 Request sample patient list 3 3 Revise query2 1 3 Send a starting patient list 3 3 Guide data interpretation 2 2 Request help with data interpretation 2 2 Request help with query formulation 1 12 Results Transfering 2 2 Data reformatting request 1 1 Guide data need clarification 1 1 Help with data interpretation 1 1 Progress Inquiry 1 1 Request help with data interpretation 1 1 Send a starting patient list; Setting up meetings 1 1 Send related information 1 1 Suggest Query Revision 1 1 Grand Total

11 Top Themes 11 Row LabelsQ->RR->Qother Total Need Clarification1533…52 Data transfer17 … Set up meetings85…16 Follow-up17…10 Confirmation52…8 Initial contact26…8 Q: Query Analyst; R: Researcher; M: Manager

12 Example Communication Patterns 12

13 Aggregated Activity Transition Graph 13

14 Need Clarification Example 1 14 Hi Alice, Thank you very much for your help. I just want to make sure I get it right. About the code from your list - there are fifth digits with code (0 and 1) and non of them match your description in the list. Please look at the icd9 codes below and let me know the right ones GASTRIC ULCER ACUTE GASTRIC ULCER ACUTE GASTRIC ULCER WITH HEMORRHAGE, WITHOUT MENTION OF OBSTRUCTION ACUTE GASTRIC ULCER WITH PERFORATION, WITHOUT MENTION OF OBSTRUCTION ACUTE GASTRIC ULCER WITH HEMORRHAGE AND PERFORATION CHRONIC GASTRIC ULCER CHRONIC GASTRIC ULCER WITH HEMORRHAGE CHRONIC GASTRIC ULCER WITH PERFORATION CHRONIC GASTRIC ULCER WITH HEMORRHAGE AND PERFORATION GASTRIC ULCER WITH OBSTRUCTION ACUTE GASTRIC ULCER WITH OBSTRUCTION AC STOMAC ULC W HEM-OBST AC STOM ULC W PERF-OBST AC STOM ULC HEM/PERF-OBS CHRONIC GASTRIC ULCER WITH OBSTRUCTION CHRONIC OR UNSPECIFIED GASTRIC ULCER WITH HEMORRHAGE, WITH OBSTRUCTION CHRONIC OR UNSPECIFIED GASTRIC ULCER WITH PERFORATION, WITH OBSTRUCTION CHRONIC GASTRIC ULCER WITH HEMORRHAGE, PERFORATION, AND OBSTRUCTION Thank you again. A Hi Alice, Thank you very much for your help. I just want to make sure I get it right. About the code from your list - there are fifth digits with code (0 and 1) and non of them match your description in the list. Please look at the icd9 codes below and let me know the right ones GASTRIC ULCER ACUTE GASTRIC ULCER ACUTE GASTRIC ULCER WITH HEMORRHAGE, WITHOUT MENTION OF OBSTRUCTION ACUTE GASTRIC ULCER WITH PERFORATION, WITHOUT MENTION OF OBSTRUCTION ACUTE GASTRIC ULCER WITH HEMORRHAGE AND PERFORATION CHRONIC GASTRIC ULCER CHRONIC GASTRIC ULCER WITH HEMORRHAGE CHRONIC GASTRIC ULCER WITH PERFORATION CHRONIC GASTRIC ULCER WITH HEMORRHAGE AND PERFORATION GASTRIC ULCER WITH OBSTRUCTION ACUTE GASTRIC ULCER WITH OBSTRUCTION AC STOMAC ULC W HEM-OBST AC STOM ULC W PERF-OBST AC STOM ULC HEM/PERF-OBS CHRONIC GASTRIC ULCER WITH OBSTRUCTION CHRONIC OR UNSPECIFIED GASTRIC ULCER WITH HEMORRHAGE, WITH OBSTRUCTION CHRONIC OR UNSPECIFIED GASTRIC ULCER WITH PERFORATION, WITH OBSTRUCTION CHRONIC GASTRIC ULCER WITH HEMORRHAGE, PERFORATION, AND OBSTRUCTION Thank you again. A Hi A…………. ………………. ……………….. Hi A, These are relevant codes pasted below: ICD9 codes Helicobacter pylori Malignant neoplasm of stomach Malignant Carcinoid Tumor of the Stomach Benign neoplasm of stomach Carcinoma in situ of stomach Neoplasm of uncertain behavior of stomach, intestines, and rectum Gastric ulcer unspecified Unspecified functional disorder of stomach Unspecified disorder of stomach and duodenum These are the CPT codes we need: Hi A, These are relevant codes pasted below: ICD9 codes Helicobacter pylori Malignant neoplasm of stomach Malignant Carcinoid Tumor of the Stomach Benign neoplasm of stomach Carcinoma in situ of stomach Neoplasm of uncertain behavior of stomach, intestines, and rectum Gastric ulcer unspecified Unspecified functional disorder of stomach Unspecified disorder of stomach and duodenum These are the CPT codes we need:

15 Need Clarification Example 2 15 Hi, >> Age 18 is the current age or diagnosis age? >> Do you care about which diagnosis is made first? Hi, >> Age 18 is the current age or diagnosis age? >> Do you care about which diagnosis is made first? Hi A…………. ………………. ……………….. I filed the discovery request today. I am requesting 2 lists of MRNs that meet the criteria below. LIST 1 Population: adults aged 18 years or older Date range: 1992-present Inclusion criteria: ICD 079.5, OR , OR , OR 042, OR 043, OR 044, AND ICD 155.0, OR 230 Data elements requested: Date of birth Age sex race/ethnicity I filed the discovery request today. I am requesting 2 lists of MRNs that meet the criteria below. LIST 1 Population: adults aged 18 years or older Date range: 1992-present Inclusion criteria: ICD 079.5, OR , OR , OR 042, OR 043, OR 044, AND ICD 155.0, OR 230 Data elements requested: Date of birth Age sex race/ethnicity

16 Need Clarification Example 3 16 I will double check. It is not 'primary', I will correct it. Then exclude V24.6 and <15. Then exclude ICU only patients, if I can find a way. By the way, I used 'age<18' according to your request doc. You prefer 15 instead? I will double check. It is not 'primary', I will correct it. Then exclude V24.6 and <15. Then exclude ICU only patients, if I can find a way. By the way, I used 'age<18' according to your request doc. You prefer 15 instead? Hi A…………. ………………. ……………….. Hi A, Thanks for the data. It does seem strange to me that the numbers increase so much in Can you confirm that the numbers are indeed correct? Also, can you tell me if the diagnosis is the "primary” diagnosis or not? We are most interested in those with a primary admitting diagnosis that is one of these variables. Please also confirm that those with concomitant V24.6 are excluded and those age <15 are excluded. Thanks, Researcher Hi A, Thanks for the data. It does seem strange to me that the numbers increase so much in Can you confirm that the numbers are indeed correct? Also, can you tell me if the diagnosis is the "primary” diagnosis or not? We are most interested in those with a primary admitting diagnosis that is one of these variables. Please also confirm that those with concomitant V24.6 are excluded and those age <15 are excluded. Thanks, Researcher

17 Iterative Need Clarification 17 Sample patients Data sample Data Requests …. ….. …. ….. Codes Concept Clarification Data Verification

18 Length of Query Processing Time 18 AnalystMD Experienc e CaseStartEndLength Avg ANo> 10 Y 110/8/1310/25/1317 days 26d 211/28/131/6/1440 days 312/28/131/17/1420 days BYes< 0.1 Y 410/28/1311/1/133 days 15d 510/22/1311/2/1310 days 610/1/1310/22/1321 days 71/6/141/23/1417 days CNo~ 2 Y 810/6/111/9/13>400 days >400d Medical knowledge may be associated with more efficient query processing

19 Discussion 19

20 Conclusions Decision support should not be just about user augmentation, but enable user engagement and shared decision making Besides alerts, reminders, information filters or summarizers, we also need better dialog- based decision support to bridge the gap between clinical researchers and Big Data 20

21 Towards Dialog-based Query Support

22 Limitations One institution Small sample Communication outside s 22

23 Thank you NLM R01LM (Bridging the semantic gap between clinical research eligibility criteria and clinical data, PI: Weng) 23


Download ppt "Get the Data You Need Via Cross- Disciplinary Conversation Alignment Chunhua Weng 1, Gregory W. Hruby 1, Sunmoo Yoon 2, Alla Babina 1, Feng Liu 1, Jianhua."

Similar presentations


Ads by Google