Presentation is loading. Please wait.

Presentation is loading. Please wait.

New York State Center of Excellence in Bioinformatics & Life Sciences R T U Referent Tracking: The New Paradigm Dagstuhl May 23th, 2006 Werner Ceusters,

Similar presentations


Presentation on theme: "New York State Center of Excellence in Bioinformatics & Life Sciences R T U Referent Tracking: The New Paradigm Dagstuhl May 23th, 2006 Werner Ceusters,"— Presentation transcript:

1

2 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Referent Tracking: The New Paradigm Dagstuhl May 23th, 2006 Werner Ceusters, MD Ontology Research Group Center of Excellence in Bioinformatics & Life Sciences SUNY at Buffalo, NY

3 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Three models for a Comprehensive Patient Care Information System * Information model of the medical record: What can be said ? Process model of clinical care: What ought to occur ? Inferred model of the state of the patient: What actually occurs. * Rector AL, Nolan WA, and Kay S. Foundations for an Electronic Medical Record. Methods of Information in Medicine 30: 179-86, 1991. (Figure 1) requirements inferences modification Inferred model of the state of the patient: What actually occurs. ?

4 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Is ‘saying that an event has occurred’ a requirement for the event to have occurred ? ? What ‘event’ occurred in my left hand being a part of my left arm ? An event model of medical information representation * ‘The real world consist of objects (or entities)’ ‘Objects interact with other objects and can be associated with other objects by relationships’ ‘When two or more objects interact in the real world, an ‘event’ is said to have occurred’ * Huff SM, Rocha RA, Bray BE, Warner HR, and Haug PJ. An Event Model of Medical Information Representation. J Am Med Informatics Assoc. 1995;2:116-134.

5 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Observation Event Instance Created from the Statement ‘ Surgical clips are again seen along the right mediastinum ’ * * Huff SM, Rocha RA, Bray BE, Warner HR, and Haug PJ. An Event Model of Medical Information Representation. J Am Med Informatics Assoc. 1995;2:116-134. ? Are the clips there because they have been observed ? Is the observation located in the mediastinum ?

6 New York State Center of Excellence in Bioinformatics & Life Sciences R T U What is wrong in both cases (and so many others) ? Further clues to the answer: –Huff SM, Rocha RA, Bray BE, Warner HR, and Haug PJ. An Event Model of Medical Information Representation. J Am Med Informatics Assoc. 1995;2:116-134. –Rector et al.’s paper: Many of the difficulties experienced in attempting to generalize existing [patient record] systems stem from the fact that they have pre-selected and distorted information in order to fit into particular applications, usually clinical research and epidemiology. The models emit much of the information actually used in clinical care and do not accurately reflect the real status of the data they record.

7 New York State Center of Excellence in Bioinformatics & Life Sciences R T U What is wrong (continued) ? An overemphasis on data and information and too little attention to reality: –“data modelling” –“information modelling” Is the “Object Oriented” model approach any better, since, after all, objects are said to be those things that exist in reality ? –The object-oriented model is based on a collection of objects –An object contains values stored in instance variables within the object. –Unlike the record-oriented models, these values are themselves objects.

8 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Current mainstream thinking data information knowledge wisdom - representation (- representation) Questions not often enough asked: What part of our data corresponds with something out there in reality ? What part of reality is not captured by our data, but should because it is relevant ? Reality What is there on the side of the patient

9 New York State Center of Excellence in Bioinformatics & Life Sciences R T U The story of Jane Smith an old case, well known in the literature...

10 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Jane’s favourite supermarket July 4th, 1990: Jane goes shopping: The freezer section of Jane’s favourite supermarket The only available warning sign used outside A very suspiciously shaped upper leg

11 New York State Center of Excellence in Bioinformatics & Life Sciences R T U A visit to the hospital City Health Centre Dr. Peters (City HC) Dr. Longley

12 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Diagnosis: a severe spiral fracture of the femur

13 New York State Center of Excellence in Bioinformatics & Life Sciences R T U The City HC’s medical record Main principles: –a faithful record of the clinicians’ observations: what they have heard, seen, thought and done. –captures in a structured form all of the ‘clinically significant’ information in the narrative notes, where by clinically significant they mean the information which is within the medical domain rather than the domain of everyday life. Rector AL, Nowlan WA, Kay S, Goble CA, Howkins TJ. A framework for modelling the electronic medical record. Methods Inf Med. 1993 Apr;32(2):109-19.

14 New York State Center of Excellence in Bioinformatics & Life Sciences R T U CityHC’s representation formalism (for statements in records) Rector AL, Nowlan WA, Kay S, Goble CA, Howkins TJ. A framework for modelling the electronic medical record. Methods Inf Med. 1993 Apr;32(2):109-19. Categories: “ represent concepts and are analogous to classes in other formalisms ” Individuals: “ concrete instances of categories which persist in space and time ” Occurrences: “ are specific occurrences of individuals and must be situated in space and time. The most important group of occurrences are observations — i.e. agents ’ observations of individuals. ”

15 New York State Center of Excellence in Bioinformatics & Life Sciences R T U A look at the database: use of SNOMED codes for ‘unambiguous’ understanding 557204/07/199026442006closed fracture of shaft of femur 557204/07/199081134009Fracture, closed, spiral 557212/07/199026442006closed fracture of shaft of femur 557212/07/19909001224Accident in public building (supermarket) 557204/07/199079001Essential hypertension 093924/12/1991255174002benign polyp of biliary tract 230921/03/199226442006closed fracture of shaft of femur 230921/03/19929001224Accident in public building (supermarket) 4780403/04/199358298795Other lesion on other specified region 557217/05/199379001Essential hypertension 29822/08/19932909872Closed fracture of radial head 29822/08/19939001224Accident in public building (supermarket) 557201/04/199726442006closed fracture of shaft of femur 557201/04/199779001Essential hypertension PtIDDateObsCodeNarrative 093920/12/1998255087006malignant polyp of biliary tract * * * * cause, not disorder How many disorders have patients 5572, 2309 and 298 each had thus far in their lifetime ? How many numerically different disorders are listed here ? How many different types of disorders are listed here ?

16 New York State Center of Excellence in Bioinformatics & Life Sciences R T U 557204/07/199026442006closed fracture of shaft of femur 557204/07/199081134009Fracture, closed, spiral 557212/07/199026442006closed fracture of shaft of femur 557212/07/19909001224Accident in public building (supermarket) 557204/07/199079001Essential hypertension 093924/12/1991255174002benign polyp of biliary tract 230921/03/199226442006closed fracture of shaft of femur 230921/03/19929001224Accident in public building (supermarket) 4780403/04/199358298795Other lesion on other specified region 557217/05/199379001Essential hypertension 29822/08/19932909872Closed fracture of radial head 29822/08/19939001224Accident in public building (supermarket) 557201/04/199726442006closed fracture of shaft of femur 557201/04/199779001Essential hypertension PtIDDateObsCodeNarrative 093920/12/1998255087006malignant polyp of biliary tract Same patient, same hypertension code: Same (numerically identical) hypertension ? Different patients, same fracture codes: Same (numerically identical) fracture ? Same patient, different dates, same fracture codes: same (numerically identical) fracture ? Same patient, same date, 2 different fracture codes: same (numerically identical) fracture ? Same patient, different dates, Different codes. Same (numerically identical) polyp ? Does seeing the labels help you ? Different patients. Same supermarket? Maybe the same (irrelevant ?) freezer section ? Or different supermarkets, but always in the freezer sections ?

17 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Main problem areas for CityHC’s EHR Statements refer only very implicitly to the concrete entities about which they give information. Idiosyncracies of concept-based terminologies –tell us only that some instance of the class the codes refer to, is refered to in the statement, but not what instance precisely. –Are usually confused about classes and individuals. “Country” and “Belgium”. Mixing up the act of observation and the thing observed. Mixing up statements and the entities these statements refer to.

18 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Consequences Very difficult to: –Count the number of (numerically) different diseases Bad statistics on incidence, prevalence,... Bad basis for health cost containment –Relate (numerically same or different) causal factors to disorders: –Dangerous public places (specific work floors, swimming pools), –dogs with rabies, –HIV contaminated blood from donors, –food from unhygienic source,... Hampers prevention –...

19 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Proposed solution: Referent Tracking Purpose: –explicit reference to the concrete individual entities relevant to the accurate description of each patient’s condition, therapies, outcomes,... Method: –Introduce an Instance Unique Identifier (IUI) for each relevant individual (= particular, = instance). –Distinguish between IUI assignment: for instances that do exist IUI reservation: for entities expected to come into existence in the future

20 New York State Center of Excellence in Bioinformatics & Life Sciences R T U ‘Ontology’: the study of being as a science ‘An ontology’ is a representation of some pre-existing domain of reality which – (1) reflects the properties of the objects within its domain in such a way that there obtains a systematic correlation between reality and the representation itself, – (2) is intelligible to a domain expert – (3) is formalized in a way that allows it to support automatic information processing ‘ontological’ (as adjective): – Within an ontology. – Derived by applying the methodology of ontology –... Ontology

21 New York State Center of Excellence in Bioinformatics & Life Sciences R T U An ontological analysis continuants City HC The freezer section of Jane’s favourite supermarket Jane’s left femur Jane’s left femur fracture Jane Smith Dr. Peters Jane’s left femur Jane’s fracture’s image Dr. Longley City HC’s EHR system t Jane’s falling Jane’s femur breaking Dr. Peter’s examination of Jane’s fracture Dr. Peter’s ordering of an X-ray Shooting the pictures of Jane’s leg occurrents Jane’s fracture’s healing Dr. Peter’s diagnosis making Jane dies Freezer section dismantled Dr. Longley’s examination of Jane’ s fracture Jane’s fracture as seen by Dr. Peters Jane’s fracture as seen by Dr. Longley Instances of Jane’s fracture Universals EHR system HC Freezer section Person Femur Fracture Image

22 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Ontological recategorisation CityHCDr. Peters Jane Smith Jane Smith’s Fracture Of Femur Fracture Of Femur Severe Spiral City HC exists on 4th July 1990 Dr. Peters located at City HC on 4th July 1990 Jane Smith’s consultation with Dr. Peters at City HC on 4th July 1990 Dr. Peters’ assessment of Jane Smith’s fracture of femur at City HC on 4th July 1990 Jane Smith’s Fracture Of Femur’s severity Jane Smith’s Fracture Of Femur’s shape

23 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Essentials of Referent Tracking Generation of universally unique identifiers; deciding what particulars should receive a IUI; finding out whether or not a particular has already been assigned a IUI (each particular should receive maximally one IUI); using IUIs in the EHR, i.e. issues concerning the syntax and semantics of statements containing IUIs; determining the truth values of statements in which IUIs are used; correcting errors in the assignment of IUIs.

24 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Architecture of a Referent Tracking System (RTS) RTS: system in which all statements referring to particulars contain the IUIs for those particulars judged to be relevant. Ideally set up as broad as possible: – some metrics: % of particulars referred to by means of IUI % of HCs active in a region –Geographic region –functional region: defined by contacts amongst patients % of patients referred to within a region Services: –IUI generator –IUI repository: statements about assignments and reservations –Referent Tracking ‘Database’ (RTDB): index (LSID) to statements relating instances to instances and classes

25 New York State Center of Excellence in Bioinformatics & Life Sciences R T U IUI generation Universally Unique IDs: –recently standardized through ISO/IEC 9834- 8:2004, –specifies format and generation rules enabling users to produce 128-bit identifiers that are either guaranteed or have a high probability of being globally unique –Meaningless strings –Central management or certification not needed to guarantee uniqueness (But use as IUI requires this)

26 New York State Center of Excellence in Bioinformatics & Life Sciences R T U IUI assignment = an act carried out by the first ‘cognitive agent’ feeling the need to acknowledge the existence of a particular it has information about by labelling it with a UUID. ‘cognitive agent’: –A person; –An organisation; –A device or software agent, e.g. Bank note printer, Image analysis software.

27 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Criteria for IUI assignment (1) 1.The particular’s existence must be determined: –Easy for persons in front of you, body parts,... –Easy for ‘planned acts’: they do not exist before the plan is executed ! Only the plan exists and possibly the statements made about the future execution of the plan –More difficult: subjective symptoms But the statements the patient makes about them do exist ! –However: no need to know what the particular exactly is, i.e. which universal it instantiates No need to be able to point to it precisely –One bee out of a particular swarm that stung the patient, one pain out of a series of pain attacks that made the patient worried –But: this is not a matter of choice, not ‘any’ out of...

28 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Criteria for IUI assignment (2) 2.The particular’s existence ‘may not already have been determined as the existence of something else’: Morning star and evening star Himalaya Multiple sclerosis 3.May not have already been assigned a IUI. 4.It must be relevant to do so: Personal decision, (scientific) community guideline,... Possibilities offered by the EHR system If a IUI has been assigned by somebody, everybody else making statements about the particular should use it

29 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Assertion of assignments IUI assignment is an act of which the execution has to be asserted in the IUI-repository: –D i = IUI d IUI of the registering agent A i the assertion of the assignment »IUI a IUI of the author of the assertion »IUI p IUI of the particular »t ap time of the assignment t d time of registering A i in the IUI-repository Neither t d or t ap give any information about when # IUI p started to exist ! That might be asserted in statements providing information about # IUI p.

30 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Management of the IUI-repository Adequate safety and security provisions –Access authorisation, control, read/write,... –Pseudonymisation Deletionless but facilities for correcting mistakes. Registration of assertion ASAP after IUI assignment (virtual, e.g. LSID) central management with adequate search facilities.

31 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Representation in the EHR Relevant particulars referred to using IUIs Relationships that obtain between particulars at time t expressed using relations from an ontology (type OBO) Statements describing for each particular, at time t: –Of what universal from an ontology it is an instance of –AND/OR (if one insists): –By means of what concept from a concept-based system it can sensibly be described CityHCDr. Peters Jane Smith Jane Smith’s Fracture Of Femur Fracture Of Femur Severe Spiral Jane Smith’s consultation with Dr. Peters at City HC on 4th July 1990 Dr. Peters’ assessment of Jane Smith’s fracture of femur at City HC on 4th July 1990 Jane Smith’s Fracture Of Femur’s severity Jane Smith’s Fracture Of Femur’s shape 4th July 1990 particulars

32 New York State Center of Excellence in Bioinformatics & Life Sciences R T U PtoP statements - particular to particular ordered sextuples of the form R i = IUI a is the IUI of the author of the statement, t a a reference to the time when the statement is made, r a reference to a relationship (available in o) obtaining between the particulars referred to in P, o a reference to the ontology from which r is taken, P an ordered list of IUIs referring to the particulars between which r obtains, and, t r a reference to the time at which the relationship obtains. P contains as much IUIs as required by the arity of r. In most cases, P will be an ordered pair such that r obtains between the particular represented by the first IUI and the one referred to by the second IUI. As with A statements, these statements must also be accompanied by a meta-statement capturing when the sextuple became available to the referent tracking system.

33 New York State Center of Excellence in Bioinformatics & Life Sciences R T U PtoU statements – particular to universal U i = IUI a is the IUI of the author of the statement, t a a reference to the time when the statement is made, inst a reference to an instance relationship available in o obtaining between p and cl, o a reference to the ontology from which inst and u are taken, IUI p the IUI referring to the particular whose inst relationship with u is asserted, u the universal in o to which p enjoys the inst relationship, and, t r a reference to the time at which the relationship obtains.

34 New York State Center of Excellence in Bioinformatics & Life Sciences R T U U - -tuples: “negative findings” Relation type Type of Negative Finding Examples % C1 * A particular is not related in a specific way to any instance of a universal at some given time he denies abdominal pain; no alcohol abuse; no hepatosplenomegaly; he has no children, without any cyanosis 85.4 C2 A particular is not the instance of a given class at some given time which ruled out primary hyperaldosteronism, nontender, in no apparent distress, Romberg sign was absent, no palpable lymph nodes 12.4 C3 A particular is not related to another particular in a specific way at some given time this record is not available to me; it is not the intense edema she had before; he has not identified any association with meals. 2.2 * ‘p’ ranges over particulars, ‘u’ over universals U  i = The particular referred to by IUI a asserts at time t a that the relation r of ontology o does not obtain at time t r between the particular referred to by IUI p and any of the instances of the universal u at time t r

35 New York State Center of Excellence in Bioinformatics & Life Sciences R T U PtoCO statements particular to concept code Co i = IUI a is the IUI of the author of the statement, t a a reference to the time when the statement is made, cbs a reference to the concept-based system from which co is taken, IUI p the IUI referring to the particular which the author associates with co, co the concept-code in cbs which the author associates with p, and, t r a reference to the time at which the author considers the association appropriate,

36 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Interpretation of PtoCO statements must be interpreted as simple indexes to terms in a dictionary. All that such a statement tells us, is that within the linguistic and scientific community in which cbs is used, the terms associated with co may - i.e. are acceptable to - be used to denote p in their determinative version.

37 New York State Center of Excellence in Bioinformatics & Life Sciences R T U A SNOMED-CT example #IUI-0945: author of the statement #IUI-1921: the left testicle of patient #IUI-78127 367720001: the SNOMED concept-code to which “left testis” is (in SNOMED) attached as term So we can denote #IUI-1921 by means of that left testis that entire left testis that testicle, that male gonad, that testis that genital structure that physical anatomical entity BUT NOT: that SNOMED-CT concept

38 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Pragmatics of IUIs in EHRs IUI assignment requires an additional effort In principle no difference qua (or just a little bit more) effort compared to using directly codes from concept- based systems –A search for concept-codes is replaced by a search for the appropriate IUI using exactly the same mechanisms Browsing Code-finder software Auto-coding software (CLEF NLP software Andrea Setzer) –With that IUI comes a wealth of already registered information –If for the same patient different IUIs apply, the user must make the decision which one is the one under scrutiny, or whether it is again a new instance A transfert or reference mechanism makes the statements visible through the RTDB

39 New York State Center of Excellence in Bioinformatics & Life Sciences R T U PtoN-statements N i = The person referred to by IUI a asserts at time t a that n i is the name of the nametype nt j that designates in the real world the particular referred to by IUI p at t r. This template will further be referred to as PtoN template. Would assert that “Werner” is my first name, and “Ceusters” is my last name.

40 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Advantage: better reality representation 557204/07/199026442006closed fracture of shaft of femur 557204/07/199081134009Fracture, closed, spiral 557212/07/199026442006closed fracture of shaft of femur 557212/07/19909001224Accident in public building (supermarket) 557204/07/199079001Essential hypertension 093924/12/1991255174002benign polyp of biliary tract 230921/03/199226442006closed fracture of shaft of femur 230921/03/19929001224Accident in public building (supermarket) 4780403/04/199358298795Other lesion on other specified region 557217/05/199379001Essential hypertension 29822/08/19932909872Closed fracture of radial head 29822/08/19939001224Accident in public building (supermarket) 557201/04/199726442006closed fracture of shaft of femur 557201/04/199779001Essential hypertension PtIDDateObsCodeNarrative 093920/12/1998255087006malignant polyp of biliary tract IUI-001 IUI-003 IUI-004 IUI-005 IUI-007 IUI-002 IUI-012

41 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Other Advantages mapping as by-product of tracking –Descriptions about the same particular using different ontologies/concept-based systems Quality control of ontologies and concept-based systems –Systematic “inconsistent” descriptions in or cross terminologies may indicate poor definition of the respective terms

42 New York State Center of Excellence in Bioinformatics & Life Sciences R T U A case study Double goal: –Application of referent tracking to a concrete patient story –Ontological analysis of what is involved The latter is NOT to be performed to the same extent when referent tracking is used as an alternative to coding using concept-based systems. So, don’t go home with the idea: “that’s all too cumbersome and time cosuming”

43 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Jim Cimino’s Woods Hole case Jane Smith is a 30 year old, Native American female who presents to the emergency room with the chief complaint of cough and chest pain. The patient reports that she has had a productive cough for three days but that chest pain developed one hour ago. She gives a history of hypertension. She also reports that she was treated in the past for tuberculosis while she was pregnant. The patient reports an allergy to Bufferin. Physical examination revealed a well-developed, …

44 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Step 1: identify the phrases referring to particulars Jane Smith is a 50 year old, Native American female who presents to the emergency room with the chief complaint of cough and chest pain. Question: What if the patient is not telling the truth ?

45 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Jane Smith is a 50 year old, Native American female who presents to the emergency room with the chief complaint of cough and chest pain. Step 2: indentify to what particulars these phrases refer Jane SmithJane Smith’s age Jane Smith’s raceJane SmithJane Smith’ s gender Jane Smith ’s showing up at... A specific emergency room of health facility XYZ Jane Smith’s complaining primarily about... A temporal part of Jane Smith’s life marked by happenings of coughs Jane Smith’s chest A specific pain experienced by Jane Smith

46 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Compare with simple clinical coding in juxtaposition Jane Smith is a 50 year old, Native American female who presents to the emergency room with the chief complaint of cough and chest pain. “Jane Smith” CS1-age CS1-native-american CS1-female- gender CS1-emergency room CS1-chief-complaint CS1-coughingCS1-chest-pain CS2-woman CS2-pain CS2-chest

47 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Compare with the output of the perfect semantic analyser we all would dream of CS3-50 years old Has-Age CS3-woman Is-A CS3-native american Is-A CS3-complaining “Jane Smith” Has-Sayer CS3-chest pain Has-Saying CS3-coughing Has-Saying CS3-consultation Has- happening- during CS3-Em.Room Has-Loc Has- participant Compare with the output of the NAIVE !!! semantic analyser we all would dream of

48 New York State Center of Excellence in Bioinformatics & Life Sciences R T U What it (more or less) should be CS3-complaining CS3-chest pain Has-Saying CS3-coughing Has-Saying “chest-pain” Has-’referent’ “coughing” Has-’referent’

49 New York State Center of Excellence in Bioinformatics & Life Sciences R T U Conclusion Referent tracking can solve a number of problems in an elegant way. Existing (or emerging) technologies can be used for the implementation. Old technologies (concept-based systems) can play an interesting, but different role. Big Brother feeling is to be expected but with adequate measures easy to fight. The proof of the pudding is in the eating –Pilote is going to be set up


Download ppt "New York State Center of Excellence in Bioinformatics & Life Sciences R T U Referent Tracking: The New Paradigm Dagstuhl May 23th, 2006 Werner Ceusters,"

Similar presentations


Ads by Google