1. NIH and PROMIS ® ACR-2012 Clinical Highlights November 14, 2012 James Witter MD, PhD FACR CSO PROMIS Medical Officer: Rheumatic Diseases NIH/NIAMS/DSRD Dynamic Tools to Measure Health Outcomes from the Patient Perspective

2. Click to edit Master title style Disclosures: No financial disclosures

3. Click to edit Master title style Goals of presentation General Overview The ‘science’ of PROMIS –Domain theory of disease –Item Response Theory (IRT) Application of Computerized Adaptive Testing (CAT) –Terminology Future in rheumatology

4. Click to edit Master title style Definitions-Terminology Items are questions that have: Context, stems, responses Parameters (Difficulty, Discrimination) –Important for analyses, calibration Banks (collection of items) “calibrated” on a common metric –difficulty and discrimination have been estimated Define common concept-domain –Allow computerized adaptive testing (CAT) Domains Define latent traits/abilities

5. Click to edit Master title style Item Response Theory In psychometrics- body of theory that: Describes application of mathematical models to how people respond to items » At person and item level Serves as basis for measuring » Abilities » Attitudes Based on probability of endorsing a particular item category is function of latent trait or ability Ability to improve reliability of instrument

6. The Tower of Babel (Brueghel, 1563)

7. Click to edit Master title style Advancing Patient-Centered Outcomes PROMIS: A Common Source of PROs Clinical Practice Clinical research Surveys (CDC) NIH FDA Clinic Hospital Industry

8. Click to edit Master title style NIH PROMIS

9. Click to edit Master title style Vision-Mission: Vision –The Patient-Reported Outcomes Measurement Information System (PROMIS), funded by the National Institutes of Health, aims to provide clinicians and researchers access to efficient, precise, valid, and responsive adult- and child-reported measures of health. Mission –PROMIS uses measurement science to create an efficient state-of-the-art assessment system for self-reported health.

10. Click to edit Master title style NIH Common Fund/Roadmap Initiative Over $90 million investment since 2004 Managed by NIAMS and NCCAM Substantial involvement of multiple NIH ICs

11. Click to edit Master title style PROMIS: Present

12. PROMIS Resources Advancing Knowledge >100 Peer-Reviewed Publications Informatics Assessment Center Supports >100 Studies Tools 40 Adult Measures 20 Pediatric Measures Translations All item banks  Spanish Cooperative Group 12 Research Sites 3 Centers 150+ Scientists

13. Click to edit Master title style Outcomes (FDA workshop) Clinical Outcomes Assessments (COAs) PROs: Patient-reported outcomes ClinROs: Clinician-reported outcomes ObsROs: Observer-reported outcomes all influenced by human choices, judgment, cooperation or motivation Biomarkers not influenced by humans

14. Click to edit Master title style Patient-Reported Outcomes (PROs) FDA and NIH recognize PROs as important outcomes to answer clinical questions –translating the efficacy-effectiveness and safety of therapeutics In development (clinical research) In the real world (clinical care) Patient burden is important aspect of PRO assessment in both these settings

15. Click to edit Master title style Evolving concept of health DOMAIN vs. DISEASE SPECIFIC -ACR 20, DAS 28-

16. Click to edit Master title style ACR 20 responder index: > 20% improvement in swollen and tender joint count…….plus... > 20 % improvement in 3 of following 5: patient global physician global patient pain (VAS) modified HAQ acute phase reactant (CRP or ESR)

17. Click to edit Master title style DOMAINS A domain is the specific feeling, function, or perception you want to measure. Cuts across different diseases

18. Click to edit Master title style DOMAINS vs. Diseases Diseases (common & rare) are combinations of different mechanisms that impact domains Capturing multiple domains may be optimal way to assess diseases Core-common PRO domains are universally applicable across diseases, ages and ethnicities Core PRO domains can link common and rare diseases

19. DOMAINS

20. Click to edit Master title style Common DOMAINS Fibromyalgia Pain, fatigue, depression SLE Fatigue, pain, social function RA Pain, physical function, fatigue

21. Anxiety Prostaglandins Interleukins Chemokines Sleep PROs Mechanisms Pain Phys Fn Social Fatigue

23. Fatigue Item Bank Lower Back Pain Same metric, same meaning Depression Heart Failure Cancer COPD

24. PROMIS Measures Tested in Six Conditions ConditionRelevant Item Banks COPD Physical Function Fatigue Pain Social Role Satisfaction Emotional Distress (Depression, Anxiety, Anger) Heart Failure Physical Function Fatigue Social Role Satisfaction Depression Low Back Pain Pain (Interference and Behavior) Physical Function Depression Fatigue Sleep Disturbance Depression Emotional Distress (Depression, Anxiety, Anger) Sleep Disturbance Fatigue Physical Function Pain Arthritis Physical Function Cancer Pain Fatigue Emotional Distress (Depression, Anxiety) Physical Function

25. The PROMIS Metric T Score Mean = 50 SD = 10 Referenced to the US General Population

26. 5035 40 45 5560 65 PROMIS Fatigue Across Five Clinical Conditions Average for General Population COPD Stable (B) COPD Exacerbation (B) HF Pre-transplant HF Post-transplant Exacerbation to Stable Depression (B) Depression (1 mo) Depression (3 mos) Cancer Chemo (B) Cancer w/ benefit (2 mos) Back Pain (B) Back Pain (1 mo) Back Pain (3 mos) N = 64 N = 310 N = 114 N = 229 N = 125

27. Click to edit Master title style

30. Adult Fatigue Bank The fatigue item bank evaluates a range of self- reported symptoms, from mild subjective feelings of tiredness to an overwhelming, debilitating, and sustained sense of exhaustion that likely decreases one’s ability to execute daily activities and function normally in family or social roles. Fatigue is divided into the experience of fatigue (frequency, duration, and intensity) and the impact of fatigue on physical, mental, and social activities. The fatigue short form is generic rather than disease-specific. It assesses fatigue over the past seven days.

31. Click to edit Master title style PROMIS ® combines: Item Response Theory (IRT) and Computer Adaptive Testing (CAT) Together, IRT and CAT provide precise measurement of individual symptoms

32. Low High Persons’ Levels of Physical Function Item Difficulty IRT models Latent Traits: People and Items are Represented on the Same Scale Are you able to run 5 miles Are you able to get out of bed. Low High 32

33. Click to edit Master title style Computerized Adaptive Testing (CAT) Integrates IRT with computers to administer a PRO instrument selects questions on the basis of a patient’s response to previously administered questions measurement is “adapted” to individual skips uninformative items to minimize response burden allows determination of person’s standing on a domain without a loss in measurement precision.

34. Computerized Adaptive Tests 0 1 2 3 - 1 - 2 - 3 high physical function 0 1 2 Question #2 1 2 Question #3 Questionnaire with a high precision - AND a wide range low physical function Question #1

35. Who uses CAT?

36. Covers the whole range of the domain Items are “calibrated” (difficulty and discrimination) CAT Starts with an Item Bank

37. An item bank is a large collection of items measuring a single domain. Any and all items can be used to provide a score for that domain.

43. PROMIS ® Adult Banks: v1.0Domains Items in Bank ShortForm Emotional Distress – Anger 298 Emotional Distress – Anxiety 297 Emotional Distress – Depression 288 Fatigue957 Pain – Behavior 397 Pain – interference 416 Physical Function 12510 Satisfaction with Discretionary Social Activities 127 Satisfaction with Social Roles 147 Sleep Disturbance 278 Wake Disturbance (sleep related impairment) 168 Global Health 10

44. 44 PROMIS ® Profile Short Forms (29-43-57 items) (+ pain intensity) 44 Anxiety 29 Anxiety 29 Depression 28 Depression 28 Fatigue 95 Fatigue 95 Pain Interference 41 Pain Interference 41 Sleep Disturbance 27 Sleep Disturbance 27 Physical Function 86 Physical Function 86 Satisfaction with Roles 14 Satisfaction with Roles 14 4 6 8 Mental Physical Social

45. Click to edit Master title style Child-Adult Linkage Studies Render child and adult editions comparable same scale Enable life course outcome assessment

46. Click to edit Master title styleDomains Items in Bank ShortForm Emotional Distress – Anger n/a6 Emotional Distress – Anxiety 158 Emotional Distress – Depression 148 Fatigue2310 Pain – Interference 138 Physical Function-Mobility 12510 Physical Function-Upper Extremity 298 Peer Relationships 158 Asthma178 PROMIS ® Pediatric Banks: v1.0

47. Click to edit Master title style Assessment-Technology Center FREE online research management tool Enables study specific websites –Secure data capture Clinical studies can be customized Includes PROMIS instruments –short forms, CATs and Profiles Detailed statistical/development history Real-time scoring www.assessmentcenter.net

48. AC supports different modes of administration

50. Click to edit Master title style

51. Assessment Center

52. CAT Graph

53. Click to edit Master title style Ancillary Studies RFA AR-12-007 To facilitate incorporation of PROMIS® domains into ongoing clinical projects in patient populations that represent the NIAMS portfolio of diseases Funded in patients with –Vasculitis –Chronic Musculoskeletal Pain –Orthopedics

54. Click to edit Master title style PROMIS in Rheumatology

55. Click to edit Master title style Contributions: Future Clinical Research & Care Precision – improved measurement precision across the full range of patient-reported outcomes Efficiency – less respondent burden Standardization – more interpretable research with standard terminology and metrics International clinical trial applications Common language between research and practice fosters CER

56. PROMIS International Users’ Group...and more