1. The Outcomes Measurement System (OMS) Web-Based Datamart: Development and Demonstration
Diana Seybolt, PhD
Tim Santoni, MA,
Systems Evaluation Center
University of Maryland Baltimore

2. Acknowledgements Maryland Mental Hygiene Administration ValueOptions
OMS Participants:
Consumers
Children/adolescents
Caregivers
Providers

3. Overview of Presentation
OMS background and procedures
Overview of OMS Datamart
Analytic comparison of consumers indicating substance use issues with those indicating no substance use issues

4. Purpose of OMS
Track how individuals in outpatient services in the PMHS are doing over time
Intended to track trends in the PMHS as a whole, not the changes in individual consumers
Useful at the aggregate provider, CSA, State levels
Clinicians are encouraged to use OMS interview as tool in treatment planning

5. OMS Project Background
Intended to quantify outcomes for individuals in PMHS outpatient services
Collaboratively developed
Consumers
Providers
Stakeholders
MHA
CSAs
SEC
Value Options
Operational since 9/2006; refined 9/2009

6. Underlying Principles
Value to consumers, providers, CSAs, MHA
Responsive to State and federal reporting requirements
Use of validated/reliable tools and questions as available
BASIS 24® for Adults
University of Maryland KIDNET for children
Federal scales for functioning, social connectedness

7. OMS Interview Implementation
Consumers ages 6-64 receiving outpatient treatment at OMHC, hospital outpatient, FQHC, local health department
Conducted with consumer or caregiver at intake and every 6 months in treatment
Integrated into Value Options® service authorization system
Approval contingent on OMS submission

8. Access to OMS Datamart MHA Website:
Value Options Maryland Website:
Directly to OMS Website:

9. Minimum System Requirements
Browser versions
Internet Explorer Version 6
Mozilla Firefox Version 2
Safari Version 5
Computer system
Processor speed of 1.8 GHz
1.0 GB Memory

10. Software Requirements
Adobe Shockwave
Adobe Flash Player (32 bit only)
May need to update Adobe software
Shockwave, and therefore the datamart, will not currently run on the iPad

11. Datamart Demonstration

12. MHA Website

13. Welcome Page with Analysis Choices

14. Adult CY11 Living Situation

15. Geographic Filter by County/CSA

16. Age Filter for Adults

17. Gender Filter

18. Race Filter

19. “Counts Only” = total sample

20. Welcome Page (choosing other filter options)

21. Age Filter for Children and Adolescents

22. Psychiatric Symptoms for Children/Adolescents

23. Substance Use (general and clinical subsample)

24. Technical Challenges Combining two ASO data sets
Defining episode of care
Matching provider agencies
Screen layout for Datamart
Changes in items/additions between Generation 1 and Generation 2: analysis issues

25. Data Analysis

26. Demographic Comparison Point in Time and Change Over Time
Point In Time
Change Over Time
Demographic MH
MH-SA
Female
61.8%
49.7%
62.8%
50.8%
Male
38.2%
50.3%
37.2%
49.2%
18 to 21
12.0%
4.1%
9.3%
2.2%
22 to 29
20.6%
16.7%
17.4%
14.0%
30 thru 49
46.2%
53.3%
46.8%
53.2%
50 to 64
21.1%
25.9%
26.5%
30.6%
African American
47.8%
45.5%
47.0%
46.4%
White
50.0%
50.9%
52.1%
Other
1.2%
2.1%
1.5%

27. Results Based on the Most Recent OMS Interview (Point in Time-PIT Analysis)
Calendar Year 2011

28. PIT-Methodology Find all consumer OMS completed in calendar year 2011
Select the most recent OMS for all consumers

29. PIT-Living situation

30. PIT-Homeless in last 6 months

31. PIT-Satisfaction with recovery

32. PIT-Arrested in last 6 months

33. PIT-Jail or prison in last 6 months

34. PIT-Employed in last 6 months

35. PIT-Currently smoking cigarettes

36. PIT-Current health status

37. PIT Conclusions MH-SA group more likely to be Males Older White
In non-independent living
Homeless
Arrested, in jail or prison
Unemployed
Smoking cigarettes
Less healthy

38. Results of Comparing Most Recent Interview with Initial Interview (Change Over Time-COT)
Calendar Year 2011

39. COT-Methodology Find most recent OMS interview in CY 2011
Identify “initial” OMS interview for this “episode of care”
Same form (adult/child)
Same provider
Same authorization span
No discharge
No lag between interviews of more than 180 days

40. COT-BASIS 24® Scales I
Lower score equates to fewer symptoms.

41. COT-BASIS 24® Scales II
Lower score equates to fewer symptoms.

42. COT-6 month homeless status

43. COT-6 month arrest status

44. COT-6 month employment status

45. COT-Cigarette smoking status

46. COT-General health status

47. COT Observations MH-SA more likely to Begin with higher symptoms
Reduce symptoms more
Change arrest status
Change employment status
Change smoking status
Change health status

48. Current Activities Provider/CSA Training Demonstration
Instructions for Access
Demonstration of Connected Model
Administering the Questionnaire (providers only)
Data Analysis/Interpretation
Data Utilization