1. Using the Family Development Matrix to Share Outcomes ICCS/CSUMB Strategies OCAP

2. Today’s Objectives Understand the structure, benefits, and applications of the Matrix Outcomes Model Understand the role of the Matrix to build on family strengths and track their progress Use the Matrix as a tool for family support, healthy families, child welfare and mental health to develop shared outcomes and evaluate results for preventing child abuse

3. History Government Performance and Results Act (GPRA) of 1993. Scales Committee, HHS developed Agency, Family and Community Matrices. Results Oriented Management and Accountability (ROMA). ICCS began examining the California Community Action model in 1996 by providing workshops locally.

4. History In 1999, conducted testing for validity & reliability. Since 1997, we have assisted 300 programs to design their indicators and train staff to use the Matrix in a variety of settings. Today, Website provides online design & data base assessment and reports.

5. The Matrix is: An outcome tool for measuring performance and establishing results accountability A process for conducting ongoing assessments, case management, outcomes measurement and evaluation “Success is defined as improvement as measured against a baseline” Mark Friedman, Fiscal Policies Studies Institute

6. Matrix Outcomes Model Key Point: The purpose of an outcome-based approach is to focus on the well being of the family and ultimately the ability of the community to prepare children for success.

7. Matrix Structure  Outcome categories define the Matrix  Four status levels define each of the indicators for the outcome categories  Strength-based assessment, case planning and outcome results

8. Family Development Matrix Provides information directly from family members. Assists staff to build on strengths, address challenges, and track change Families recognize their strengths as well as areas in need of further assistance The data assists agencies and funders to improve family- centered services.

9. Categories and Indicators Children Children’s Care & SafetyChildren’s DevelopmentChildren’s Education Access to quality health careAge-appropriate behavior & social skills Access to appropriate educational services Access to age-appropriate after school program Children’s behaviorAppreciation of intergenerational relationship Supervision by the familyChildren’s communicationComprehensive: retelling a story Assure safe environment (risk of physical violence, sexual abuse) Development milestonesConnectedness with local schools Family respite CarePeer relationshipsDesire to read Resource for recreation & play opportunities Educational development Verbal communicationsReading exposure by number of books read Age-appropriate developmentSchool/Program attendance Vocabulary

10. Adolescence Adolescence DevelopmentStudent Development AttitudeKnowledge of goal setting Quality of immediate family support Ability to follow directions Job skill; work historyPeer relationshipQuality of community or school support Communication with friends and adults College/Vocational GoalsConflict resolution skills with family School/Program attendance Leadership skills Communication with Adults Disciplinary problemsSense of personal responsibility Make wise decisions

11. Family Adult Education/EmploymentChildren’s Care and SafetyChildren's DevelopmentChildren's Education Job Skills; Work HistoryAccess to Quality HealthcareDevelopment MilestonesAccess to Educational Services Educational DevelopmentAccess to Age-Appropriate after school program Age-Appropriate Behavior and Social Skills Family Connectedness to School Career Goals/AchievementSupervision by FamilyVerbal CommunicationSchool Program Attendance Quality of EmploymentAssured Safe EnvironmentPeer PressureSkill Building Language skills & LiteracyFamily Respite CareAdolescent job skillsResources for recreation and play Family EnvironmentFinancesFood/ClothingHealth/Safety Family Communication SkillsSavings and Finance ResourcesResources for Nutrimental FoodsEnvironmental Conditions Family Rules and ExpectationsBudgeting SkillsQuality of DietHealth Habits Conflict/Resolution SkillsIncome Level in Context with Local Cost of Living for Basic Needs Adequacy of ClothingAccess to Health Resources Parent/Child RelationshipCondition of Food Preparation (Utensils, Space, Appliance, Furniture and Sanitation) Status of Psychical Health Adult Self CareKnowledge and Understanding of Financial Intuition and Resources Ability to Afford Health Care Extended Family Support Immigrant/ResettlementShelter/Community EnvironmentSocial and Emotional Health and Competency Transportation/Mobility Immigration StatusHousing ResourceQuality of Social Support SystemAccess to Transportation Language Sills Based on NeedsStability of HousingPresence, Degree of Substance AbuseLegal Status of Driver & Vehicle (Driver’s License, Insurance, Etc) Preservation of Language OriginAdequate for Family SizeCoping Skills Maintaining Cultural DiversityRelations with NeighborsQuality of Emotional Well BeingSafety, condition of Transportation Involvement in Culture of OriginCommunity Service & EngagementAbility and Willingness to Identify Needs and Access to Resource Reliability and Safety of Transportation

12. Customize a Matrix Model Adolescence Adult Education & Employment Agency Organizational Standards Ambitions Attachment Status (child) Basic Needs Caregiver Support (senior) Children’s Care & Safety Children’s Education Children’s Development Children’s Skill Building Community Engagement Community Environment Community Health Cultural Competence Elder Support Family Environment Family Relations Financial Stability Health Access Health Safety Health Care Policy Immigration Individual Health Intergenerational Programs Long Term Care (senior) Parent Involvement Parents/Child Relationships Prenatal Healthcare School Healthy Environment Sexual Activity Shelter Social & Emotional Health Social Family Support Student Development Substance Abuse Transportation Volunteers

13. The Matrix Creator A Web-based system: Programs design outcome measurement and collect data Customize an assessment to a specific population Conduct local reliability and validity tests Conduct ongoing assessments and outcomes measurement Enter and retrieve data and chart findings

14. A Partnership is Formed

15. Project Goals To build capacity within FRCs to use an integrated family outcomes tool for program assessment and intervention evaluation To support FRCs in partnering with local child welfare systems to develop shared target outcomes for families where differential response is indicated To conduct research and provide a framework of information for a pathway to prevention of child abuse to keep children in stable and nurturing homes

16. Project Partners 90 agencies in 14 counties in collaborative networks ButteSan Francisco Del NorteSanta Barbara LakeSan Luis Obispo MaderaSan Joaquin OrangeSiskiyou SacramentoTehama Ventura 10 tribal communitiesYolo

17. Pathways Mapping Project Harvard University research – identifies outcomes, strategies, examples, actions for PCAN Pathway knowledge base bridges disciplines serving families Pathway identifies actions that contribute to achieving specified outcomes Pathway identifies indicators of progress toward specified outcomes http://www.pathwaystooutcomes.org

18. Prevention Model

19. The Matrix Process Core categories and indicators Tested and evaluated for validity and reliability locally Field Test with staff working with families Establish protocols and codes for data Train staff to use the Matrix with families Conduct the assessment with families Track progress by individual, family, program, agency and county Use data to tell the story of change

20. Status Level Change (4) SAFE/SELF-SUFFICIENT A strong and secure position for a person or family (3) STABLE A current plan and readiness for change (2) AT-RISK Indicates a threat; not yet committed to strategies for change (1) IN-CRISIS Inability to meet needs; situation near collapse; requires immediate intervention

21. c/r Jerry Endres Edit Your Chosen Indicators

22. Matrix Assessment  Measures both where family is strong and has resources and where it needs support  Creates a partnership with the family  Facilitates family ownership of their efforts  Helps to develop skills in the family  Documents, over time, the family’s progress toward outcomes

23. Family Assessment Listen to the Family’s situation. Restate what you have heard using Matrix indicators. Ask more questions to cover the Matrix categories. Score each category together.

24. Subsequent Assessments Baseline Assessment The worker and family member determine initial scores for each of the outcome categories Additional Assessments Subsequent meetings depend on the duration of services. The Matrix "scores" established at the previous meeting are revisited, and another assessment is completed.

25. Enter Your Data

26. Auto-Generated Assessment Summary

27. Family Empowerment Plan (Based on Principles of Family Support) Step one: Identify areas of strength and issues of concern. Step Two: Ask the family the goal they would like work on at this time. Step Three: Assist family to identify strengths that can be applied to assist with goal achievement. Step Four: Complete a Family Empowerment Plan.

28. Empowerment Planning Client ID#Case Partners Date Case Opened Write in the name of the Matrix categories and family objectives below GoalsMatrix category Accomplishment objective Objectives Family Program What will the family want to accomplish? What the the family will do to help reach the objective? Review Date:Parent signature:Staff Person: Supervisor: What other resource persons will do to help reach objectives? What the program will do to help reach objectives

29. Strength Based Change AWARENESS Family sees their situation from a strength based perspective SKILLSFamily has the knowledge, skills and ability to move toward self-selected priorities MOTIVATIONRewards and benefits for change outweigh attitudes or obstacles that may prevent the Family from achieving goals MAINTENANCEFamily is using strengths to reach and maintain self-sufficiency

30. Family Focused Model Key Point: The Matrix tracks Family needs from the beginning of a relationship. It functions as an empowerment tool to accomplish the overall goal of the Family--- to become and remain self-sufficient.

31. Family Focused Model Key Point: The Matrix is a tool built on the Principles of Family Support. The family has central, active role in determining their goals and steps they can take toward achieving their goals

32. Benefits of Using the Matrix Measures strengths and risks Creates a partnership with worker and family Documents the process that achieves outcomes Facilitates family ownership of their efforts Helps families develop skills

33. Analyzing Data Status level change based on time in program Compare baseline to current quarter Analyzing effects of differing interventions

34. Charts Enable Quick Understanding of the Data

35. Matrix Data Family Empowerment Program Improvement Agency Strategic Planning Reports to Funders Legislative Advocacy

36. Analysis of FDM data Overall data. Factors contributing to change in scores

37. Baseline Scores

38. Change in Scores

39. Our Theory of Change Building/Testing a theory of change Family WorkerIntervention Family 1: Participation Family 2: Follow empowerment plan Family 3: Barriers Family 4: Level of support Pathway InterventionCase management activity

40. A Model of Change  score i =  +  ’ ( Family) +  ( baseline)+  ( strengths)+  (ethnicity)+  ( gender) + A’  i Change as a function of: Family engagement Initial status level Overall strengths Ethnicity Gender Collaborative specific effects

41. Basic change model ***p<.01,**p<.05, *p<.1; Collaborative variables omitted from table Participation Follow through BarriersSupports

42. DR Paths and Change Are different DR paths related to change in outcomes? Change as a function of: DR Path Family engagement Initial status level Overall strengths Ethnicity Gender Collaborative specific effects

43. DR Paths in the FDM Path 1 : Child Welfare refers to FRC with no investigation (Referral) Path 2 : Child Welfare investigates and refers to FRC (Handoff) Path 3 : Child Welfare opens a case and refers to FRC (Partnership) Path 4 : Walk-ins / non Child Welfare referrals

44. Mean baseline scores by DR path

45. DR Paths in Change Model ***p<.01,**p<.05, *p<.1 Collaborative variables omitted from table

46. Conclusions from FDM data analysis Family engagement is an important factor in determining change. Families that follow through the empowerment plan and use strategies to address barriers show greater gains in scores. FDM differential response paths are not related to change in outcomes. No relationship between FDM DR path and family engagement levels.

47. Handouts Questions