Health Connection: Evaluating the quality and impact of a public health telephone response service CHNC Conference: Knowledge to Action - June 17 th, 2010.

Slides:



Advertisements
Similar presentations
Presents: The Blue Ridge H M I S.
Advertisements

St. Louis Public Schools Human Resources Support for District Improvement Initiatives (Note: The bullets beneath each initiative indicate actions taken.
Program Evaluation. Overview and Discussion of: Objectives of evaluation Process evaluation Outcome evaluation Indicators & Measures Small group discussions.
ALAMEDA UNIFIED SCHOOL DISTRICT Superintendent Search.
Key Strategic Planning Tools Section 2-8 and T2-19.
Conducting Pre- and Post-Conferences Copyright 2008 by The Health Alliance of MidAmerica LLC.
Nan Jeannero, Kerry McGuire Phoenix State of Connecticut, Department of Social Services Mystery Shopper Project November 2006.
1 Our priorities for the next three years Close Critical Service Gaps Increase availability of culturally appropriate services and serve more children.
International Conference on Establishment Surveys 1 Everything you wanted to know about Electronic Data Reporting (EDR) at Statistics Canada June 2007.
Program Planning: Community Nutrition Assessment
May 5, 2015 Strategies for Evaluation Data Collection Eric Graig, Ph.D.
Designing the Questionnaire
Eaten: UNC - Chapel Hill An investigative look at the eating habits of freshmen on the University of North Carolina at Chapel Hill campus.
0ictQATAR October 13, 2008 Qatar’s ICT Statistical Information Areas Tariq Gulrez.
Program Planning: Community Nutrition Assessment
Title I Needs Assessment and Program Evaluation
Enabling a Medical Home With a Patient Communication Strategy Jeanette Christopher Northwest Primary Care Group, P.C.
Alice M. Stafford, BS, CISD, CIT; Gail M. Gongaware, BSN, MA, CCM; Coleen Cox-Ballah, RN, MS-HCM, CCM, GCM INTRODUCTION METHODS DISCUSSIONKey Findings.
Proposed Cross-center Project Survey of Federally Qualified Health Centers Vicky Taylor & Vicki Young.
Qualitative Research MKTG 3342 Fall 2008 Professor Edward Fox.
Stakes Lodge Surgery Patient Reference Group Survey Results.
The Vision Implementation Project
Tulane University 1 Tulane University Employee Satisfaction Survey Results October 2012.
Theme Managing self Competency Problem solving and decision making Use appropriate media to communicate.
2010 TECHNICAL ASSISTANCE EVALUATION REPORT SUMMARY The provision of training and technical assistance (TA) to provider agencies is an integral component.
WOMEN’S EMPLOYABILITY AND THE IMPACT OF VIOLENCE.
Missouri Family Development Training and Credentialing Program (FDC) Evaluation of a training program for family service workers.
Student Engagement Survey Results and Analysis June 2011.
The Evaluation Plan.
Customers and their expectations Kari-Pekka Martimo PAA.
Copyright © 2007 Pearson Education Canada 3-1 Marketing Research Marketing research serves many roles. It can: 1.Link companies with customers via information.
Orientation and Induction of Traditionally and Alternatively Educated New Teachers Jennifer Conkin October, 2012.
Implementing Adult Risk Factor Surveillance in Manitoba Case Studies ARFS Symposium January 26, 2011.
MAC Fall Symposium: Learning What You Want to Know and Implementing Change Elizabeth Yakel, Ph.D. October 22, 2010.
Coordinating SH Programs: Real Life, Real Challenges, Real Success School Health Conference 2008.
Four Corners Community Behavioral Health Center Presented by Aralias Research Aralias Research Ryan Jensen, Marcus Waite, and Nick Bell.
Residential Survey. Survey Objectives Develop a more accurate algorithm to predict the presence and use of electric heat for residential customers. Algorithm.
Supplemental Educational Services (SES) Data Collection Process: Roles and Responsibilities of LEAs GaDOE Data Collections Conference August 17, 2011 Athens,
Director of Evaluation and Accountability Manager, UW’s Grand Rapids, Michigan Robert McKown, CIRS Director of Evaluation and Accountability Sherri.
Prepared by Opinion Dynamics Corporation May 2006.
1 © 2004 Cisco Systems, Inc. All rights reserved. Case Study Cisco Unity Voice Messaging Deployment: Communications Strategy November.
1 Women Entrepreneurs in Rural Tourism Evaluation Indicators Bristol, November 2010 RG EVANS ASSOCIATES November 2010.
The Marketing Research Project. Purposes of the Project 1.Give you practical experience at conducting a marketing research project. 2.Examine some factors.
Veterans Affairs Canada 2003 National Client Satisfaction Survey.
Market Research and Testing The Key To Business Success Revised June 2010.
Community Health Needs Assessment Requirements for Tax-Exempt Hospitals November 2011.
Survey Methodology Lilian Ma November 6, Three aspects 1. How questions were designed 2. How data was collected 3. How samples were drawn Probability.
Self Assessment Using EFQM Excellence MODEL Down Lisburn Trust’s Experience of Continuous Improvement John Simpson Down Lisburn Trust.
1 Non-Response Non-response is the failure to obtain survey measures on a sample unit Non-response increases the potential for non-response bias. It occurs.
Improving the Respondent Experience in the United Kingdom Julie Curzon/Debra Prestwood UK Office for National Statistics (ONS)
Prepared by Dr. Hoda Abdel Azim
Researching your contemporary issue From How to Write an Effective Special Study Dodson, Jarvis & Melhuish.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
DRAFT – FOR DISCUSSION ONLY Student Reassignment Survey Nash-Rocky Mount Public Schools October 1 – November 1, 2012.
Information Management and Market Research. Marketing Research Links…. Consumer, Customer, and Public Marketer through information Marketing Research:
Trinity Collaborative Recreation Assessment and Forest Contractor and Workforce Assessment.
Managing Marketing Information 4 Principles of Marketing.
AssessPlanDo Review QuestionYesNo? Do I know what I want to evaluate and why? Consider drivers and audience Do I already know the answer to my evaluation.
SUPPORTING PEOPLE PROVIDER FORUMS An overview of Supporting People’s new approach to Performance Monitoring and Quality Assurance.
Planning a Customer Survey Part 1 of 3 Elaine Carlson, Westat Anne D’Agostino, Compass Evaluation & Research.
Headquarters 11 Infantry Brigade and Headquarters South East A £10 million government scheme which funds projects that support the Covenant or Covenant.
THE SOUND OF SILENCE: AN EVALUATION OF CDC’S PODCAST INITIATIVE Quynh-Chau, M., Myers, Bradford A. (2013). The Sound of Silence: an evaluation of CDC's.
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Identify and Meet a Market Need
Conducting Pre- and Post-Conferences
Agenda Welcome and Introductions Purpose of Investment
Overview of AIR Special Education Program Review and Next Steps
Health care for the Homeless Strategic Planning 2018
Locally Driven Collaborative Project (LDCP)
Presentation transcript:

Health Connection: Evaluating the quality and impact of a public health telephone response service CHNC Conference: Knowledge to Action - June 17 th, 2010 Presenters: Reina Barker, RN, BSc.N Joyce Fox, RN, BSc.N, MHS

Simcoe Muskoka District Health Unit 2 Outline  Overview of Health Connection  Review Health Connection Client Survey Purpose & Objective Purpose & Objective Methodology Methodology Survey limitations Survey limitations Findings Findings Recommendations Recommendations Implementation enablers & barriers Implementation enablers & barriers

Simcoe Muskoka District Health Unit 3 Health Connection  local public health information and referral service  serves as the first point of contact for the public seeking access to public health information and the services, programs and resources  service consist of 8 separate lines access is primarily by phone access is primarily by phone staffed by public health nurses, public health inspectors and customer service representatives staffed by public health nurses, public health inspectors and customer service representatives inquiries relate to the full spectrum of public health topics inquiries relate to the full spectrum of public health topics  health promotion approach used to help clients get the information, knowledge and skills required to make choices that support health

Simcoe Muskoka District Health Unit 4 Client Survey  conducted as part the data gathering activities of a larger Health Connection review  external researcher hired to conduct the survey of clients who access HC  to identify changes to improve the client experience and service delivery  undertaken as a way of obtaining information directly from users with respect to: client characteristics client characteristics client satisfaction client satisfaction how clients use the service and the information provided how clients use the service and the information provided the impact of the service on clients the impact of the service on clients client needs and expectations client needs and expectations barriers to using and accessing the service barriers to using and accessing the service

Simcoe Muskoka District Health Unit 5 Research Questions  Does Health Connection provide information and service that meets the needs and expectations of its users?  How satisfied are users with the information and service provided?  What are the barriers to using and accessing the service?  What changes are needed to improve the effectiveness and the quality of the service?

Simcoe Muskoka District Health Unit 6 Methodology  telephone survey  eligible clients solicited by staff between October 9 – November 16, 2007  clients contacted 2-3 weeks later by independent surveyors  sample size = 290  data analyzed using SPSS software and descriptive statistics complied for each item

Simcoe Muskoka District Health Unit 7 Sample  60% of clients solicited to participate actually completed the survey

Simcoe Muskoka District Health Unit 8 Limitations  Reliance on human reporting as the primary data source  Potential respondent bias related to social desirability of responses  Potential selection bias related to staff soliciting clients to participate  Small sample size and resulting sensitivity to respondents responses.

Simcoe Muskoka District Health Unit 9 Key Findings: Client Characteristics  predominantly female (88%)  majority had completed post secondary education (60%)  geographical breakdown of respondents close to population distribution in Simcoe and Muskoka

Simcoe Muskoka District Health Unit 10 Key Findings: Access to Service  service was accessed equally throughout the day

Simcoe Muskoka District Health Unit 11 Key Findings: Access to Service  majority of respondents heard about the service through a notice to call  most were seeking information

Simcoe Muskoka District Health Unit 12 Key Findings: Access to Service  86% of respondents reported being satisfied to very satisfied with their overall experience of how their call was directed  most respondents who went to voic reported feeling comfortable doing so

Simcoe Muskoka District Health Unit 13 Key Findings: Service Quality & Impact  Respondents reported a high level of satisfaction with the service, information and recommendations provided by staff 92% indicated they were very satisfied/satisfied with Health Connection service 92% indicated they were very satisfied/satisfied with Health Connection service 87% said they would use HC service again 87% said they would use HC service again 89% would recommend service to family and friends 89% would recommend service to family and friends

Simcoe Muskoka District Health Unit 14 Key Findings: Service Quality & Impact

Simcoe Muskoka District Health Unit 15 Key Findings: Service Quality & Impact

Simcoe Muskoka District Health Unit 16 Key Findings: Service Quality & Impact Client perception of the helpfulness of the service ThemesExamples of responses/subthemes Frequency of responses for this theme Supportive staff  staff very knowledgeable  staff very supportive and provide reassurance  staff professional, felt very comfortable speaking with staff  staff provided good advice and resources 59 % Knowledge gained  linked to additional resources  questions were answered, issues addressed, second opinion very helpful  mailed out additional information after call 25% Service convenience  access to appointments12%

Simcoe Muskoka District Health Unit 17 Key Findings: Service Quality & Impact  65% of respondents indicated they followed up with the recommendations made by staff

Simcoe Muskoka District Health Unit 18 Key Findings: Service Quality & Impact  Most respondents reported accessing the service had a positive impact 57 % obtained new information 57 % obtained new information 11% changed their behavior 11% changed their behavior 4% had either increased confidence in dealing with issue, decreased stress and were reassured by the support 4% had either increased confidence in dealing with issue, decreased stress and were reassured by the support

Simcoe Muskoka District Health Unit 19 Key Findings: Service Quality & Impact  HC services currently being provided are meeting or exceeding client expectations

Simcoe Muskoka District Health Unit 20 Key Findings: Service Quality & Impact  reported challenges/barriers to utilizing the service were around call management (56%) and unmet needs (24%) long wait times before reaching staff (42 % waited 2-5 mins.) long wait times before reaching staff (42 % waited 2-5 mins.) clarity of voic instructions (being unsure of what information to provide) clarity of voic instructions (being unsure of what information to provide) limited access to a live person limited access to a live person advice/information provided did not meet need advice/information provided did not meet need limited appointment times limited appointment times staff unable to answer question staff unable to answer question

Simcoe Muskoka District Health Unit 21 Recommendations  Call Management: increase the ability of clients to self- direct through the system and minimize number of transfers  Implementation: self-direct options provided off main menu self-direct options provided off main menu direct access to specific linedirect access to specific line access to pre-recorded informationaccess to pre-recorded information ability to leave requested information by voic ability to leave requested information by voic call routing algorithms developed for switchboard staff call routing algorithms developed for switchboard staff

Simcoe Muskoka District Health Unit 22 Recommendations  Service Access: improve access to live answer by staff, service and timely responses  Implementation: Increase call response capacity Increase call response capacity CSR positionsCSR positions VPD/OH pilotVPD/OH pilot Back-up staffBack-up staff Electronic Scheduler Electronic Scheduler

Simcoe Muskoka District Health Unit 23 Recommendations  Web-services: increase availability of web-based services  Implementation: website redesign website redesign secure submission of personal health information i.e. immunization records secure submission of personal health information i.e. immunization records

Simcoe Muskoka District Health Unit 24 Recommendations  Implementation enablers fit with agency strategic priorities fit with agency strategic priorities Executive sponsorship and endorsement Executive sponsorship and endorsement broader benefit impact broader benefit impact  Implementation barriers competing priorities competing priorities current economic climate current economic climate stakeholder fatigue stakeholder fatigue

Simcoe Muskoka District Health Unit 25 Presenter Contact Information Reina Barker Joyce Fox Simcoe Muskoka District Health UnitSimcoe Muskoka District Health Unit 15 Sperling Drive15 Sperling Drive Barrie, On L4M 6K9Barrie, On L4M 6K9 (705) ext 7359(705) ext 7210