1. Provincial Evaluation Plan By Kathleen Douglas-England
The Innovative Approaches to Preschool Developmental Screening and Follow-up Services Initiative
Provincial Evaluation Plan
April 2009
By Kathleen Douglas-England
Karen Tofflemire
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

2. Outline Initiative goals Provincial Logic Model
Provincial Evaluation Objectives
Provincial Evaluation Framework
Overview of methods to be used
Work Flow for the Provincial Evaluation
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

3. Goals of the initiative
To increase the number of children receiving appropriate developmental screening and follow-up services between the ages of 18 months to 36 months.
To try out new approaches and improve timely access to assessment for the children referred from screening.
To try out new ways of providing intervention approaches and improve timely access to interventions for children identified as requiring services through assessment.
To provide parents with increased number of access points for screening and follow-up.
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

4. Goals of the initiative
To develop, implement and evaluate new models of coordinated community based screening/assessment/intervention approaches for preschool children.
To improve timely identification and referral of children eligible for educational programming.
To test the use of range of service providers and alternative service provision to determine cost-effective approaches.
To gather data and disseminate findings and evidence form the funded projects to inform decision-making regarding how to improve access to developmental screening and follow-up services in Alberta.
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

5. Goals of the Initiative
Figure 1: Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative – Logic Model
WHY
Early identification of developmental delays may allow for early intervention and more positive health outcomes for children, their families and the community.
Rationale
WHO & WHAT
Communication * Collaboration * Partnership * Sustainability
Innovative approaches to service delivery * Funding
Families and Children
Goals of the Initiative
Goals want to achieve
&
Levels of reach
Alberta Health
And
Wellness
Alberta Education
Alberta Children & Youth Services
HOW
Key principles
& Resources
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

6. Projects Millwood Community Preschool Screening Project (Capital)
Grow Along with Me Project (Chinook)
Growing Together Project (David Thompson)
Pediatric Regional Integrated Services Model (PRISM)(East Central)
Teaming for Tots (Palliser)
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

7. Provincial Evaluation Objectives
To address the goal of the provincial evaluation seven evaluation objectives have been identified:
To determine to what extent the implementation of the projects had on the access of children and families to screening and follow-up services.
To determine what factors facilitated access to screening and follow-up services.
To determine how barriers that impeded access to screening and follow-up services were addressed by the projects.
To determine what practices enhanced or hindered communication between service delivery partners.
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

8. Provincial Evaluation Objectives
To determine what were the most effective ways of coordinating or facilitating movement of children and their families through the continuum of services within and outside of those offered by the projects.
To determine to what extent did the models/approaches have had on parent knowledge, parent practices, parenting self-efficacy and parent satisfaction.
To describe successes and challenges of specific approaches developed to work with cultural communities.
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

9. Evaluation objectives
Provincial Evaluation Framework
Goal: To determine the effectiveness of the projects in generating practices that advance preschool developmental screening and follow-up services at a system level in Alberta.
Structure
Process
Outcome
Evaluation objectives
1.To determine to what extent the implementation of the projects had on the access of children and families to screening and follow-up services.
To determine what factors facilitated access to services.
To determine how barriers that impeded access were addressed by the projects.
To determine what practices enhanced or hindered communication between service delivery partners.
To determine what were the most effective ways of coordinating or facilitating movement of children and their families through the continuum of services within and outside of those offered by the projects.
To determine to what extent did the models/approaches have had on parent knowledge, parent practices, parenting self efficacy and parent satisfaction.
To describe successes and challenges of specific approaches developed to work with cultural communities.
Approaches/models
Partnerships – service delivery & stakeholders
Funding
Staff mix
Infrastructure
Policies
Barriers
Facilitators
Sustainability
Communication with service delivery partners
Communication between stakeholders
Partnership development
Coordination of services
Client description and differences
Barriers
Facilitators
Improved access to:
screening,
assessment and
interventions
Patient satisfaction with service
Improved parent knowledge and self- efficacy
Improved parent practices
Measurement
Quantitative- review of project data (e.g. parent surveys, project data on screening, assessment and referrals)
Qualitative – staff/partner and stakeholder (e.g. communication, collaboration)
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

10. Methodology Overview
Data for the provincial evaluation will collected using the following approaches:
Document review
Interviews/focus groups with project leads/stakeholders
Surveys with staff/partners
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

11. Workflow Overview
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

12. For additional information
CONTACT
Kathleen Douglas-England, MSc
Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative
Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire