1. Evaluation to Support Strategic Planning in Indian/Native Communities
Doug Novins, PhD
Candace Fleming, PhD

2. The Role of the Evaluation in CoC
Provide a knowledge base for the planning effort
Facilitate the process for developing the capacity for ongoing evaluation efforts
Examine the feasibility of the service system models
Document and disseminate the results of the initiative 2

3. Key Differences: CoC versus Typical Evaluation
In CoC, evaluation provides important information (“data”) that is used in the planning effort 2

4. A Typical Evaluation Model for Strategic Planning Efforts
Design Service System
Model
Assess Planning Effort
(Process Evaluation)
Assess Service System Model
(Feasibility Assessment)
Refine Service System
Model

5. The Circles of Care Evaluation Model
Assess Needs and Existing Services
Measure Development
Design Service System
Model
Assess Planning Effort
(Process Evaluation)
Assess Service System Model
(Feasibility Assessment)
Refine Service System
Model

6. Key Differences: CoC versus Typical Evaluation
In CoC, evaluation provides important information (“data”) that is used in the planning effort
In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer 2

7. A Typical Evaluation Model for Strategic Planning Efforts
Program
Staff
Evaluator

8. The Circles of Care Evaluation Model
Program
Staff
Evaluator

9. The Circles of Care Evaluation Model
Program
&
Evaluation
Team

10. Key Differences: CoC versus Typical Evaluation
In CoC, evaluation provides important information (“data”) that is used in the planning effort
In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer
In CoC, the community is an active participant in designing and implementing the evaluation plan, not simply the “target” of evaluation activities 2

11. A Typical Evaluation Model for Strategic Planning Efforts
Program
Staff
Evaluator
Community

12. The Circles of Care Evaluation Model
Community
Program
&
Evaluation
Team

13. The Circles of Care Evaluation Model
Community
Program
&
Evaluation
Team

14. Components of the Evaluation
Outline Goals
Marshal Resources
Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources 2

15. Components of the Evaluation
Outline Goals
Marshal Resources
Assess
Community
Needs
Define Serious
Emotional/Behavioral
Disturbance
Describe
System of
Services
Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources 2

16. Components of the Evaluation
Outline Goals
Marshal Resources
Assess
Community
Needs
Define Serious
Emotional/Behavioral
Disturbance
Describe
System of
Services
Design/Modify the Service
System Model
Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources 2

17. Components of the Evaluation
Outline Goals
Marshal Resources
Assess
Community
Needs
Define Serious
Emotional/Behavioral
Disturbance
Describe
System of
Services
Design/Modify the Service
System Model
Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources
Develop Outcome
Measures 2

18. Components of the Evaluation
Outline Goals
Marshal Resources
Assess
Community
Needs
Define Serious
Emotional/Behavioral
Disturbance
Describe
System of
Services
Design/Modify the Service
System Model
Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources
Develop Outcome
Measures
Assess Feasibility 2

19. Components of the Evaluation
Outline Goals
Marshal Resources
Assess
Community
Needs
Define Serious
Emotional/Behavioral
Disturbance
Describe
System of
Services
Design/Modify the Service
System Model
Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources
Develop Outcome
Measures
Assess Planning Effort
(Process Evaluation)
Assess Feasibility 2

20. Our Role and Mandate
To provide a clear framework for the grantees to use in designing their evaluation efforts
To allow the grantees to design an evaluation effort that is most consistent with the priorities of their communities.
To facilitate a process for identifying common domains for each of the evaluation components. 2

21. Our Role and Mandate
To provide a clear delineation of CoCETAC and grantee roles and responsibilities in the evaluation effort.
To provide consistently high quality technical assistance through a specific set of activities. 2

22. CoCETAC Technical Assistance Activities
Grantee Meetings
Evaluator Meetings
Site Visits
Scheduled Technical Assistance Conference Calls
Ad Hoc Conference Calls and Exchanges
Detailed Reviews and Critiques of Evaluation Reports
Maintain World Wide Web Site
CoC Distribution List 2

23. Grantees Role and Mandate
Development of site specific domains, constructs, and measures
Obtain necessary IRB and other research approvals
Data collection, reduction, and analysis
Provide site-specific content to CoCETAC website
The writing and submission of local interim and final reports. 2

24. AIANP Resources on the World Wide Web
CoCETAC:
NCAIANMHR
The Healthy Nations Initiative 2