1. Learning Target
Participants will have a first step in mind toward creating a meaningful evaluation of their collaborative work.
Or… Participants will have an action in mind about how to improve their evaluation of their collaborative work.

2. In evaluating collaboration, you can measure:
the presence or absence of the core components of collaboration
the amount (level) of collaboration occurring between different partners
the extent to which collaborative activities are taking place specific to the content of your initiative
who is sending and who is receiving information (& who is making contact and who is receiving that contact, i.e., Social Network Analysis)

3. What can you measure?
if you are meeting the targets (short-term outcomes) set by your collaboration
whether you are reaching your mutually agreed upon desired outcomes
if the partners are spending their money in the way that was planned
if the partners are engaged in the agreed upon activities.

4. How do you routinize the collection of these data?
Making this all part of your contracting procedures.
Other ideas???

5. A Model of Collaboration Thomson, Perry, & Miller (2007)
Governance
Administration
Mutuality
Norms (trust)

6. Governance Administration
Jointly make decisions about rules that will govern behavior & relationships
Working rules about who can make decisions about collective problems, cost & benefit distribution, and how information is disseminated
Administration
Some kind of administrative structure must exist that moves the group from governance to action
About implementation and management; requires clarity of roles and responsibilities
Communication channels that enhance coordination
Mechanisms to monitor activities

7. Mutuality
Interdependence: organizations that collaborate must experience mutually beneficial interdependencies based either on shared or complimentary interests
Norms
Can also be seen as a form of trust which is a common belief among a group of individuals that another group will:
(1) make good-faith efforts to behave in accordance with any commitments both explicit and implicit,
(2) be honest in whatever negotiations preceded such commitments, and
(3) not take excessive advantage of another even when the opportunity is available

8. Why might it be important to understand the core components of collaboration?

9. Levels of Collaboration
(Frey, Lohmeier, Lee & Tollefson, 2006)
Collaboration
Independent agencies function as one entity or system. Frequent communication with mutual trust. Consensus reached on all decisions.
Share ideas and resources frequently. Frequent and prioritized communication. All members have vote in decision-making.
Coalition
Sharing information and resources on a regular basis, defined roles, frequent communication and some shared decision-making.
Coordination
Cooperation
Providing information to each other, somewhat defined roles, independent decision-making and formal communication.
Networking
Characterized by awareness of an organization and low levels of communication for referral purposes.

10. Levels of Collaboration
Why might it be important to know the level of collaboration?

11. Whatever your model(s)
You will need to know what to track and measure
It’s about the agreed upon goals and also how you agree to get there. (Process & Outcomes)

12. Steps to Evaluating Collaboration
Logic Model
Evaluation Plan

13. Fully detailed logic model
INPUTS
OUTPUTS
OUTCOMES
Program Investments
Intermediate
Activities
Participation
Short Term
Long Term
Project Objectives
Process Measures
Outcome Measures

14. Conceptualizing and Measuring Collaboration in the Context of Early Childhood Care and Education November 27, 2013
Office of Planning, Research, and Evaluation (OPRE) in the Administration of Children and Families (ACF) in HHS

15. Resources Measuring Collaboration
Missouri's Instrument to Measure Collaboration: Measuring Collaboration at State, Regional, and Local Levels   PPT | SESSION RECORDING 
April 24, Pam Williams, Missouri SPDG Director, Drs. Pattie Noonan and Amy Gaumer Erickson, Missouri SPDG Evaluators. 
RESOURCES:  
DESE Survey Levels of Collaboration Scale MITT Observation Tool 2013 RPDC Survey Willow Springs Elem Staff Survey Summary

16. Thank you
Pam Williams, Amy Gaumer-Erickson, Patti Noonan
Pat Mueller