1. Dial-in: 1-877-512-6886 Pass code: 16 16 32 2775 SPDG Directors’ Webinar Collaboration Measurement Presenters: David Merves, Evergreen Evaluation and Consulting Inc. Tool Sharing: Devin Healy, Utah SPDG Greg Frostad, New Mexico SPDG Facilitators: David Guardino, OSEP Project Officer John Lind, Interim SIGnetwork Coordinator 1

2. Roll Call

3. *6 / #6

5. Housekeeping 5 Next Directors’ Webinar Apr 1: Coaching Evaluation Tools SIGnetwork Subscription Dues: If you have not received invoicing or have questions, contact Linda Lynch. lglynch@uoregon.edu 541.346.0358

6. Introductions 6

7. Measuring Levels of Collaboration Signetwork Webinar March 5 th, 2014 David Merves, Evergreen Evaluation & Consulting, Inc.

8. Session Goals What is Collaboration? Introduce Draft Collaboration Instrument Attendees develop their own SPDG examples of collaboration Benefits and Challenges Q & A

9. What comes to mind when you think of the term “collaboration”?

11. Providing input via advisory group/work group Notifying one another of upcoming events Developing a product together Co-planning and providing state training Linking from web site to partner resources Referring clients to partner What else? What are Examples of Working Together?

12. TREASURE WHAT YOU MEASURE

13. Collaboration: Research and Evaluation Sequence of the evaluation process Evaluation Questions Logic Model Theoretical Model Evaluation Methodology

14. NCEO Partner Collaborative Logic Model

15. Theoretical Considerations and Approaches Levels of collaboration outcomes Collaboration in Early Care and Education: Establishing a Framework for a Research Agenda Logic Model; Child Care Policy Research Consortium Annual Meeting, October 21-22, 2010 Dimensions of collaboration Thomson, Perry, & Miller, Conceptualizing and Measuring Collaboration, 2007, Journal of Public Administration Research and Theory Levels of collaboration Frey, Lohmeier, Lee & Tollefson, American Journal of Evaluation 2006; 27; 383, Measuring Collaboration Among Grant Partners Levels of integration Gajda 2004; 2009 Evaluating Organization Collaboration ppt, AEA Collaboration for the 21 st Century Belinda Biscoe, Director of Mid-Continent Comprehensive Center (MC 3 ). 4th Annual Leveraging Resources Conference, Office of Elementary and Secondary Education, OSEP, Washington, D.C., March 25, 2009 Evaluating community collaboration Evaluating Community Collaborations, Thomas E. Backer, Editor, 2003, Springer Publishing

17. SPDG Levels of Collaboration Instrument Your examples

21. How do you communicate the information/data you have collected?

24. Inter-Agency Linkages Pre- Grant 24

25. Year 1

26. Year 2

27. Year 3

28. Benefits of Collaboration Co-sponsorship of TA products, tools, and services Assisting clients no matter whom they call (efficiency of ‘triage’) Communicating activities to field, using similar language across TA providers Sharing resources/funds for cost-effective, complimentary (i.e., non- duplicative) efforts Cost of TA with centers operating jointly versus separately (cost efficiency) Increased availability of resources

29. Collaboration Challenges Difficulties associated with initial stages of evaluation Staff members’ lack of time Delayed accomplishments Duplication of efforts Difficulty working with a diverse set of organizations

30. Questions and Answers

31. Thank you For additional information please contact: David Merves Evergreen Evaluation & Consulting, Inc. david@eecvt.com (802) 434-7644

32. Resources Frey, B. B., Lohmeier, J. H., Lee, S. W., & Tollefson, N. (2006). Measuring Collaboration Among Grant Partners. American Journal of Evaluation, 383-392.