1. Evaluating Communities of Practice in Child and Youth Mental Health

2. Introductions Discuss with others at your table: –What are communities of practice? –What you would like to learn about CoPs today?

3. In this workshop, we ask… What are communities of practice (CoPs)? Why evaluate the work ofCoPs? How might we evaluate the work of CoPs?

4. What are communities of practice?

5. A brief overview… Subject (Domain) –A shared area of interest that provides a common focus –Shared competence in this area People (Community) –A group of people who interact in an ongoing way –Emphasis on relationships as the route to collective learning Action (Practice) –Practitioners who develop a set of shared resources (experiences, stories, tools for solving problems) –Emphasis on sustained interaction over time

6. Goals of a CoP Problem solving Growth and evolution of members Sharing information and experiences Reusing and recycling resources Evaluating information and developments Identifying gaps in knowledge

7. An Example: Triple P CoP Subject –Evaluation of Triple P programs in Ontario People –Service providers in charge of evaluating Triple P programs Action –An online portal for developing the evaluation framework; e-discussions and teleconferences; working towards common measures

8. CoP Collaboration Collaborations Often time-limited Goal: Concrete tasks determined by the group Communities of Practice Longer-term, ongoing Goals: Produce or manage knowledge Change practice

9. A Community of Practice Inventory COMMUNITY OF PRACTICE INVENTORY FORM ORGANIZATION: __________________________ DEPARTMENT OR UNIT: ____________________ DATE: ____________________________________ NameCoP NamePurposeLength of time CoP has existed Formally recognized? Frequency and type of meetings 1. 2. 3. 4. Continued…

10. In small groups… Identify one community of practice you are involved in and ask yourselves: –What is the subject or domain? –Who is involved? –What are the CoPs activities? –What are the CoPs goals?

11. Why evaluate the work of CoPs?

12. What do we want to know? Impact/Outcome What changes are produced by the CoP Process How the CoP works

13. Measuring Processes and Outcomes System Individual Practice Organization Profession Work of CoP (Process) Impact on Client/ Family (Outcomes) Sylvestre & Bendell, 2008

14. In small groups… Thinking about your community of practice, what goal do you want to evaluate? –How would you measure this goal? –How do you know you have achieved this goal? –Do you have any timelines for achieving this goal?

15. How might we measure processes? How is the group developing? –Assemble and Form –Storm and Order –Norm and Perform –Transform and Adjourn

16. How is the group working together? Networking, Cooperating, Partnering, Merging, Unifying (Rebecca Gajda, 2004) Awareness, Communication, Coordination, Collaboration (Gina Browne, 2004)

17. In small groups… Describe the processes in your community of practice… How it is developing (form, storm, perform, norm)? How it is working (networking, communicating, coordinating, collaborating)?

18. But what about outcomes?

19. In small groups… Describe the outcomes your community of practice might produce at different levels… –System –Organization –Profession –Individual practice How might you measure these?

20. Who do you need to talk to? What decisions need to be made? What actions need to be taken? How will the actions be evaluated? What will we do with what we know?

21. What did you find… Surprising? Important? Confusing? Applicable to the work you do?

22. FOR MORE INFORMATION Purnima Sundar, PhD Research and Knowledge Exchange Consultant psundar@cheo.on.ca 613.737.7600, ext. 3485 www.onthepoint.ca or www.cymh.ca psundar@cheo.on.ca www.onthepoint.cawww.cymh.ca psundar@cheo.on.ca www.onthepoint.cawww.cymh.ca