1. Host: Don Pratt Monday, April 11, 2011 9:30 – 10:30 AM EDT Monday, April 11, 2011 9:30 – 10:30 AM EDT Performance Measures for PHCAST Demonstration Projects

2. 2 Agenda 1. Performance measurement involves... 2. Performance measure examples 3. Anatomy of a performance measure 4. Additional considerations 5. Group discussion: What can you track for your project? Purpose of today’s session: Share information and ideas about what you are already measuring—and what you may be thinking of measuring—to assess the performance of your project. This session an opportunity to share in the process of identifying some common performance measures.

3. Performance Measures for PHCAST Demonstration Projects3 Performance measurement involves...  Tracking work completed (activities/outputs)  Measuring outcomes (usually “soft” measures and short-term)  Routine/cyclical data collection  Comparing observed results to performance targets  Using results to improve program management and outcomes

4. Performance Measures for PHCAST Demonstration Projects4 Performance Measure Examples  Output: Develop new training curriculum aligned with competency models (end of year one).  Output: Train X participants using new curriculum (middle of year two).  Output: Collect feedback from participants and instructors to assess implementation (middle of year two).  Outcome: X percent of trainees report training met their learning needs (end of year two).

5. Performance Measures for PHCAST Demonstration Projects5 Output: Training X participants using new curriculum (middle of year two). Anatomy of a Performance Measure  What will occur? Participants will be trained using new curriculum  How much will be accomplished? X participants will be trained  When will it occur? By middle of year two

6. Performance Measures for PHCAST Demonstration Projects6 Additional Considerations  What schedule will you follow for data collection, and who are the partners in this process? (planning and logistics)  Who will provide the data? (data source)  What evidence will you rely on to know if results occurred? (indicators)  What instruments will you use to collect the data? (tools)  How will you ensure data quality? (reliability, validity)

7. Performance Measures for PHCAST Demonstration Projects7 What results do you currently track in the areas of curriculum, certification and trainees? How do you track these results? Are there other results you don’t currently track but that you would like to track?

8. Performance Measures for PHCAST Demonstration Projects8 How do you envision using this information to improve your program?

9. Performance Measures for PHCAST Demonstration Projects9 What are some areas you think would be best addressed through more formal evaluation efforts (and why)?