1. PLANNING TO MONITOR OR EVALUATE (CONT’D) ©2006 William Holmes

2. SET PRIORITIES Measures from Logic Model Measures from Requirements Procedures for Data Collection Persons Responsible for Data Collection Timeline for Data Collection Report Procedures Quality Assurance Procedures

3. LOGIC MODEL MEASURES: PART I Program Goals Input Status Intake Criteria Assessments

4. LOGIC MODEL MEASURES: PART II Services/Activities Resources Termination Criteria Output Status

5. REQUIRED MEASURES Legal eligibility Legal status Body counts Report data Contract requirements Normative requirements

6. MEASUREMENT PLAN VariablesMeasures How Collected By WhomWhen DepressionCES-DQuestionnaireStaffIntake and Exit Suicidal RiskSuicide ScaleQuestionnaireStaffIntake and Exit CounselingNumber of sessions Service FormCounselorEach session

7. PROCEDURES FOR DATA COLLECTION How data collected When data collected By whom data collected How data kept secure To whom data given

8. TIMELINE PLANNING Specifying event sequence Specifying event timing Specifying event options Specifying externally imposed timelines Test timeline by walking through timeline with staff

9. REPORT PLANNING Reports for case management Reports for resource management Reports to meet contract requirements Reports for staff development Reports for PR Develop examples of reports.

10. PLANNING QUALITY ASSURANCE Completeness of data Timeliness of data Accuracy of data Relevance to service delivery Relevance to program improvement and staff training

11. PLANNING APPROVAL PROCESS Informed Consent Requirements Supervisor Approval Policy Board Approval IRB Approval

12. INFORMED CONSENT FOR CLIENTS None for anonymous data Minimal harm exemption waver Risk and benefit notice Use of data notice Expiration dates if necessary Health data HIPPAA involvement

13. SUPERVISOR APPROVAL Provide summary info Discuss process Raise questions

14. PRIVACY BOARD APPROVAL Check Privacy Board Policies. Review Privacy Board Procedures. Develop documentation required by Privacy Board (if any). Seek prior approval if required.

15. IRB APPROVAL Check IRB policies. Review IRB procedures. Review IRB forms Informally discuss issues to identify red flags. Make sure all forms submitted are complete. Be sure to use expected jargon.