1. Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program Chad Green, Program Analyst Lynn McNally, Technology Resource Supervisor Loudoun County Public Schools, VA Virginia DOE Tech Leadership Conference, November 29, 2006

2. Goals of Presentation 1. Loudoun Tech Leadership Program: The Story 2. Enhancing the Program: Logic Model Framework 3. Research Anchor: Why Use a Logic Model 4. Questions and Answers

3. Loudoun Tech Leadership Program 1. The Story Spring 2002 - Bill and Melinda Gates (VITAL) Market to Principals Roll Out the TAGLIT Survey The Workshop Plan Packages 1. The Story Spring 2002 - Bill and Melinda Gates (VITAL) Market to Principals Roll Out the TAGLIT Survey The Workshop Plan Packages

4. Loudoun Tech Leadership Program

7. Spring 2002 - Planning - LM Year 1: 17 workshops, 291 participants – SK Year 2: 10 workshops, 102 participants – SB Year 3: 32 workshops, 360 participants – PT Year 4: 39 workshops, 340 participants – PT Spring 2002 - Planning - LM Year 1: 17 workshops, 291 participants – SK Year 2: 10 workshops, 102 participants – SB Year 3: 32 workshops, 360 participants – PT Year 4: 39 workshops, 340 participants – PT Loudoun VITAL Participation

8. End of Year 4 – Look at Benefits PrincipalITRTSupervisorStudent Tech Skills New Tools Tech Integration Data Manipulation SIP Planning Manage Change Understand Role Build Partners Consultant Role More Visibility Awareness of Initiatives Understanding of Initiatives Build Partners Thoughtful Tech Integration Learning Motivation Interest

9. Enhancing the Program 2. Logic Model Framework What Is a Logic Model? Components of a Logic Model Benefits of Logic Models Example: Loudoun VITAL Program Using a Logic Model for Evaluation 2. Logic Model Framework What Is a Logic Model? Components of a Logic Model Benefits of Logic Models Example: Loudoun VITAL Program Using a Logic Model for Evaluation

10. Enhancing the Program What Is a Logic Model? Provides a graphic description of a program. Shows the relationship of program resources and activities to expected results. Makes explicit the underlying theories and assumptions (logic) behind a program’s design. What Is a Logic Model? Provides a graphic description of a program. Shows the relationship of program resources and activities to expected results. Makes explicit the underlying theories and assumptions (logic) behind a program’s design.

11. Enhancing the Program Components of a Logic Model Situation Statement: Mission of program and intended outcomes based on needs Inputs: Required resources for activities to achieve outcomes Outputs: Activities and participation rate/ satisfaction of target populations Components of a Logic Model Situation Statement: Mission of program and intended outcomes based on needs Inputs: Required resources for activities to achieve outcomes Outputs: Activities and participation rate/ satisfaction of target populations

12. Enhancing the Program Components of a Logic Model (cont.) Outcomes: Short-, medium-, and long-term benefits for program participants (results) Assumptions: Supporting evidence of the effectiveness of program design External Factors: Other potential influences on program’s ability to achieve outcomes Evaluation: Formative and summative Components of a Logic Model (cont.) Outcomes: Short-, medium-, and long-term benefits for program participants (results) Assumptions: Supporting evidence of the effectiveness of program design External Factors: Other potential influences on program’s ability to achieve outcomes Evaluation: Formative and summative

13. Enhancing the Program Benefits of Logic Models Goal Setting: Define the specific short-, medium-, and long-term outcomes (results) of a program. Planning and Design: Clarify the underlying assumptions, relationships, and desired effects of program activities. Benefits of Logic Models Goal Setting: Define the specific short-, medium-, and long-term outcomes (results) of a program. Planning and Design: Clarify the underlying assumptions, relationships, and desired effects of program activities.

14. Enhancing the Program Benefits of Logic Models (cont.) Communications and Marketing: Clarify and illustrate the program to key stakeholders. Collaboration: Build buy-in and promote consensus on program design and outcomes. Evaluation: Focus resources on the most critical and appropriate data to track. Benefits of Logic Models (cont.) Communications and Marketing: Clarify and illustrate the program to key stakeholders. Collaboration: Build buy-in and promote consensus on program design and outcomes. Evaluation: Focus resources on the most critical and appropriate data to track.

15. Enhancing the Program Example: Loudoun VITAL Program See handouts. Example: Loudoun VITAL Program See handouts.

16. Enhancing the Program Using a Logic Model for Evaluation Develop essential questions for each column. Prioritize and select questions given resources. Identify indicators for each question. Develop data collection tools for indicators. Collect and analyze data. Report results to stakeholders. Using a Logic Model for Evaluation Develop essential questions for each column. Prioritize and select questions given resources. Identify indicators for each question. Develop data collection tools for indicators. Collect and analyze data. Report results to stakeholders.

17. Research Anchor 3. Why Use a Logic Model Why do you think the logic model has the components that it has and is a common tool for evaluation? Is it useful for planning and evaluating educational technology programs in general? 3. Why Use a Logic Model Why do you think the logic model has the components that it has and is a common tool for evaluation? Is it useful for planning and evaluating educational technology programs in general?

18. Research Anchor Feedback Spirals as Components of Continuous Learning * * Costa, A. L., & Kallick, B. (1995).

19. Research Anchor Feedback Spirals at the Program Level 1. Clarify program goals and purpose (via logic model). 2. Develop implementation and evaluation plan. 3. Implement and monitor priority program activities. 4. Collect, organize, and analyze evidence (data). 5. Review results with various groups. 6. Modify program activities based on new knowledge. 7. Revisit/clarify program goals and purpose. 8. Revisit logic model and action plan.... Feedback Spirals at the Program Level 1. Clarify program goals and purpose (via logic model). 2. Develop implementation and evaluation plan. 3. Implement and monitor priority program activities. 4. Collect, organize, and analyze evidence (data). 5. Review results with various groups. 6. Modify program activities based on new knowledge. 7. Revisit/clarify program goals and purpose. 8. Revisit logic model and action plan....

20. Questions and Answers 4. Questions and Answers Loudoun VITAL Program Logic Model Our Roles in Loudoun Chad’s Suit Lynn’s Haircut Good Restaurants in Roanoke 4. Questions and Answers Loudoun VITAL Program Logic Model Our Roles in Loudoun Chad’s Suit Lynn’s Haircut Good Restaurants in Roanoke