1. 1 Introduction to State Logic Models and Related Planning Stephanie Lampron, NDTAC

2. 2 Agenda Provide an overview of the logic model framework for this conference Discuss the different purposes of logic models Demonstrate the sections of a logic model Discuss leading and lagging indicators and relationships to the model Provide an overview of the state logic model template

3. 3 Logic Models and Relevance to Title I, Part D Why are we talking about them today? –Link to recent initiatives at ED –Assist you in conceptualizing your programs –Assist you in thinking about the best uses of funds for your programs

4. 4 Why Develop a Logic Model? Logic model development offers the following benefits: Identifies program goals, objectives, activities, and desired results Clarifies assumptions and relationships between program efforts and expected outcomes Communicates key elements of the program Guides assessment of underlying project assumptions and promotes self-correction Helps specify what to measure in an evaluation Citation: OJJDP-Understanding Logic Models, accessed at:OJJDP-Understanding Logic Models http://www.ojjdp.gov/grantees/pm/logic_models_understanding.html

5. 5 Information That Logic Models Should Demonstrate Outline how and why a program, policy, or initiative should work Show the relationship between resources, how the program will operate, and what the program aims to achieve Citation: OESE Toolkit for Leading Indicator Development

6. 6 Basic Components of a Logic Model Input/ Resources Activities/ ProcessesOutputs Outcomes (short-term) Outcomes/ Results (intermediate) Outcomes/ Impact (system change) Resources that enable program effectiveness (and barriers that may hinder it) Activities, technologies, tools, events, and actions of the program; interventions intended to bring the desired result Describes the size and scope of the services and products delivered or produced Changes expected in 1–2 years; individual level Changes expected in 3–5 years; organizational level Changes expected at 5+ years; system level Funding, staff, equipment, policies, attitudes, etc. Monitoring, professional development, assessments, etc. People trained, students served, hours of instruction, etc. What short- term changes result from activities? (attitude change; improved behavior) What longer term changes result from services? (increased reading proficiency) What is the aspirational goal? (100% literacy rate) Citations: OESE Toolkit for Leading Indicator Development; Kellogg Logic Model Guide

7. 7 Consider Your Planning Level At what level are you conceptualizing your long-term outcomes? At what level are the processes and activities occurring? –SEA activities and impact –SA/LEA activities and impact –Facility activities and impact

8. 8 Leading and Lagging Indicators Leading Indicators Align with the process, output, or outcomes areas of the logic model Identify if activities are taking place Demonstrate signs of growth or change in a given direction that suggests early progress or a warning signal Measure conditions that are prerequisite to the desired outcomes (i.e., predict lagging indicators) Lagging Indicators Align with the outcomes, results, and impacts portion of the model Measure the success and consequences of activities that have already occurred Measure achievement of the desired outcomes The same indicator may serve as a leading or lagging indicator, depending on when it is used/examined.

9. 9 Selecting Performance Indicators What kind of indicator is each of the following and why? Graduation rate Enrollment rate GED enrollment rate Number of CTE certificates awarded Number of CTE certificates earned Recidivism rate Types of CTE courses offered Number of CTE courses offered Per pupil spending Number of youth served Percentage of HQT by FTE Bed count High school transcript Average SAT/ACT score Course completion rate

10. 10 State TIPD Leading Indicators for Subpart 1 and Subpart 2 The percentage of long-term students served (90+ calendar days) who have both pretest and posttest scores in reading The percentage of long-term students served (90+ calendar days) who have both pretest and posttest scores in mathematics The percentage of students who enrolled in a school after exit from a Title I, Part D program The percentage of students served earning high school course credits up to 90 days after exit

11. 11 State Part D Templates Turn to the model templates you have been provided; we will be using and discussing these throughout the day.

12. 12 Logic Model Development Resources W.K. Kellogg Foundation Logic Model Development Guide (http://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg- foundation-logic-model-development-guide.aspx)W.K. Kellogg Foundation Logic Model Development Guide National Juvenile Justice Evaluation Center (NJJEC) Logic Model Toolkit for Juvenile Justice Service Providers (http://www.jrsa.org/njjec/publications/logic_model_toolkit.pdf)National Juvenile Justice Evaluation Center (NJJEC) Logic Model Toolkit for Juvenile Justice Service Providers NJJEC Logic Model Tutorial (http://www.jrsa.org/njjec/njjec-tutorial/category/learning3/)NJJEC Logic Model Tutorial Office of Juvenile Justice and Delinquency Prevention (OJJDP) Logic Models (http://www.ojjdp.gov/grantees/pm/logic_models.html)Office of Juvenile Justice and Delinquency Prevention (OJJDP) Logic Models Bureau of Justice Assistance (BJA) Center for Program Evaluation and Performance Measurement: “Developing and Working with Logic Models” (https://www.bja.gov/evaluation/guide/pe4.htm)Bureau of Justice Assistance (BJA) Center for Program Evaluation and Performance Measurement: “Developing and Working with Logic Models”

13. 13 Leading Indicator References and Resources Leading Indicators of School Turnaround: How To Know When Dramatic Change Is on Track (http://www.darden.virginia.edu/web/uploadedFiles/Darden/Darden_ Curry_PLE/UVA_School_Turnaround/Leading_Indicators_of_School _Turnarounds.pdf)Leading Indicators of School Turnaround: How To Know When Dramatic Change Is on Track Beyond Test Scores: Leading Indicators for Education (http://annenberginstitute.org/pdf/leadingindicators.pdf)Beyond Test Scores: Leading Indicators for Education In Search of Leading Indicators in Education (http://www.cpre.org/search-leading-indicators-education)In Search of Leading Indicators in Education