The Ohio STEM Learning Network: A Study of Factors Affecting Implementation Spread and Sustainability

Measuring Implementation Applying Research on Science Materials Implementation: Bringing Measurement of Fidelity of Implementation (FOI) to Scale Supported by the National Science Foundation Instruments that could be used across multiple programs We had practical and theoretical reasons A suite of instruments that could be used alone or in combination depending on resources and goals We were keeping the users in mind. Provide detailed and specific information about FOI We wanted to know more than if the intervention worked. We wanted to know what parts worked (in which contexts under what conditions). A Little Bit of Background and Theory….

Fidelity and Implementation Conceptual Framework

Implementation Factors Study #2: Accumulating Knowledge on Scaling and Sustaining Reform: A Foundation for Future Research concepts factors processes mechanisms Study #1: Nine-Site Study Nine sites that sustained elementary science programs from years Why did they last?

characteristics of the innovation elements of the environment - internal characteristics of people in the organization fit elements of the environment intrinsic motivation strategies elements of the environment - external factor categories

What is the status of implementation of the Platform school’s STEM school model and to what extent does the model reflect the OSLN Initiative’s Design Principles What factors have contributed to or inhibited the implementation of each Platform school’s STEM school model? What factors have contributed to or inhibited the spread of each Platform school’s STEM school model to other schools hubs and institutions over time? What are the differential effects of the factors affecting sustainability, spread and implementation on the evolution of the implementation over time? What is a STEM school? (bonus!) The Ohio STEM Learning Network: A Study of Factors Affecting Implementation, Spread and Sustainability Our Research Questions:

OSLN Can we find a way to specifically and meaningfully represent implementation “types”? Once we understand what implementation types are, what is the best way to examine the factors that contribute to and inhibit those types? What types are “best”? Which critical components are key to success? Can we bring clarity in the field about what STEM schools are and facilitate collaboration around research on STEM schools? The Ohio STEM Learning Network: A Study of Factors Affecting Implementation, Spread and Sustainability Our Guiding Questions and Goals:

Year One Pre-Data Collection Worked with STEM schools to articulate their models (critical components) Adapted factors and created instruments for measuring them Created instruments for measuring enactment of critical components Established relationships with STEM schools and hubs Data Collection Teacher and School Leader Instructional Questionnaires Teacher and School Leader Factor Questionnaires Student Questionnaires Networking Questionnaires (teacher, school leader, hub partners) On-Site Data Collection (2 schools) Observations, Interviews, Focus Groups Data Analysis School Reports and School Meetings Network Analysis Implementation Types Factors The Study

Year Two The Study Pre-Data Collection Revise Instruments Communication with Sites Presentations to School Staff and Leadership Spread Strategy Coordination and leveraging with other REESE project Data Collection Student Questionnaires Teacher and School Leader Instructional Questionnaires Teacher and School Leader Factor Questionnaires Student Questionnaires On-Site Data Collection (5 schools) Observations, Interviews, Focus Groups

Researchers Without Borders – Year One STEM School Community STEM School Infographic Development Researchers Without Borders – Year Two STEM School Webinars – What is a STEM School? STEM School Webinars – STEM School Partnerships STEM School Webinars – STEM School Research STEM School Research Coordination STEM School Infographic Commitment to Open Research Share work in progress with others including other researchers, practitioners, and policy makers. This is risky but essential.