Evaluation Tools & Approaches for Engaging Stakeholders: The AREA Approach Presentation at the Canadian Evaluation Society Dr. Mariam Manley, Principal.

Slides:

Advertisements

Similar presentations

Teacher Effectiveness Evaluation Pilot September 1, 2011 – September 30, 2012 NJ State Board of Education, July 13, 2011.

Advertisements

Progress Towards Reading Success: The Reading First Evaluation Prepared by: Amy Kemp, Ph.D. Research Associate and Patricia A. Muller, Ph.D. Associate.

A Vehicle to Promote Student Learning

M & E for K to 12 BEP in Schools

Through Instructional Rounds

North Carolina Educator Evaluation System. Future-Ready Students For the 21st Century The guiding mission of the North Carolina State Board of Education.

The NDPC-SD Intervention Framework National Dropout Prevention Center for Students with Disabilities Clemson University © 2007 NDPC-SD – All rights reserved.

© 2010 Learning Sciences International Bering Strait School District Demographic Information  Covers 88,000 square miles.

Freehold Borough Teacher Evaluation System Freehold Intermediate School Friday – February 15, 2013 Rich Pepe Director of Curriculum & Instruction.

Edward S. Shapiro Director, Center for Promoting Research to Practice Lehigh University, Bethlehem, PA Planning for the Implementation of RTI: Lessons.

Teacher Evaluation Model

April 6, 2011 DRAFT Educator Evaluation Project. Teacher Education and Licensure DRAFT The ultimate goal of all educator evaluation should be… TO IMPROVE.

Evaluation Plan for Wisconsin’s Educator Effectiveness System Prepared for the Wisconsin Department of Public Instruction By: ●Josef Dvorak ●Daniel Marlin.

Missouri Reading Initiative Evaluation Plan: Goals, Activities, and Responsibilities.

Muscogee County School District Division of Academics (DOA) District Accreditation Module 4: Quality Assurance.

Training in Instructional Consultation, Assessment & Teaming Todd A. Gravois, Ph.D. Edward Gickling, Ph.D. & Sylvia Rosenfield, Ph.D.

Johns Hopkins University School of Education 2006 ACTION RESEARCH Eileen Ferrance Northeast and Islands Regional Educational Laboratories Brown University.

Agenda Introductions Objectives and Agenda Review Research & Literature From Session 1 Homework Video Exercise Mid-Year Conferences.

UNDERSTANDING, PLANNING AND PREPARING FOR THE SCHOOL-WIDE EVALUATION TOOL (SET)

Student Assessment Inventory for School Districts Inventory Planning Training.

Differentiated Supervision

Assessing Financial Education: A Practitioner’s Guide December 2010.

Monitoring Accommodations in South Dakota Linda Turner Special Education Programs.

Observations A Mirror of the Classroom. Objectives  Gain specific strategies for communicating with teachers to promote successful teaching and learning.

Kim Ward and Pat Auger. Why is evaluation of technology literacy and use important to students, educators, the community, and our society? Outcome/Mega:

CONDUCTING PROGRAM EVALUATIONS FOR FEDERAL PROGRAMS Brooke Blair, ALSDE Mark Ward, ALSDE Erin McCann, SEDL Mary Lou Meadows, SEDL.

Dr. G. Johnson, Program Evaluation and the Logic Model Research Methods for Public Administrators Dr. Gail Johnson.

Agenda Overview of evaluation Timeline Next steps.

One Voice – One Plan Office of Education Improvement and Innovation MI-CSI: Do Stage Implement Plan and Monitor Plan.

Iowa’s Teacher Quality Program. Intent of the General Assembly To create a student achievement and teacher quality program that acknowledges that outstanding.

Missouri Reading Initiative Evaluation Plan: Goals, Activities, and Responsibilities.

Kazakhstan Centres of Excellence Teacher Education Programme Assessment of teachers at Level Two.

Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.

Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.

Learnings from Classroom Connections Findings and Conclusions from Two Studies on the Statewide Laptop Initiative Dr. Wade Pogany – South Dakota DOE –

Effective Instructional Feedback Mike Miles July 2009.

TAP TAP Basics (Preparing for Success in a TAP School) [PSTS]

Results of Survey on Level Organization June 2012.

Professional Practice Required Elements Self-Reflection, Professional Growth Planning To be completed by all principals and assistant principals annually.

Data Sources Artifacts: Lesson plans and/or curriculum units which evidence planned use of diagnostic tools, pre- assessment activities, activating strategies,

Learning Centered Conferencing with the Using the Danielson Framework John Hellwich & Michelle Lewis.

South Western School District Differentiated Supervision Plan DRAFT 2010.

The Delaware Performance Appraisal System II for Teachers Training Module 3 The DPAS II Process Training for Teachers.

NC Teacher Evaluation Process

Ongoing Training Day 2. Welcome Back! [re]Orientation Lead Evaluator Training Agenda Review.

20081 E-learning Lecture-10: EVALUATING THE IMPACTS OF E-LEARNING week 12- Semester-4/ 2009 Dr. Anwar Mousa University of Palestine Faculty of Information.

1 The Oregon Reading First Model: A Blueprint for Success Scott K. Baker Eugene Research Institute/ University of Oregon Orientation Session Portland,

Leading at All Levels to Support MDC Implementation

1 Universal Pre-Kindergarten (UPK) Scope of FY08 Evaluation Activities December 11, 2007.

“A Truthful Evaluation Of Yourself Gives Feedback For Growth and Success” Brenda Johnson Padgett Brenda Johnson Padgett.

CaMSP Cohort 8 Orientation Cohort 8 State and Local Evaluation Overview, Reporting Requirements, and Attendance Database February 23, 2011 California Department.

Idaho Principal Evaluation Process Tyson Carter Educator Effectiveness Coordinator Idaho State Department of Education

Teacher Growth and Assessment: The SERVE Approach to Teacher Evaluation The Summative or Assessment Phase.

Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.

Th e Heart of TPEP: Learning Centered Conferencing Michelle Lewis John Hellwich TPEP.

Data Report July Collect and analyze RtI data Determine effectiveness of RtI in South Dakota in Guide.

Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.

Educator Effectiveness Dr. Mark Kirkemier, Coordinator Dr. Alison Grizzle, Education Administrator Dr. Kisha Tolbert-Woods, Education Specialist.

Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.

Statewide Evaluation Cohort 7 Overview of Evaluation March 23, 2010 Mikala L. Rahn, Ph.D.

Massachusetts Department of Elementary & Secondary Education 11  What role will student feedback play in your district next year?

How do you know your product “works”? And what does it mean for a product to “work”?

Assessment of Your Program Why is it Important? What are the Key Elements?

Knowledge-Building and Instructional Practice in Georgia Reading First.

Tri City United Public Schools August 6, 2013 “Leading for educational excellence and equity. Every day for every one.”

What Does it Mean to Observe Only Observable Elements? Defining Observation for Your District for

Instructional Leadership and Application of the Standards Aligned System Act 45 Program Requirements and ITQ Content Review October 14, 2010.

Introduction to CPD Quality Assurance

Accessibility Supports Training

Implementation data will continue to be collected

Presentation transcript:

Evaluation Tools & Approaches for Engaging Stakeholders: The AREA Approach Presentation at the Canadian Evaluation Society Dr. Mariam Manley, Principal Evaluator Mid-Continent Research for Education & Learning June 1, 2003

What is the Advanced Reading Enhancement Approach (AREA)? AREA is a statewide program designed to help ensure that, by the third grade, all South Dakota students are reading and writing at grade level. The AREA project trains and mentors teachers over an entire school year and consists of the following elements:  45 hours of direct instruction to teachers  hours of administrator training  Ongoing mentoring & coaching  Provision of resources & materials  Student Assessment

Stakeholder Involvement … Do I REALLY want to do this?! External, third party Objectivity Validity Reliability Time Consensus (yikes!) Friend/Foe Useful Meaningful Ownership Cost Effective Educational

Methods of Stakeholder Involvement  Logic Model and evaluation design  Instrument development  Data collection  Design & management of data collection system  Feedback mechanisms  Reporting

DEVELOPMENT OF A PROGRAM LOGIC MODEL Resources/Inputs  Activities  Short-term  Intermediate  Long-term Impact External conditions influencing success  Understanding & “Big Picture”  Identification of outcomes  Links between activities and outcomes  Communication  Formative  Identify evaluation questions and sources of existing information  Reporting

What types of information were collected as part of the AREA evaluation?  Documentation and ongoing monitoring of program implementation  Pre and post teacher & administrator surveys  Classroom observations  Student assessment data  Site visits & interviews

INSTRUCTIONS FOR USE What is the sequence of events in using these instruments? 1. Arrange the observation session(s) with the teacher 2. Ask a pre-observation question (2 minutes or so) 3. Observe the instructional area to be focused upon 4. Conduct a post-observation interview (approximately 15 minutes) 5. Complete the observation form 6. Enter the rating form into the web-based data collection system