C R E S S T / U C L A 1 UCLA Graduate School of Education & Information Studies Center for the Study of Evaluation (CSE) National Center for Research on.

Slides:

Advertisements

Similar presentations

Teachers, administrators and staff continuously seek and share learning and then act on what they learn. The goal of their actions is to enhance their.

Advertisements

Monitoring and Evaluation of ICT Use in Rural Schools Ok-choon Park Global Symposium on ICT in Education – Measuring Impact: Monitoring and Evaluation.

An advanced testing, recording, and evaluation tool for online training and performance evaluation. RoboTutor Software, 8980 Cheshire Drive, Sandy, Utah.

Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.

PD Plan Agenda August 26, 2008 PBTE Indicators Track

North Carolina Educator Evaluation System. Future-Ready Students For the 21st Century The guiding mission of the North Carolina State Board of Education.

Individual Learning Plan for Kentucky. Background: Data Integration State-wide unique student identifiers are used to link information from a number of.

Alabama Professional Education Personnel Evaluation Program Administrator Systems August 2002.

Presentation Overview What is QSP? Functions and Features of QSP QSP and NCLB Local Level Decision-Making Technical Requirements QSP Rollout.

Applying Psychology to Teaching

TEACHER EVALUATION IN NEW JERSEY: PREVIEW OF FINAL REPORT RUTGERS GRADUATE SCHOOL OF EDUCATION.

Kotler / Armstrong, Chapter 4

Enter System Name AdvancED TM External Review Exit Report Catalyst High School May 11,12,13, 2014.

Volunteer Recognition Honoring and recognizing individuals for their unique contribution to educational program efforts Honoring and recognizing individuals.

Knowledge is Power Marketing Information System (MIS) determines what information managers need and then gathers, sorts, analyzes, stores, and distributes.

E-Program Portfolio Let’s Begin Department of Reading and Language Arts Program Portfolio Central Connecticut State University Name: Date Submitted: Program.

Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.

Presented by Margaret Shandorf

© 2004 The McGraw-Hill Companies. All rights reserved. Chapter 13 Planning the Literature Program.

Title I Needs Assessment/ Program Evaluation Title I Technical Assistance & Networking Session October 5, 2010.

Accountability Assessment Parents & Community Preparing College, Career, & Culturally Ready Graduates Standards Support 1.

TEKS & Activities Desktop Publishing.

Milwaukee Digital Inclusion Program Draft: January 26, 2007, Milwaukee Department of Administration.

Teaching and Learning with Technology  Allyn and Bacon 2002 Administrative Software Chapter 5 Teaching and Learning with Technology.

1. An Overview of the Data Analysis and Probability Standard for School Mathematics? 2.

Data Analysis for Evaluation Eric Graig, Ph.D.. Slide 2 Innovation Network, Inc. Purpose of this Training To increase your skills in analysis and interpretation.

1.Knowledge management 2.Online analytical processing 3. 4.Supply chain management 5.Data mining Which of the following is not a major application.

Evaluation Process/Requirements for CAPP Algebra Project.

Chapter 3: Marketing Intelligence Copyright © 2010 Pearson Education Canada1.

DE&T (QuickVic) Reporting Software Overview Term

Assessment Cycle California Lutheran University Deans’ Council February 6, 2006.

1/36 CRESST/UCLA QSP Margaret Heritage CRESST/UCLA July 18, 2003 The Quality School Portfolio.

Reflect and Revise: Evaluative Thinking for Program Success Tom DeCaigny and Leah Goldstein Moses.

Getting Started with the State Pre-Planning Process.

Approaches to Measuring Child Outcomes Kathy Hebbeler ECO at SRI International Prepared for the NECTAC National Meeting on Measuring Child and Family Outcomes,

Jasmine Carey CDE Psychometrician Interpreting Science and Social Studies Assessment Results September 2014.

Administrative Software Chapter 7 Teaching and Learning with Technology.

Chapter 6-Evaluating 3 S Education James and Kelly McVey.

Observation technique and assessment measurements 1.

Key System Features and Next Steps. Features: Computer Adaptive Testing Adaptive assessment provides measurement across the breadth of the Common Core.

CRESST’s Evaluation of the Artful Learning Program: “Findings,” Contexts, and Future Explorations Noelle Griffin,Ph.D UCLA Graduate School of Education.

External Review Exit Report Springfield Platteview Community Schools March 2-4, 2015.

Field Test of Counselor System July 2000 Alabama Professional Education Personnel Evaluation Program.

Drake 274.  Interests and Preferences for Postsecondary Expectations  Definition: Interests are those things/activities that evoke curiosity and preferences.

Building and Recognizing Quality School Systems DISTRICT ACCREDITATION © 2010 AdvancED.

Jackson County Public Schools Technology Plan Kimberly Body and Elizabeth Perin Liberty University Education 639.

Senior Capstone Experience Framework A Guide for South Dakota Schools.

Evaluation of the Noyce Teacher Scholarship Program 2010 NSF Noyce Conference Abt Associates Inc. July 9, 2010.

Writing Policy for SBDM Councils. Goals of this Session provide an overview of Senate Bill 1 requirements related to writing provide guidance in reviewing.

Quality Assurance Review Team Oral Exit Report School Accreditation AUTEC School 4-8 March 2012.

Literacy Partner 2007 – 2008 The literacy partner supports student learning by collaborating with teachers and administrators to model best practices and.

Copyright © 2014 by Educational Testing Service. All rights reserved. Influencing Education: Implementing Online Reporting Systems to Support Assessment.

Alabama Professional Education Personnel Evaluation Program Field Test of Assistant Principal System July 2000.

COMPONENT THREE MONITORING LEARNING PROGRESS WHAT IS THE SCHOOL’S ASSESSMENT PLAN? HOW IS THE ASSESSMENT DATA ANALYZED AND KNOWN? HOW DID THE RESULTS IMPACT.

1 Science, Learning, and Assessment: (Eats, Shoots, and Leaves) Choices for Comprehensive Assessment Design Eva L. Baker UCLA Graduate School of Education.

Primary Planning Seminar Monday 9 th June. Primary Planning Seminar Woodside School - Planning What have we done so far? Action :Working Party established.

Wisconsin Administrative Code PI 34 1 Wisconsin Department of Public Instruction - Elizabeth Burmaster, State Superintendent Support from a Professional.

The Digital Portfolio Add samples of student work directly from the Gradebook into the Digital Portfolio Keep track of several different formats: Written.

Building an Interim Assessment System: A Workbook for School Districts CCSSO National Conference on Student Assessment Detroit, MI June 22, 2010.

 Located in Jonesboro, AR  Grades 1-6  58 Staff Members (24 Core-Curriculum classroom teachers)  597 Students.

Summer Series, 2007 Building Capacity to Make Research-Based Practice Common Practice In Georgia Utilizing the Keys to Quality.

Background CPRE brings together education experts from renowned research institutions to contribute new knowledge that informs K- 16 education policy &

Long Range Technology Plan, Student Device Standards Secondary Device Recommendation.

BLOOMFIELD PUBLIC SCHOOLS B Learning and Growing Together Climate and Satisfaction Survey Results Dr. James Thompson, Superintendent Dr. Ellen J. Stoltz,

Note: In 2009, this survey replaced the NCA/Baldrige Quality Standards Assessment that was administered from Also, 2010 was the first time.

Outcomes By the end of our sessions, participants will have…  an understanding of how VAL-ED is used as a data point in developing professional development.

EPearl: Electronic Portfolio Encouraging Active Reflective Learning - POP Presentation (Jan. 12, 2007)

Interpreting Science and Social Studies Assessment Results

Smarter Balanced Assessments: What do families need to know?

Hispanic Bilingual Gifted Screening Instrument

Presentation transcript:

C R E S S T / U C L A 1 UCLA Graduate School of Education & Information Studies Center for the Study of Evaluation (CSE) National Center for Research on Evaluation, Standards, and Student Testing (CRESST) John J. Lee Senior Researcher Quality School Portfolio Decision Support System: Transforming Data into Information

C R E S S T / U C L A 2 The Quality School Portfolio (QSP) è Without tools to investigate and understand results, more testing will not impact educational practice è Software for use by educators to organize, collect, interpret, and respond to complex data è UCLA, OERI, Stuart, and Joyce Foundation support

C R E S S T / U C L A 3 QSP—Making Use of Testing and Other Information Data Manager Resource Kit

C R E S S T / U C L A 4 QSP Goals è Transform test and other results into usable, actionable form è Create coherent information structure for all members of the educational community (policymakers, administrators, teachers, and parents) è Encourage using information as the basis for making decisions about educational options and services è Raise capacity and efficacy of educators è Communicate findings in intuitive displays

C R E S S T / U C L A 5 Learning to Use Results: QSP Features è Relies on external and internal sources of information è Easy access and display è Custom queries è Disaggregation è Report preparation

C R E S S T / U C L A 6 Applying QSP è Use for school monitoring and improvement è For distance learning assessment reporting è For distributed program evaluation (LA’s BEST; Artful Learning) è Disaggregation è Individual longitudinal records

C R E S S T / U C L A 7 How can the school focus on particular populations? System Groups Custom Groups Combo Groups Disaggregation

C R E S S T / U C L A 8 Conditional Disaggregation: Eight Filters è Hispanic + è Boys + è 9 th Grade + è Spanish L1 + è Redesignated English è Magnet schools + è GPA below è Less than 2 years in the school

C R E S S T / U C L A 9 Gauge Display

C R E S S T / U C L A 10 Scatterplot

C R E S S T / U C L A 11 Quick School Comparisons

C R E S S T / U C L A 12 School Performance Reports

C R E S S T / U C L A 13 Resource Kit Menu

C R E S S T / U C L A 14 Resource Kit Functions è Clustered topics of resources è Selection or modification of instruments in a cluster given a description è Supports Acrobat Reader and Rich Text Formats è Customized entry of standard surveys, etc., to permit local use of evaluation data and simultaneous export of information to centralized sources

C R E S S T / U C L A 15 QSP Resource Kit è Local data to answer local questions è Staff and student surveys, interview and observation protocols è Data entry mechanisms, e.g., student work— in process (digital portfolios) è Online assessments or surveys è Transfer into Data Manager

C R E S S T / U C L A 16 Resource Kit Summary Page

C R E S S T / U C L A 17 Extensions è QSP Web (currently in development) è Data analysis from descriptive to growth projection è Flexible report wizard è Improved Web training component

C R E S S T / U C L A 18 User Challenges è Learning to ask productive questions è Looking at measures over time è Level of technical sophistication, e.g., hierarchical models, trajectories è Reports appropriate to various audiences and stakeholders

C R E S S T / U C L A 19 Continuing Research: A Sample of Impact Questions è Who is helped? What kinds of schools, teachers, and students? How do experience, beliefs, knowledge condition impact? è Do administrative practices change at school, district and board levels? è What happens in classrooms? Is student growth affected? For how long? What kind of combination of information is needed (CRT/NRT, process)?