Tarrence McGovern Team Leader South Carolina Department of Education Office of Exceptional Children Heather Grohn SC Gateways Project Evaluator University of South Carolina Office of Program Evaluation SC Gateways Project Technology

Agenda  SC Gateways Data Collection Tools Needs Assessment: 20-Minute Target Survey (University of Kansas) Data Presentation Walkthrough CHAMPS Fidelity Rubric Daily Activity Log for Coaches

SC Gateways Project Focus  Professional development for teachers, both general education and special education.  Tier 1 (6) and Tier 2(10) sites  Also offering free statewide trainings

Data Collection Needs  Needs Assessment: every classroom, every school needed to be observed. Then repeat, repeat, repeat…  Technology was needed to manage this effort with only 3 staff members. ** collecting school-level data right now but later, teacher-level, non-evaluative (formative) data

Developing “Our” Tool: From Paper to App

Product Research and the Process of Selection  Scanned the market  Reviewed the functionality of various products  Had producers attempt to create a tool in an automated fashion

The Needs  Needed a customized tool for our purposes: Timers Tallies Notes area Headcounts Ease of use and immediate feedback to teachers for later use in coaching relationship  Unobtrusive observation—no netbook or laptop needed. Be able to use iPod, iPad or smart phone.

The App and the Need for Accessibility  Data uploads to the secure server and can be downloaded to Excel  Web version is also accessible from a laptop or desktop  Smart phone access  SC Gateways is using grant-funded iPads

Instructional Activities Recording  Continuous time clock to record specific activities up to 20 minutes A timer starts when the first activity is chosen. A reminder flashes for data collection at the 10-minute mark.

Instructional Activities Tracking individual questions Ratio of Interaction Time on Task at 10 Minutes Time on Task at 20 Minutes

Content Plan  Checklist items on teacher behavior  Completed following the 20- minute observation

Assessment for Learning  Data on the use of assessment  Teacher use  Student participation Also… Expectations Respect (Qualitative)

Closing Remarks Additional Comments “Submit” sends the observation to the server if connected Teacher can be ed a copy with notes

Submission Features Submission Features  Users can: Upload to the secure server Send reports directly to teachers Log on to website to generate customized reports Create charts Obtain the raw data

Getting to the Data  There are 6 simple steps to access and display data  Data is available at: Classroom Level School Level

1. Access the Classroommosaic.com Login Screen

2. Access the Data Tool

3. Select the data to chart from the slides

4. Select the site or teacher data to chart

5. Select: CREATE

6. Choose the Chart Type:  3 Options: Bar Pie Stacked

Additional Tools for SC Gateways  PD program fidelity checklists  Daily Activity Log for Coaches

CHAMPS Fidelity  Classrooms will be measured quarterly  SC Gateways coaches will monitor classroom level data based on the focus of the instructional coaching  Scores are based on the average of 9 fidelity subscales

CHAMPS Fidelity Tool Guidelines for Success (GFS)

Project Staff Daily Activity Log Tool  Tool Includes Date Goals Objectives Notes Follow-up/Next Action Steps

Daily Activity Log Tool

Additional Tools Under Development  Fidelity Checklists  Tools for observing coaches and providing feedback

For More Information  Please visit the SC Team to demo our product  Contact  Susan Beck, SC Gateways Project,  Tyler Smith, Classroom Mosaic,