10+ Ways to Analyze Data Presenter: Lupe Lloyd Lupe Lloyd & Associates, Inc.

Accountability Systems State Accountability or AEIS Federal Accountability or AYP Performance-Based Monitoring Analysis System or PBMAS Data Validation (Leaver, Assessment, Discipline)

Critical Success Factors Increase Leadership Effectiveness Increase Use of Data Driven Instruction Increase Learning Time Increase Teacher Quality Increase Parent Community Involvement Improve School Climate Improve Academic Performance

Paradigm shift from intuition, tradition, or convenience… Scattered staff development / smorgasbord Budgetary decisions based on prior practice or priority programs Staff assignments based on interest and availability Reports to the community about school events Goal setting by administrators or teachers based on favorite initiatives or fads

…and other school culture cycles Staff meetings that focus on operations and dissemination of information Parent communications via twice-a-year conferences, open-houses and newsletters Grading systems based on each teacher’s criteria of completed work and participation Periodic administrator team meetings focused solely on operations

To Data-Driven Decision Making Focused staff development that addresses problems/needs identified by data Budget allocations to programs based on data- informed needs Staff assignments based on skills needed as indicated by the data Organized factual reports to the community about the learning progress of students Goal–setting based on data about problems and possible explanations

…and more… Data Driven Decision Making Staff meetings that focus on strategies and issues raised by the local school’s data Regular parent communication regarding the progress of their children with specific data Grading systems based on common criteria for student performance that reports progress on the standards as well as work skills Administrative team meetings that focus on measured progress toward data-based improvement goals

Top 10 Uses of Data in Schools 1.Data can uncover problems that might otherwise remain invisible 2.Data can convince people of the NEED for CHANGE 3.Data can confirm or discredit assumptions about students and school practices 4.Data can get to the root cause of problems, pinpoint areas where change is most needed, and guide resource allocation 5.Data can help schools evaluate program effectiveness and keep the focus on student learning results

Top 10 Uses of Data in Schools 6.Data can provide the feedback that teachers and administrators need to keep going and stay on course 7.Data can prevent over-reliance on standardized tests 8. Data can prevent one-size-fits-all and quick solutions 9.Data can give schools the ability to respond to accountability questions 10.Data can build a culture of inquiry and continuous improvement (Love, 2000)

Complexity of Student Assessment Data DAILY Formative Assessments Are the teachers asking higher order thinking questions to assess on- going learning? Are students learning it? Is there other evidence of learning taking place?

Complexity of Student Assessment Data WEEKLY Classroom Curriculum Tests, Quizzes Are we testing what was taught? Did students learn it? Is there evidence of learning?

Complexity of Student Assessment Data CURRICULUM UNITS Performance assessments Can students apply and generalize what they have learned? What evidence of cognitive learning skills do they have?

Complexity of Student Assessment Data STUDENT REPORT CARDS How are students reporting in general? Do the grading standards truly reflect their performance?

Complexity of Student Assessment Data Diagnostic Assessments What are students’ cognitive strengths and needs? How are those needs supported in the classroom?

Complexity of Student Assessment Data BENCHMARKING Are students meeting the state standards? Are we testing what is taught? Are we testing with the same rigor?

Complexity of Student Assessment Data State and National Assessments Are all students performing optimally? Are all subgroup populations performing optimally?

Factors That Affect Student Performance Individual, educational, and demographic factors Previous educational experience and success Behaviors, attitudes, & aspirations Current programs, practices, & support

An Integrated Database INTEGRATED DATA BASE DEMOGRAPHIC DATA DATA THAT SUPPORTS EQUITY, ACCOUNTABILITY, AND IMPROVEMENTS STUDENT PERFORMANCE DATA STUDENT EDUCATION DATA

Systemic Database System INTEGRATED DATA BASE Student Demographics Gender, ethnicity, disability, economic level, English proficiency, mobility, & other characteristics Performance Data State Assessment Data Standardized Test Data Performance Assessments Diagnostic assessments Classroom Assessments Grades Attendance Disciple Dropout rates Graduation rates Education Data Grade level Feeder School Prior Education Subjects/Courses Special Ed. Bilingual Ed. School-to-career Title I Unlimited Disaggregation Across: Multiple Student Characteristics Multiple Educational Factors Multiple Performance Measures

PLC Data Team for Data Driven Dialogue DATA TEAM Establishes goals Defines questions Collects and organizes data Makes meaning of data or disaggregates Communicates actions needed Evaluates actions DATA COACH Member of Data Team Communicates goals Provides Data Training Assists with data disaggregation Assists with implementation of actions Collects outcomes for evaluation

CRITICAL QUESTIONS FOR DATA COLLECTION Performance How are specific groups of students; i.e., All, African American, Hispanic, White, Economical Disadvantaged performing on state and standardized assessments in all contents? How are students, who are enrolled in different learning academies, specific course offerings, and special programs performing? What are the proficiency levels of various student groups in content and skill areas? How do the grades given to students compare to their scores on state and other standardized measures?

CRITICAL QUESTIONS FOR DATA COLLECTION Feeder System Analysis: What are the characteristics and literacy skills of the incoming ninth-grade class? How has each subgroup performed in the last three years for state assessments, attendance, and discipline trends? What is the failure rate of students by gender and ethnicity in core courses?

CRITICAL QUESTIONS FOR DATA COLLECTION ATTENDANCE What are the enrollment patterns at different grade levels? What are the characteristics of students with high absence rates? How does absence affect student performance? Are students with high attendance rates achieving success? What types of students are dropping out?

CRITICAL QUESTIONS FOR DATA COLLECTION CURRICULUM Is the curriculum vertically and horizontally aligned to the TEKS. Is the scope and sequence aligned to the testing schedule? Are teachers teaching the TEKS to be assessed with Student Expectations and rigor? In the areas of low performance such as reading and math, what strengths and weaknesses are in the curriculum?

CRITICAL QUESTIONS FOR DATA COLLECTION INSTRUCTIONAL PROGRAM Do grading patterns suggest inconsistencies in grading criteria across learning academies, subject areas, or course offerings? Are students who are enrolled in specific programs achieving positive results on different measures? Are specific groups of students enrolling in specific courses? What is the failure rate of students by gender and by ethnicity in core courses? How is SES or other interventions showing improvement?

CRITICAL QUESTIONS FOR DATA COLLECTION DROPOUTS What is impacting the completion, graduation, and dropout rates? What are the characteristics of these students? By subgroup, what programs have they participated in that have not resulted in graduation? How many overage students are in need of credit recovery?

Data Driven Dialogue

The Inquiry Cycle Establish S.M.A.R.T. Goals Define the Questions Collect and Organize Data Make Meaning of Data Take Action! Evaluate And Assess Actions

Create a Data Room with Data Walls

Contact Information LUPE LLOYD National Educational Consultant Lupe Lloyd & Associates, Inc. Data and Instructional Coach Specialist in Bilingual/ESL support Professional Service Provider (210)