ELEMENTARY SCIENCE LIAISONS ICAD 5: DATA ANALYSIS (February 23 – February 26, 2015) Next Generation Sunshine State Standards For Science with Integration of English Language Arts Literacy and Mathematics Common Core State Standards Department of Mathematics and Science Office of Academics and Transformation Millard Lightburn, Ph.D. Supervisor Mary Tweedy, Noreyda Casanas, Daniel Gangeri, Curriculum Support Specialists

Session Outcomes Participants will be able to: –Understand how to analyze and interpret Interim data. –Develop an action plan to support remediation of secondary benchmarks. Department of Mathematics and Science

What Kind of Information can Data Provide us? Data can… provide feedback on the past and provide a basis to begin planning for the future Department of Mathematics and Science

Importance of Data We live in a data driven society. Data is used to make decisions at all levels of government and businesses. Education is no exception. We are in the business of educating our future leaders. In education, we need to be able to disaggregate assessment data at the level where we can make a difference in a child’s life. We should be able to say that John Doe needs help in understanding “Properties of Minerals”. Department of Mathematics and Science

Florida Continuous Improvement Model Department of Mathematics and Science

Data Analysis Grade 5 Science Winter IA results QSBA-Q2 Benchmark Assessment for K-4 Department of Mathematics and Science

Quarter 2 Science Benchmarks assessment results K-4 ( ) GRADE LEVELNUMBER OF STUDENTSSATISFACTORY GRADE 45,656 (22% of 25,511)52% GRADE 36,217 (22% of 28,355)56% GRADE 26,050 (22% of 27,437)92% GRADE 15,458 (20% of 27,197)73% Kindergarten5,057 (20% of 25,154)97% Department of Mathematics and Science

Grade 4 QSBA Q2 Results (2014) BENCHMARKS AVERAGE % CORRECT SC.4.P % SC.4P % SC.4.P % SC.4.P % SC.4.P % SC.4.P % SC.4.P % SC.4.P % Department of Mathematics and Science Number of Students Tested: 5435 Average % Correct: 61%

Grade 5 Science Proficiency for Winter IA 2013, 2014 & 2015 (District) INTERIMNUMBER OF STUDENTS Average Correct SatisfactoryLimitedInsufficient Winter ,69254% 10%36% Winter ,70655% 56% FCAT 51% 10%34% Winter IA ,786 53%52% FCAT 51% 11%37% Department of Mathematics and Science

GRADE 5 SCIENCE INTERIMS RESULTS (DISTRICT) Assessment Enroll- ment % Tested % Satisfactory OverallNature of Science Earth and Space Science Physical ScienceLife Science Avg. % Correct Pts. Max Avg.% Correct Pts. Max Avg.% Correct Pts. Max Avg.% Correct Pts. Max Avg.% Correct Pts. Max FCAT 2015 MYA (Winter IA)25,40389%54% 6850%957%2053%2453%15 Fall IA25,26637%48%51%6743%946%2056%2455%14 Baseline25,25889%NA48%6638%845%1954%2447%15 FCAT ,703100%51%NA5670%1069%1669%1664%14 Department of Mathematics and Science The MYA enrollment reflected above is as of Feb. 13, 2015 (Fall IA is on Nov. 26, 2014 and Baseline is on Sept. 12, 2014). It excludes students with Florida Alternative Assessment (FAA). The MYA science data were downloaded from Thinkgate on February 19, The % satisfactory indicates the predictive value of the % of students would earn achievement levels 3-5 on the 2015 FCAT2.0. Score is not reported if the number of students tested is less than 10. Average % Correct of less than 51 are denoted in red. The Fall IA was optional for schools. Source: Dr. Wongbundhit, Yuwadee

Regression Analysis of Winter Interim results vs FCAT scale score Grade 5 Science Winter Interim results (X) FCAT Scale Score (Y) Department of Mathematics and Science

Winter Interim Cut Scores Grade 5 Science Satisfactory: Raw score (36-68) (53% or higher) Limited: Raw score (33-35) (49-51%) Limited: Raw score (33-35) (49-51%) Insufficient: Raw score (0-32) (0 – 47%)

STUDENT ASSESSMENT RESULTS BY CLASS Department of Mathematics and Science Click on score as indicated below. It will open a pop up screen with Report Selection shown below. (Details on next slide)

REPORT SELECTION: OPTION 3 (Available Reports) Administered Test Not Taken students At Risks Distractor Analysis Item Analysis Mastery Proficiency Report Progress Report Department of Mathematics and Science Report Card by Students Score Analysis Report Standard Analysis Subgroups by Standards Test Summary

REPORT SELECTION: AT RISK (various reports are available) Students by Standard report provides list of standards that are of concern and lists students who had low performance on each standard.. It is a great tool for intervention and differentiated instruction Department of Mathematics and Science Students

REPORT SELECTION: Distractor Analysis: Has option to hide some selection criteria (see row 1). You can organize incorrect answers by grouping them (row 2) (Incorrect answers in red) Department of Mathematics and Science

ITEM ANALYSIS REPORT : Compares class performance to school and district performance Department of Mathematics and Science

To view Progress Report that shows performance by benchmark from Fall IA to Winter IA, click on notepad Department of Mathematics and Science

Progress report by standards from Fall to Winter IA Department of Mathematics and Science

Progress Report by Standard export to Excel Department of Mathematics and Science

Excel unedited Progress Report file imported from Thinkgate Participants will be able to: –Access science instructional resources to support science teaching and learning –Identify effective science teaching and learning –Develop an action plan to support science teaching and learning Department of Mathematics and Science

On excel spreadsheet we increased the width of each column and added a title. Participants will be able to: –Access science instructional resources to support science teaching and learning –Identify effective science teaching and learning –Develop an action plan to support science teaching and learning Department of Mathematics and Science

Grade 5 Science Baseline to Winter IA results by Standards

Grade 5 Science Baseline to Winter IA results by Standards (Cont….)

Comparison Gr 5 Science Performance by Benchmark FIA & WIA (2014) BENCHMARKSBENCHMARKS by QUARTER BASELINE 2014 Winter IA 2015 DIFF % (WIA - Base) NGSSS.SCI.3.SC.3.L.14.1Q3 (Plants Structures & Function)37%46%9% NGSSS.SCI.4.SC.4.E.5.4Q2 (Movement in space)44%55%11% NGSSS.SCI.4.SC.4.E.6.2Q2 (Minerals and Rocks)33%57%24% NGSSS.SCI.4.SC.4.E.6.3Q2 (Earth Resources)51%48%-3% NGSSS.SCI.4.SC.4.E.6.4Q2 (Weathering and Erosion)42%63%21% NGSSS.SCI.4.SC.4.L.16.4Q3 (Life Cycles)46%63%17% NGSSS.SCI.4.SC.4.L.17.3Q3 (Food Chain)52%43%-9% NGSSS.SCI.5.SC.5.E.5.1Q2 (Our Galaxies)59%36%-23% NGSSS.SCI.5.SC.5.E.5.3Q2 (Our Solar System)56%64%9% NGSSS.SCI.5.SC.5.E.7.1Q3 (Water Cycle)37%56%19% NGSSS.SCI.5.SC.5.E.7.3Q3 (Weather)40%76%36% NGSSS.SCI.5.SC.5.L.14.1Q4 (Human Body Organs)54%52%-2% NGSSS.SCI.5.SC.5.L.14.2Q3 (Comparing Plants and Animals Organ Function)44%60%16% NGSSS.SCI.5.SC.5.L.17.1Q3 (Animal Adaptations)47%52%5% NGSSS.SCI.5.SC.5.N.1.1ALL (Practice of Science: Process skills, variables)32%35%3% NGSSS.SCI.5.SC.5.N.2.1ALL Qts (Observations linked to evidence)35%65%30% NGSSS.SCI.5.SC.5.N.2.2ALL Qts (Evidences produced should be replicated)50%49%-1% NGSSS.SCI.5.SC.5.P.10.1Q2 (Forms of Energy)80%51%29% NGSSS.SCI.5.SC.5.P.10.2Q2 (Energy can casue motion or create change)49%62%13% NGSSS.SCI.5.SC.5.P.10.4Q2 (Electrical energy can be transformed)48%57%9% NGSSS.SCI.5.SC.5.P.13.1Q1 (Forces)51%54%3% NGSSS.SCI.5.SC.5.P.13.2Q1 (Forces that move objects)48%38%-10% NGSSS.SCI.5.SC.5.P.8.1Q1 (Properties of Solids, Liquid and Gases)57%48%-9% NGSSS.SCI.5.SC.5.P.8.3Q1 (Mixtures of solids can be separated)54%59%5% NGSSS.SCI.5.SC.5.P.9.1Q1 (Physical and Chemical Changes)46%55%9% Department of Mathematics and Science

Analyze 2015 Winter Interim  Analyze changes by benchmarks  Use the teacher debriefing protocol to analyze your class or school datateacher debriefing protocol  Use the grade level debriefing protocol to compare your class performance to overall school performance.grade level debriefing protocol Department of Mathematics and Science

DISTRICT 2015 WINTER IA RESULTS FOR Gr 5, Gr 8 and Biology GRADE LEVEL SATISFACTORY LEVEL (%) ON 2015 WINTER INTERIM GRADE 554% GRADE 839% BIOLOGY60% Department of Mathematics and Science

Sample Data Chats form Student Name and ID ___________________ Math FCAT: Achievement Level and DSS_______ Reading FCAT: Achievement Level and DSS ____ Science Assessment data: Baseline: _____ Monthly ____ Fall Interim ___ Winter Interim ______ Post-Baseline_______ Student Goals:___________________________ Teacher Comment__________________ Data Chats Department of Mathematics and Science

Action Plan Develop an action for Grade 5 Science Winter IA: 1. List strongest benchmarks (50%+) 2. List weakest benchmarks (<50%) 3. Identify number of students: Satisfactory, Limited (Bubble) and Insufficient Progress 3. Develop a plan to address secondary benchmarks, including how you will group your students. 4. Develop an Instructional Plan to implement during crunch time to address all deficient benchmarks. Department of Mathematics and Science

Percentage Points by Complexity Level for Grade 5 and 8 Science FCAT

EXAMPLE OF SCIENCE ACTIVITIES ACROSS COGNITIVE COMPLEXITY LEVELS Department of Mathematics and Science

Sample Low Complexity Question Department of Mathematics and Science Source: FCAT 2.0 Item Specs

Sample Moderate Complexity Question Department of Mathematics and Science Source: FCAT 2.0 Item Specs

High Complexity Question Department of Mathematics and Science Source: FCAT 2.0 Item Specs

Bchmrks Content Focus for FCAT 2014) Reporting Category 1. Nature of Science SC.5.N.1.1Analyzing data; Collecting and organizing data; Defining a testable problem; Evaluating a 346 SC.5.N.2.1Identifying empirical evidence; Importance of observations 433 SC.5.N.2.2Importance of replication331 Reporting Category Point Total10 Reporting Category 2. Earth and Space Science SC.4.E.5.4Appearance of stars; Appearance of the Moon; Earth's revolution 233 SC.4.E.6.2Mineral properties—cleavage; Mineral properties—color112 SC.4.E.6.3Natural resources—phosphate13 SC.4.E.6.4Erosion—wind; Weathering—water11 SC.5.E.5.1Star brightness14 SC.5.E.5.3Distinguishing between asteroids and comets; Distinguishing between inner and outer planets 22 SC.5.E.7.1Water cycle—states of matter41 SC.5.E.7.3Climate zone—temperate; Weather—precipitation41 Reporting Category Point Total16

BchmrksContent Focus for FCAT Reporting Category 3. Physical Science SC.5.P.8.1Comparing objects—physical properties; Physical properties—liquids 312 SC.5.P.8.3Separating mixtures—particle size211 SC.5.P.9.1Chemical change—temperature; Identifying chemical change 112 SC.5.P.10.1Light and heat relationships; Pitch342 SC.5.P.10.2Energy causing a change121 SC.5.P.10.4Conductors—electric; Electric circuits; Heat flow333 SC.5.P.13.1Forces—friction; Forces—magnetic222 SC.5.P.13.2Balanced forces; Force, mass, and motion relationships; Speed 123 Reporting Category Point Total16

FCAT 2.0 Content Focus Analysis cont’d… BchmrksContent Focus Reporting Category 4. Life Science SC.3.L.14.1Plant structures—leaves; Plants responding to gravity; Seed dispersal343 SC.4.L.16.4Comparing insect life cycles111 SC.4.L.17.3Energy flow through a food chain122 SC.5.L.14.1Organ functions—bladder; Organ functions—sensory organs112 SC.5.L.14.2Animal classification—vertebrates; Comparing plant and animal structures 452 SC.5.L.17.1Behavioral adaptations; Impact on the environment—animals; Physical adaptations—animals 314 Reporting Category Point Total1614 The Next Generation Sunshine State Standards (NGSSS) benchmarks and content foci assessed on the 2014 FCAT 2.0 assessment are not predictive of future FCAT 2.0 content. Content Focus Reports should not be used to make decisions about instruction at the individual student level

FCAT PLEDGE Department of Mathematics and Science Share the FCAT Pledge with your students. I WILL