1. ELEMENTARY SCIENCE LIAISONS ICAD 5: DATA ANALYSIS (February 23 – February 26, 2015) Next Generation Sunshine State Standards For Science with Integration of English Language Arts Literacy and Mathematics Common Core State Standards Department of Mathematics and Science Office of Academics and Transformation Millard Lightburn, Ph.D. Supervisor Mary Tweedy, Noreyda Casanas, Daniel Gangeri, Curriculum Support Specialists

2. Session Outcomes Participants will be able to: –Understand how to analyze and interpret Interim data. –Develop an action plan to support remediation of secondary benchmarks. Department of Mathematics and Science

3. What Kind of Information can Data Provide us? Data can… provide feedback on the past and provide a basis to begin planning for the future Department of Mathematics and Science

4. Importance of Data We live in a data driven society. Data is used to make decisions at all levels of government and businesses. Education is no exception. We are in the business of educating our future leaders. In education, we need to be able to disaggregate assessment data at the level where we can make a difference in a child’s life. We should be able to say that John Doe needs help in understanding “Properties of Minerals”. Department of Mathematics and Science

5. Florida Continuous Improvement Model Department of Mathematics and Science

6. Data Analysis Grade 5 Science 2014-15 Winter IA results QSBA-Q2 Benchmark Assessment for K-4 Department of Mathematics and Science

7. Quarter 2 Science Benchmarks assessment results K-4 (2014-15) GRADE LEVELNUMBER OF STUDENTSSATISFACTORY GRADE 45,656 (22% of 25,511)52% GRADE 36,217 (22% of 28,355)56% GRADE 26,050 (22% of 27,437)92% GRADE 15,458 (20% of 27,197)73% Kindergarten5,057 (20% of 25,154)97% Department of Mathematics and Science

8. Grade 4 QSBA Q2 Results (2014) BENCHMARKS AVERAGE % CORRECT SC.4.P.10.173 % SC.4P.10.253% SC.4.P.10.360% SC.4.P.10.474% SC.4.P.11.161% SC.4.P.11.241% SC.4.P.12.163% SC.4.P.12.256% Department of Mathematics and Science Number of Students Tested: 5435 Average % Correct: 61%

9. Grade 5 Science Proficiency for Winter IA 2013, 2014 & 2015 (District) INTERIMNUMBER OF STUDENTS Average Correct SatisfactoryLimitedInsufficient Winter 2015 22,69254% 10%36% Winter 2014 22,70655% 56% FCAT 51% 10%34% Winter IA 2013 21,786 53%52% FCAT 51% 11%37% Department of Mathematics and Science

10. GRADE 5 SCIENCE INTERIMS RESULTS 2014-15 (DISTRICT) Assessment Enroll- ment % Tested % Satisfactory OverallNature of Science Earth and Space Science Physical ScienceLife Science Avg. % Correct Pts. Max Avg.% Correct Pts. Max Avg.% Correct Pts. Max Avg.% Correct Pts. Max Avg.% Correct Pts. Max FCAT 2015 MYA (Winter IA)25,40389%54% 6850%957%2053%2453%15 Fall IA25,26637%48%51%6743%946%2056%2455%14 Baseline25,25889%NA48%6638%845%1954%2447%15 FCAT 201425,703100%51%NA5670%1069%1669%1664%14 Department of Mathematics and Science The MYA enrollment reflected above is as of Feb. 13, 2015 (Fall IA is on Nov. 26, 2014 and Baseline is on Sept. 12, 2014). It excludes students with Florida Alternative Assessment (FAA). The MYA science data were downloaded from Thinkgate on February 19, 2015. The % satisfactory indicates the predictive value of the % of students would earn achievement levels 3-5 on the 2015 FCAT2.0. Score is not reported if the number of students tested is less than 10. Average % Correct of less than 51 are denoted in red. The Fall IA was optional for schools. Source: Dr. Wongbundhit, Yuwadee

11. Regression Analysis of Winter Interim results vs FCAT scale score Grade 5 Science Winter Interim results (X) FCAT Scale Score (Y) Department of Mathematics and Science

12. Winter Interim Cut Scores Grade 5 Science Satisfactory: Raw score (36-68) (53% or higher) Limited: Raw score (33-35) (49-51%) Limited: Raw score (33-35) (49-51%) Insufficient: Raw score (0-32) (0 – 47%)

13. STUDENT ASSESSMENT RESULTS BY CLASS Department of Mathematics and Science Click on score as indicated below. It will open a pop up screen with Report Selection shown below. (Details on next slide)

14. REPORT SELECTION: OPTION 3 (Available Reports) Administered Test Not Taken students At Risks Distractor Analysis Item Analysis Mastery Proficiency Report Progress Report Department of Mathematics and Science Report Card by Students Score Analysis Report Standard Analysis Subgroups by Standards Test Summary

15. REPORT SELECTION: AT RISK (various reports are available) Students by Standard report provides list of standards that are of concern and lists students who had low performance on each standard.. It is a great tool for intervention and differentiated instruction Department of Mathematics and Science Students

16. REPORT SELECTION: Distractor Analysis: Has option to hide some selection criteria (see row 1). You can organize incorrect answers by grouping them (row 2) (Incorrect answers in red) Department of Mathematics and Science

17. ITEM ANALYSIS REPORT : Compares class performance to school and district performance Department of Mathematics and Science

18. To view Progress Report that shows performance by benchmark from Fall IA to Winter IA, click on notepad Department of Mathematics and Science

19. Progress report by standards from Fall to Winter IA Department of Mathematics and Science

20. Progress Report by Standard export to Excel Department of Mathematics and Science

21. Excel unedited Progress Report file imported from Thinkgate Participants will be able to: –Access science instructional resources to support science teaching and learning –Identify effective science teaching and learning –Develop an action plan to support science teaching and learning Department of Mathematics and Science

22. On excel spreadsheet we increased the width of each column and added a title. Participants will be able to: –Access science instructional resources to support science teaching and learning –Identify effective science teaching and learning –Develop an action plan to support science teaching and learning Department of Mathematics and Science

23. Grade 5 Science Baseline to Winter IA results by Standards 2014-2015

24. Grade 5 Science Baseline to Winter IA results by Standards 2014-2015 (Cont….)

25. Comparison Gr 5 Science Performance by Benchmark FIA & WIA (2014) BENCHMARKSBENCHMARKS by QUARTER BASELINE 2014 Winter IA 2015 DIFF % (WIA - Base) NGSSS.SCI.3.SC.3.L.14.1Q3 (Plants Structures & Function)37%46%9% NGSSS.SCI.4.SC.4.E.5.4Q2 (Movement in space)44%55%11% NGSSS.SCI.4.SC.4.E.6.2Q2 (Minerals and Rocks)33%57%24% NGSSS.SCI.4.SC.4.E.6.3Q2 (Earth Resources)51%48%-3% NGSSS.SCI.4.SC.4.E.6.4Q2 (Weathering and Erosion)42%63%21% NGSSS.SCI.4.SC.4.L.16.4Q3 (Life Cycles)46%63%17% NGSSS.SCI.4.SC.4.L.17.3Q3 (Food Chain)52%43%-9% NGSSS.SCI.5.SC.5.E.5.1Q2 (Our Galaxies)59%36%-23% NGSSS.SCI.5.SC.5.E.5.3Q2 (Our Solar System)56%64%9% NGSSS.SCI.5.SC.5.E.7.1Q3 (Water Cycle)37%56%19% NGSSS.SCI.5.SC.5.E.7.3Q3 (Weather)40%76%36% NGSSS.SCI.5.SC.5.L.14.1Q4 (Human Body Organs)54%52%-2% NGSSS.SCI.5.SC.5.L.14.2Q3 (Comparing Plants and Animals Organ Function)44%60%16% NGSSS.SCI.5.SC.5.L.17.1Q3 (Animal Adaptations)47%52%5% NGSSS.SCI.5.SC.5.N.1.1ALL (Practice of Science: Process skills, variables)32%35%3% NGSSS.SCI.5.SC.5.N.2.1ALL Qts (Observations linked to evidence)35%65%30% NGSSS.SCI.5.SC.5.N.2.2ALL Qts (Evidences produced should be replicated)50%49%-1% NGSSS.SCI.5.SC.5.P.10.1Q2 (Forms of Energy)80%51%29% NGSSS.SCI.5.SC.5.P.10.2Q2 (Energy can casue motion or create change)49%62%13% NGSSS.SCI.5.SC.5.P.10.4Q2 (Electrical energy can be transformed)48%57%9% NGSSS.SCI.5.SC.5.P.13.1Q1 (Forces)51%54%3% NGSSS.SCI.5.SC.5.P.13.2Q1 (Forces that move objects)48%38%-10% NGSSS.SCI.5.SC.5.P.8.1Q1 (Properties of Solids, Liquid and Gases)57%48%-9% NGSSS.SCI.5.SC.5.P.8.3Q1 (Mixtures of solids can be separated)54%59%5% NGSSS.SCI.5.SC.5.P.9.1Q1 (Physical and Chemical Changes)46%55%9% Department of Mathematics and Science

26. Analyze 2015 Winter Interim  Analyze changes by benchmarks  Use the teacher debriefing protocol to analyze your class or school datateacher debriefing protocol  Use the grade level debriefing protocol to compare your class performance to overall school performance.grade level debriefing protocol Department of Mathematics and Science

27. DISTRICT 2015 WINTER IA RESULTS FOR Gr 5, Gr 8 and Biology GRADE LEVEL SATISFACTORY LEVEL (%) ON 2015 WINTER INTERIM GRADE 554% GRADE 839% BIOLOGY60% Department of Mathematics and Science

28. Sample Data Chats form Student Name and ID ___________________ Math FCAT: Achievement Level and DSS_______ Reading FCAT: Achievement Level and DSS ____ Science Assessment data: Baseline: _____ Monthly ____ Fall Interim ___ Winter Interim ______ Post-Baseline_______ Student Goals:___________________________ Teacher Comment__________________ Data Chats Department of Mathematics and Science

29. Action Plan Develop an action for Grade 5 Science Winter IA: 1. List strongest benchmarks (50%+) 2. List weakest benchmarks (<50%) 3. Identify number of students: Satisfactory, Limited (Bubble) and Insufficient Progress 3. Develop a plan to address secondary benchmarks, including how you will group your students. 4. Develop an Instructional Plan to implement during crunch time to address all deficient benchmarks. Department of Mathematics and Science

30. Percentage Points by Complexity Level for Grade 5 and 8 Science FCAT

31. EXAMPLE OF SCIENCE ACTIVITIES ACROSS COGNITIVE COMPLEXITY LEVELS Department of Mathematics and Science

32. Sample Low Complexity Question Department of Mathematics and Science Source: FCAT 2.0 Item Specs

33. Sample Moderate Complexity Question Department of Mathematics and Science Source: FCAT 2.0 Item Specs

34. High Complexity Question Department of Mathematics and Science Source: FCAT 2.0 Item Specs

35. Bchmrks Content Focus for FCAT 2014)201220132014 Reporting Category 1. Nature of Science SC.5.N.1.1Analyzing data; Collecting and organizing data; Defining a testable problem; Evaluating a 346 SC.5.N.2.1Identifying empirical evidence; Importance of observations 433 SC.5.N.2.2Importance of replication331 Reporting Category Point Total10 Reporting Category 2. Earth and Space Science SC.4.E.5.4Appearance of stars; Appearance of the Moon; Earth's revolution 233 SC.4.E.6.2Mineral properties—cleavage; Mineral properties—color112 SC.4.E.6.3Natural resources—phosphate13 SC.4.E.6.4Erosion—wind; Weathering—water11 SC.5.E.5.1Star brightness14 SC.5.E.5.3Distinguishing between asteroids and comets; Distinguishing between inner and outer planets 22 SC.5.E.7.1Water cycle—states of matter41 SC.5.E.7.3Climate zone—temperate; Weather—precipitation41 Reporting Category Point Total16

36. BchmrksContent Focus for FCAT 2014201220132014 Reporting Category 3. Physical Science SC.5.P.8.1Comparing objects—physical properties; Physical properties—liquids 312 SC.5.P.8.3Separating mixtures—particle size211 SC.5.P.9.1Chemical change—temperature; Identifying chemical change 112 SC.5.P.10.1Light and heat relationships; Pitch342 SC.5.P.10.2Energy causing a change121 SC.5.P.10.4Conductors—electric; Electric circuits; Heat flow333 SC.5.P.13.1Forces—friction; Forces—magnetic222 SC.5.P.13.2Balanced forces; Force, mass, and motion relationships; Speed 123 Reporting Category Point Total16

37. FCAT 2.0 Content Focus Analysis cont’d… BchmrksContent Focus201220132014 Reporting Category 4. Life Science SC.3.L.14.1Plant structures—leaves; Plants responding to gravity; Seed dispersal343 SC.4.L.16.4Comparing insect life cycles111 SC.4.L.17.3Energy flow through a food chain122 SC.5.L.14.1Organ functions—bladder; Organ functions—sensory organs112 SC.5.L.14.2Animal classification—vertebrates; Comparing plant and animal structures 452 SC.5.L.17.1Behavioral adaptations; Impact on the environment—animals; Physical adaptations—animals 314 Reporting Category Point Total1614 The Next Generation Sunshine State Standards (NGSSS) benchmarks and content foci assessed on the 2014 FCAT 2.0 assessment are not predictive of future FCAT 2.0 content. Content Focus Reports should not be used to make decisions about instruction at the individual student level

38. FCAT PLEDGE Department of Mathematics and Science Share the FCAT Pledge with your students. I WILL