Science MCA-III Updates Minnesota Department of Education Science Assessment Specialist Jim WoodDawn Cameron
MCA Update Scorable Item Samplers in Test Design and Simulations Text to Speech Reporting: Data and Resources education.state.mn.us 2
Item Samplers – Teacher Guides education.state.mn.us 3
Item Samplers – Score reports education.state.mn.us 4 Score ReportTeacher Guide
Test Design and Navigation education.state.mn.us 5
Science Grades 5, 8 and high school MCA-III Statewide scores went up from 2012 Increase in performance was realized as standards were more consistently implemented across the state. education.state.mn.us MCA Assessment Results Summary
education.state.mn.us State Proficiency Level
education.state.mn.us 8
9
10
education.state.mn.us 11 Comparison of 2012 and 2013 St. Paul
education.state.mn.us 12 Information found in MDE Data Center
Interpreting Science MCA-III Test Scores –Overall scale scores (G01-99) –Scale scores match with the ALD’s Strand, Sub-Strand levels –Reported using a different scale score system (1-9) –Standard Deviation –Standard Error of the Mean= SD/√n education.state.mn.us 13 Putting it all together
education.state.mn.us 14 Benchmark Analysis
All data is relative to the state data Watch the dotted lines – different colors may overlap in their standard deviation Keep an eye on the CLES metric when comparing schools education.state.mn.us 15 CAUTION!!! P-values and standard deviation
Food for Thought Save time for evaluation of data, individually and as a team What inferences can and cannot be made from results? Formative vs. Summative strengths –What are you going to do with this data
Test Development Process Test Specs Storyboard Writing Item Review Field Test Items Data Review Operational Item Pool Operational Test Bias Review Achievement Levels Storyboard Review Bias Review Item Writing education.state.mn.us 17
Get involved! Assessment Advisory Panels—ongoing Register to be invited to panels at Educator Excellence Testing Resources Register for Advisory panels education.state.mn.us 18
education.state.mn.us 19
Broken down by Sub-strand education.state.mn.us 20 HS Benchmark Graphs 2013
Grade 5Grade – 16%0.45 – 14%0.50 – 50% 0.55 – 90%0.55 – 91% High School 0.45 – 15% 0.50 – 50% 0.55 – 95% education.state.mn.us 21 Interpretation of CLES