Presentation on theme: "1 Measure Up! Benchmark Assessment Quality Assurance Process RCAN September 10, 2010."— Presentation transcript:
1 Measure Up! Benchmark Assessment Quality Assurance Process RCAN September 10, 2010
2 Measure Up! Objective To monitor and improve Benchmark Assessments in order to attain the most accurate possible measurement of student achievement with respect to California Content Standards Tests.
Measure Up! Components Content—Structure & Course Guides Predictability – Correlation of Benchmark Exams to CST scores – Association of Benchmark Exams with CST Performance Levels Item Analysis – Difficulty – Discrimination – Representative of CST items Evolving
4 PSUSD Benchmark Structure CST ~153 ID 60 to 75 Items Blueprint Aligned Benchmark #1 ~45 ID ~20-35 Items 1 st 45 ID Paced Standards Partial Match to CST Benchmark #2 ~90 ID ~20-35 Items 2 nd 45 ID Paced Standards Partial Match to CST Benchmark #3 ~135 ID ~20-35 Items 3 rd 45 ID Paced Standards Partial Match to CST
5 2008-2009 Algebra I (8 th Grade) Aggregation of 3 Benchmarks 2008-209 Algebra I (8 th Grade) CST Predictability
6 Prof = 38 38 Algebra I BM 08-09 (8 th Grade) Algebra I CST 2009 (8 th Grade)
30 Item Difficulty The p value for any item – percentage of correct answers – usually in decimal form Ideally p value range is.30 to.80 for most items For example – p value of.28 = 28% of the test takers got the item right – p value of.75 = 75% of the test takers got the item right – P value of.95 = 95% of the test takers got the item right
32 Item Discrimination Is item “discriminating” appropriately between higher & lower scoring students Discrimination Index (DI) = difference between how upper half and lower half of students score on an item DI ranges between -1 and +1 We want items to discriminate positively
33 Item Discrimination Monitoring Item Number N Students Standardp ValueDIMax DI 1853NS184.108.40.206.74 2853NS220.127.116.11.84 3853NS18.104.22.168.46 4853MG2.1.25 -.12.50 5853MG22.214.171.124.70 6853MG126.96.36.199.80 7853PS188.8.131.52.86 8853PS184.108.40.206.82 9853PS220.127.116.11.50 10853PS3.3.95.09.10
34 2008-2009 7 th Grade Math 3 rd Benchmark 2009-2010 7 th Grade Math 3 rd Benchmark Representative of CST Items and our continual Revision Process
Your consent to our cookies if you continue to use this website.