FCAT Science High School Test – Grade 11 How did this happen? Why didn’t I know?

History of Grade Choices Original 1999 Legislation  Grades 4, 8, and 10 DOE Recommendation  Grades 5, 8, and 10  Rationale: Reading and Writing at Grade 4 Mathematics and Science at Grade 5

Grade 10 Concerns Content Advisory Committee  Concerns from the beginning  What Science of the SSS can be taught and tested by March of Grade 10? Item Review Committees  Can we include these items if all students have not had instruction? Rangefinding Committees  Can we require this “top score point” if all students can’t be expected to know this ?

1 – Test Administration History 2002 Field Test Item writing challenges Test construction challenges Hard to find top score responses to performance tasks

2 – Test Administration History 2003 – First Scores Reported Interpretation: Comparing to the State scores Low percent answering questions correctly Lots of blank performance tasks Questions –  Lack of learning?  Lack of consequences? (Student/School)

3 – Test Administration History 2004 – Second Scores Reported Performances somewhat improved Preparing for Standard Setting – Fall 2004  Pre-standard setting meeting January 2004  What performance represents on-grade level performance? Above grade level? Below grade level? Grade 10 Group – Struggled with “on grade level”  What content is on-grade level for all 10 th graders?

FCAT Science Performance GradeYearAvg. % Correct % % % % % %

4 – Field Test at Grade 11 Question – Could the items developed for grade 10 be used at grade 11 without additional field testing. March 2004 test was used (same as 10 th ) Statistical sample of 3,000 identified Ten schools from 8 districts were included Findings (late July) – An acceptable Grade 11 test can be built using existing statistical data from the items developed and field tested for Grade 10.

DOE Policy Considerations Keep test at Grade 10 – Expect less science Move to Grade 11 – Expect more science  Instructionally valid  Statistically appropriate  Legally challengeable (law says grade 10) Test both grades  10 th to conform to the law  11 th to collect data for standard setting  Cost for adding grade 11 - $1.2 million

Move to Grade 11 Pros Test will have more instructional validity Better scores are more likely Content advisory and administrative support Recommended by science teachers and curriculum specialists Cons Hard to motivate juniors Too much testing of juniors already No student consequences Logistical challenges of test administration with reading/math retakes

Thinking About Consequences Inclusion in A+ school accountability ( ) Should there be student consequences? 1. Pass for graduation 2. Diploma endorsement (high scores) 3. Require Level 1 (2?) students to pass another science course prior to graduation

 Plans under way to change law and rule Changes student consequences also?  Administer in Grade 11 in 2005  Set standards for Grade 11 in Fall 2005  Report scores in 2005 and 2006  Include in A+ School Accountability in So, where are we?

Questions? Dr. Cornelia S. Orr, Director Assessment and School Performance 850/