Florida IBTP Overview Community of Practice Lake Mary, FL May 28, :45 - 4:15 p.m. Florida Department of Education Office of Race to the Top Assessments

Objectives To provide an understanding of the Florida Item Bank and Test Platform, including:  Background, structure and purpose  Content  Resources  Demo of navigating, searching, test-building, assigning, administration and viewing results 2

What is the IBTP?  Bank of +90,000 assessment items  Wide range of content areas for K-12  Aligned to the Florida Standards  Varied item types and modes of assessment from selected response to performance tasks  Includes range of cognitive complexity, difficulty for all standards Bottom line: The IBTP is designed to be a valuable resource for districts and classrooms to enrich lessons and units with high quality, standards-based, engaging assessment activities for diagnostic, interim or summative assessment. 3

Statewide Technology-Based* System Bank of Standards- based items/tasks Tiered access for security Training modules for PD and support Test-builder tool – Build valid and reliable assessments Diagnostic Interim Summative 4 * Computer or paper-based functionality + IBTP

Florida Educator Involvement  Item writers and item reviewers  Hard-to-Measure project led by districts  CFAC contribution  Functionality testing and Item Tryouts throughout the project  District Preview and feedback to the Item Bank 5

6 ContentGrades English Language ArtsK-12 MathematicsK-8 and Algebra 1, Geometry, and Algebra 2 Science K-8 and Biology, Chemistry, Earth/ Space Science, and Physics Social Studies K-8 and World History, United States History, United States Government, and Economics SpanishBands K-2, 3-5, 6-8, 9-12 Access PointsGrades K-12, Science and Social Studies The IBTP Project

Content AreasDistrict Awardee Physical and Health Education, K - 8Miami-Dade Physical and Health Education, Hillsborough Performing Arts, ChoralPolk Performing Arts, Band and OrchestraPolk Visual ArtsMiami-Dade World LanguagesDuval Career and Technical EducationHillsborough 7 Hard-to-Measure Project for District-developed Assessments

Osceola County Project (CFAC) Project Awarded in July 2013 ContentCourses MathematicsTrigonometry, Pre-Calculus, Probability & Statistics ScienceEnvironmental, Marine, Anatomy & Physiology Social StudiesPsychology, Sociology AVID CTE JROTC 8

9 Passages developed & reviewed Items written & reviewed Items approved or rejected Item tryouts IBTP available to districts, schools & classrooms Teachers can create diagnostic or interim assessments Districts may use for local assessments IBTP Development  Educator training Winter/Spring 2014  Available to districts Summer 2014  Development Summer 2012 through Spring 2014

IBTP Item Distribution 10 Tier 1 Differentiated Accountability & other state level programs Tier 2 District level access This tier will house the majority of items. Tier 3 School level access Tier 4 Classroom teacher access Tier 5 Public access Sample items. Collection will grow over time. Tiers 1-4 will be password accessible to a limited group of people. Greatest security is employed for Tier 1 items, with wider access available at lower levels. As items are no longer used at an upper level, they will move to become available at the next level down. At end of Year 2, the IBTP houses approximately 90,000 items.

Standards Alignment 11 Florida Standards  English Language Arts  Mathematics  Social Studies (including Literacy Standards)  Science (including Mathematics and Literacy Standards)  Spanish  Hard-to-Measure (including Literacy Standards) Number of Items 22,000 9,000 12,000 11,000 7,000 29,000 IBTP assessment Items are written to Florida Content Standards.

Item Types Developed for the IBTP  Selected Response1 point  Short Response1 point  Gridded Response1 point  Constructed Response2 points  Extended Response4 points  Essay Response6 points  Performance Tasks1-10 points 12

Other Item Types On roll-out, the Item Bank will contain just the item types discussed here. However, the Test Platform will have the functionality for districts and teachers to create other types, including:  True/False  Matching  Technology Enhanced Items 13

Associated IBTP Resources  Classroom Enrollment Tool (CET) allows districts to pre-populate classroom roster data; teachers will not need to manually enter student data; district may update the CET as frequently as desired; data format similar to FDOE (Survey 2).  Single Sign-On (SSO) provides access to the IBTP for district and school staff, teachers and students. 14

Training and Support Training and reference materials will be available on CPALMs, including:  Training Workbook  Job Aids – Brief, step-by-step instructions detailing each IBTP functionality  Online self-study tutorials for administrators, teachers, and technical coordinators  The Student Experience – an overview to acquaint students with the IBTP online testing process 15

Office of RTTT Assessments Directors IBTP Project Manager HtM Project Manager ELA Specialist Spanish Specialist IBTP Systems Admin 16

Questions? 17

Thank You NOTE: These materials were developed under a grant from the U.S. Department of Education. However, the contents do not necessarily represent the policy of the U.S. Department of Education, and you should not assume endorsement by the Federal Government. Copyright © 2014 Florida Department of Education. All rights reserved. 18

District-Developed Assessments for Hard-to- Measure Content Antionette Meeks, EdD, CPP, MCHES Project Manager, District Developed Assessments for Hard-to-Measure Content 19 Spring 2014

Seven Hard to Measure Project Awards 20 Project Letter Content AreasDistrict Awardee APhysical and Health Education, K - 8Miami-Dade BPhysical and Health Education, Hillsborough CPerforming Arts, ChoralPolk DPerforming Arts, Band and OrchestraPolk EVisual ArtsMiami-Dade FWorld LanguagesDuval GCareer and Technical EducationHillsborough

Tasks 21 Develop item specifications based on identified Florida course descriptions and corresponding Florida standards Develop item development plan Create high quality, cognitively complex assessment items representing various item types Review items using three review levels at the project level

Challenges Need to use temporary item bank Updating of standards Adjustments in course descriptions Early IBTP development issues 22

Tasks 23 Participate in fall 2013 item try-outs – test the IBTP Participate in spring 2014 field test – Test IBTP – Gather item level data – Analyze data Accept, adjust, reject items Create new items to fill identified gaps – Submit field test report Submit final project report

Field Test 24 Over 30 districts More than 38,000 independent responses Approximately 40,000 constructed response items

Field Test: Challenges 25 Audio (resolved) Video (June update) Classroom Enrollment Tool (district dependent) File names (resolved; writer dependent) Florida Standards (resolved)

Antionette Meeks, EdD Project Manager, District-Developed Assessments (850) Office of Race to the Top Assessments 26 Fall 2013 Thank you Division of Accountability, Research, and Measurement Florida Department of Education

Central Florida Assessment Collaborative Update Presented to the Community of Practice May 28, 2014 By Heather P. Wright Prepared by Heather P. Wright

63 CFAC Member Districts Prepared by Heather P. Wright

Assessment Development Projects: Collaborating to Meet Legislative Mandates Developing item banks using grant funds (48 courses) Developing item banks using district funds (71 courses) Sharing district-developed item banks (200+ courses) Developing test blueprints using item banks developed by Interim Assessment Item Bank project, CFAC project, & Hard to Measure projects (200+ courses) Developing test forms using item banks developed by Interim Assessment Item Bank project, CFAC project, & Hard to Measure projects (200+ courses) Prepared by Heather P. Wright

CFAC Assessment Development Process Benchmark Analysis Item Specification Development Test Blueprint Development Item Writing Item Content Review Item Bias/Sensitivity Review Item Proofreading (Grant Only) Field Test Form Creation Field TestItem Analysis Item Edits/Item Writing & Review Assessment Creation Prepared by Heather P. Wright

CFAC Grant-Funded Project: Project G 48 courses – Item bank available to ALL districts, regardless of CFAC membership Items authored in IBTP 7 Content Areas: 12,250 items total – Math – Science – ELA – Social Studies – CTE – JROTC – World Languages Grant awarded in July 2013/ Item writer accounts created September 2013 Summer workshops scheduled: – June 9-12: Tallahassee – June 16-19: Ft. Lauderdale – June 23-26: Orlando Prepared by Heather P. Wright

CFAC Project G: 48 Grant-Funded Courses Items Published As of May 13, 2014: – Career/Technical Education: 1383 items – English electives: 1361 items – JROTC: 10 items – Math: 1623 items – Science: 1485 items – Social Studies: 1302 items – Total: 7164 Prepared by Heather P. Wright

CFAC District-Funded Project: Project D 71 courses – Item bank available ONLY to CFAC districts in good standing 7 Content Areas: 1,972 published items/105 submitted items (as of May 6, 2014) – Math – Science – ELA – Social Studies – CTE – JROTC – World Languages 100% District funded Items authored in Eduphoria Summer workshops scheduled (Districts may send participants at their expense): – June 9-12: Tallahassee – June 16-19: Ft. Lauderdale – June 23-26: Orlando Prepared by Heather P. Wright

Example - Osceola Total as of April 7, 2014: 995 Unique Courses, Not Including Pre-K and Pseudo-Courses Prepared by Heather P. Wright

CFAC Project H: District-Developed Item Banks 150+ Courses Gap-Gap Courses (not covered by any other projects or assessments) Items authored in Eduphoria or in districts’ own assessment platforms Plan to exchange items through IBTP using IBTP’s QTI 2.3 specifications Modified item development process: – Test blueprint development – Item authoring – Item review (may only be 1 content review) Prepared by Heather P. Wright

CFAC Project: Test Blueprinting & Test Development Plans to build common test blueprints & assessments for courses with item banks only: – Hard to Measure item banks – Interim Assessment item banks – CFAC item banks CFAC member districts will have option to use or to modify tests created by collaborative Locations/Dates: – Central Florida: September 2-5 – South Florida: September 8-12 – Panhandle: September Prepared by Heather P. Wright

Contact Information Heather P. Wright Research & Evaluation Specialist School District of Osceola County (407) CFAC Website: Prepared by Heather P. Wright