Presentation on theme: "FL Assessments for Instruction in Reading"— Presentation transcript:
1FL Assessments for Instruction in Reading Just Read, Florida!&Florida Center for Reading Research
2New Florida Assessments for Instruction in Reading Instructionally usefulComputer administered in grades 3-12Automatic reporting to the Progress Monitoring and Reporting Network (PMRN) in grades 3-12K-2 will be able to be administered via an internet-based application that will be linked to the PMRNImplementation study in in Manatee, Broward, Leon, and Alachua countiesAvailable free of charge to all schools in Fall 2009Only mandatory in Reading First and Kindergarten Screening
3New Florida Assessments for Instruction in Reading PreK: print knowledge, phonological awareness, vocabulary, mathK-2: phonemic awareness, letter knowledge, decoding, encoding, fluency, vocabulary, listening or reading comp.3-12: adaptive complex & low level reading comp., fluency, word analysis, skill assessmentK-12: Informal reading inventoriesLexile scores in grades 3-12 allow matching students to text and access to online librariesLinked to current measure for K screeningIdentifies risk of reading difficulties and reading disabilities
4New Florida Assessments for Instruction in Reading
5Why New Reading Assessments? Improved to include assessment of:1.PreK2.Vocabulary3.ComprehensionAssesses standards in G4-G12; monitors progressResults predict end of year performance on standardized test (K-2) & FCATDiagnostic inventories are linked to Florida standards and provide information for guiding instructionReading comprehension & oral reading fluency passages are equated for difficulty to allow for accurate progress monitoringComprehension assessed in instructional level passages
6Why Should Teachers Spend 30 Minutes Testing Rather Than Teaching? You can’t expect unless you inspect.Diagnostic information is crucial to teaching.Progress monitoring is crucial to learning.
7The Florida Assessments for Instruction in Reading Probability of SuccessStudents who take the TDI are recommended to take:Ongoing Progress Monitoring tasks (K-12)&Diagnostic Toolkit tasks (3-12)BIG IDEA: Describe the K-12 assessment model (from a bird’s eye view)- discuss how each assessment component provides different function. Point out icons.
8Success Zones - Probability Scores 85% or better probability of grade-level or above performance on the SESAT/SAT-10/FCAT16-84% probability of grade-level or above performance on the SESAT/SAT-10/FCAT15% or less probability of grade-level or above performance on the SESAT/SAT-10/FCATGREENYELLOWRED
9WHO will take the Florida Assessments for Instruction in Reading? Period1OPM23ScreenAllBDIAll*TDISomeScreen= Everyone who is rostered in the PMRN.BDI= All K-2 students in which more information about comprehension, vocabulary, and/or spelling skills is needed.TDI= Some students will take the TDI– those who demonstrate a need for more in-depth diagnostics based on their probability of success score.* Available to All, but may not required
10WHAT are the Florida Assessments for Instruction in Reading? Broad Screen/Progress Monitoring ToolK-2: 3-5 minute set of tasks designed to indicate the probability of success on the SESAT (K) or SAT-10 (1, 2)3-12: Computer-based, adaptive reading comprehension assessment designedto indicate the probability of successon the FCATBIG IDEA= Quick, efficient screen– functions much like a thermometer: quick indicator of a student’s probability of success in reading
11Broad Diagnostic Inventory (K-2) Set of tasks designed to indicate other key areas of instructional need related to reading successListening ComprehensionReading ComprehensionVocabularySpelling (Grade 2 only)In general, describe tasks.
12Targeted Diagnostic Inventory (3-12) Computer-based MazesComputer-based Word Analysis (spelling)
13WHAT are the Florida Assessments for Instruction in Reading? Ongoing Progress Monitoring (K-12)Set of tasks designed to monitor student progress in acquiring critical reading-related skills between benchmark tests
14Informal Diagnostic Toolkit (3-12) Instructional Level RC PassagesPhonics and Sight Word InventoryInstructional Implications of Word Analysis TaskPassage-specific Teacher Q & R TemplatesBIG IDEA: A toolkit of formative assessments for teachers
15WHEN are the Florida Assessments for Instruction in Reading Taken? Period1(Sept)OPM2(Jan)3(Apr)Screen3-5 minper studentBDI10-15 min per taskTDITime variesby studentSame assessment windows as in previous years
16HOW does using the Florida Assessments for Instruction in Reading Support Students & Teachers? Comprehensive assessment systemPhonemic AwarenessPhonicsFluencyVocabularyText ComprehensionOrthographic Skills (Spelling)K-23-12*So, the FAIR assesses each of the critical elements/skills that we know lead to success in reading. These are skills that we can assess and provide recommended instructional support. Instead of assessment and instruction functioning as 2 different aspects of learning, with the FL Assessments for Instruction in Reading, we can bring the two together with teacher-friendly and technology-enhanced tools.* embedded in text comprehension
17Task AdministrationAll but one K-2 tasks (G2 spelling) are individually administered and scored via a web-based application or on paper.Most 3-12 tasks are individually administered on the computer. The Informal Diagnostic Toolkit and G3-G5 fluency probes will be paper and pencil administration only.
18HOW is Using the Florida Assessments for Instruction in Reading Beneficial? Precise ability placement for Reading Comprehension tasksK-2: Word List placement into RC passages3-12: Adaptive placement into RC passagesInternet-based optionsK-2: Internet-based application may be used for task administration3-12: Screen and Targeted Diagnostic Inventory tasks on computerPrecise placement= rather than estimate what level of reading passage a student should receive based on classroom performance, with the FAIR, teachers will be able to reliably place students into reading passages for RC assessment (in the BDI) based upon performance on a short-word reading list in K-2 and via the computer-adaptive nature of the G3-G12 RC Screen.
19HOW is Using the Florida Assessments for Instruction in Reading Beneficial? Access to the PMRN system for recording student scoresK-2: Scores can be entered by hand or via internet-based scoring tool3-12: Scores are automatically sent to the PMRN via the computerized task administrationTeacher website for guiding instruction will be availableIdeas for grouping students by instructional need will be available; including program-specific PDLinks to appropriate instructional routines, based upon student score results, will be available
20HOW is Using the Florida Assessments for Instruction in Reading Beneficial? Screen tasks are directly related to Florida Sunshine State Standards and predict end of year performance on the Stanford Achievement Test (K-2) or FCAT (3-12)Strong psychometric test properties form the basis of all of the assessmentsAll reading comprehension and oral reading fluency tasks use equating methods to put passages on the same scale so that fluency scores are meaningful.*** This will provide teachers with the ability to more clearly monitor ORF progress using consistently leveled passages. ****
21FCAT Test Design Cognitive Complexity (Webb’s Depth of Knowledge) Content Categories for Reading- Words & phrases in context- Main idea, plot, & author’s purpose- Comparison; cause/effect- Reference & Research – locate, organize, interpret, synthesize, & evaluate information
22The K-2 Score Map BS/PMT BDI ALL tasks = Probability of Reading Success (PRS)BDILC = Total questions correct (implicit/explicit)RC = Total questions correct (implicit/explicit),Adjusted Fluency, Percent AccuracyVOC = Percentile RankSPL = Percentile RankTDIALL tasks = Meets Expectations (ME) orBelow Expectations (BE)
23Accessing the 3-12 Florida Assessments for Instruction in Reading Make sure the computers meet the minimum technology requirements for use:- Internet Explorer 6.0 or later, Safari 2.0 or later, or Firefox 1.5 or later web browser enabled (tasks can be taken on both PC and Mac)-Screen resolution of 1024 x 768 pixels in use-Headphones for administration in use (the task instructions have audio)-Placement in a well-lit, non-distracting, quiet area2. Assessments can be accessed at the following URL:https://flassessments.fcrr.orgSo now, let’s shift our attention away from the conceptual bases underlying the Florida Assessments for Instruction in Reading, and discuss the logistical aspects underlying how to use them.We have a few minimum requirements that need to be met for optimal task administration, which we’ve listed here. [Walk though #1]These assessments are web-based, so in order for students to be administered the tasks, the computers must be able to access the website address listed here [FL—for Florida-- assessments.fcrr.org– note for them the “s” after the http, meaning that it is a secure site].[Note: At this point, the FL Assessments are not ADA compliant. Plans are underway to make them 508 compliant by ]23
243-12 Assessment Sample Login Student logs into the computer application using:District NameSchool NameGradeStudent NameBirth DateNow, let’s take a look at the Reading Comprehension Screen and how it will be administered.The assessments will be available on our assessment site, https://flassessments.fcrr.org. The first screen to appear is our login screen, shown here. Students will need to login to the FL Assessments site in order to take any of the tasks.In order to login, the student will need to know the school district name, school name, his/her grade currently enrolled, name used for enrollment/registration (no nicknames), and birth date.24
253-12 Assessment Sample Login Using the drop-down menu options, the student completes the login process.A confirmation page is displayed prior to the start of the task.Florida Assessments for Instruction in ReadingUsing our drop-down menu system, students will complete the login process based upon this pre-registered information (so, for example, if a student registers with their own name, but uses a friend’s birth date, the application will fail to recognize him or her as someone with access to this task). Once the student successfully logs in, a confirmation page is displayed that prepares him or her to begin the task.25
26Reading Comprehension Task Demonstration Click here to start [Note: Click on the RC Screen link and demonstrate how the instructions and practice portion of the task functions. This file will stop running right before the administration of a “real” task item. At that point, switch back to this Power Point presentation].[Note: Although there is voiced instructions walking the student through the task, once the “real items” begin, there is no more voiced guidance (except for during feedback after passage performance).]26
27Maze Task Demonstration Click here to start [Note: Click on the Maze TDI link and demonstrate how the instructions and practice portion of the task functions. This file will stop running right before the administration of a “real” task item. At that point, switch back to this Power Point presentation].[Note: Although there is voiced instructions walking the student through the task, once the “real items” begin, there is no more voiced guidance (except for during feedback after passage performance).]27
28Word Analysis Task Demonstration Click here to start Students are directed to the Word Analysis task directly from the Maze task, and so there is not a login page required. I’ll demonstrate the Instructions and Practice portion of this task to give you an idea of what your students will do.[Note: Click on the Word Analysis TDI link and demonstrate how the instructions and practice portion of the task functions. This file will stop running right before the administration of a “real” task item. At that point, switch back to this Power Point presentation].
29* = The scores you will have on your reports from AP 1 The 3-12 “Score” MapBS/PMTFCAT Success Probability (FSP)*Color- codedPercentileStandard ScoreLexileAbility ScoreMaze - TDIPercent Correct*Percentile (look up table)Monitoring LevelWord Analysis - TDIPercentile*Ability Score (WAAS)Once the PMRN is up and running, here is the listing of scores you will have available to you on your student data. The * are the ones you have today.* = The scores you will have on your reports from AP 1
30PMRN Reports FCRR reports (e.g., school or student change State & Region reports (state status; success zone; historical)School report (status; success zone; historical; student 3+ progress)Teacher reports (status; grade; historical; year-end outcome; success zone; progress)Class reports (also TDI report and error analysis)Student report (OPM; cumulative; historical; score detail; parent letter)
33Section 4 – we will help you answer this question after you have completed the worksheet using your student data
34Looking Ahead:The Florida Assessments for Instruction in Reading will be available to all public schools free of chargeScores from these assessments can be used to meet Reading First reporting requirementsProfessional development will be provided in regional academies during the spring-summer, 2009 and the JRF! Leadership conference.Mention that FCRR has been developing instructional routines that we are in the process of linking to performance profiles so we can make instructional recommendations and provide curricular supports. By this time next year, we’ll more details to share about this.
35What Can Be Gained From the Florida Assessments for Instruction in Reading? Use of an efficient Screen to predict K-12 student success in readingAccess to free assessment tools designed to guide instructionLinking of expanded curricular supports to assessment resultsSuccessful Readers!
37RECOMMENDED PARTICIPANTS: Next Year’s Reading Coach and administrator Train the Trainer for FCRR – FAIRApril 24, 2009 (Friday)8: :30Lively – Professional Learning Center(Computer Lab)RECOMMENDED PARTICIPANTS: Next Year’s Reading Coach and administrator