TELPAS Training for Principals 2014

 This presentation does not take the place of reading the manuals  Campus test coordinators, raters, verifiers, and reading test administrators are responsible for reading the appropriate manual(s) and complying with all the instructions Disclaimer

 Scope and Purpose of Training  General Testing Procedures  Test Security & Confidentiality  Overview of TELPAS  Principal’s Role  Online Reading Test  Final Documentation Submission Components of Today’s Training

District and Campus Coordinator Manual (DCCM, pg. T-13)

Principal’s Role in TELPAS

General Testing Procedures  Test security  Test security procedures and oaths  Active monitoring  Consequences of cheating  Scheduling test administrations  Testing window  Time limits  Breaks  Make-up testing  Preparing for test administrations  Identifying eligible students  Managing secure materials  Preparing for online administrations

General Testing Procedures (Continued)  Testing with accommodations  Allowable test administration procedures and materials  Accommodations for students with disabilities  Linguistic accommodations  Ensuring students receive appropriate accommodations  Monitoring test administrations  Availability of test coordinator and principal  Completing the testing process  Documentation

Test Security And Confidentiality  Test Security  Must secure and account for all secure materials and confidential student information before, during, and after each test administration  Writing samples  Rating rosters  Student authorization letters  Paper-based tests (if applicable)  Access must be limited to personnel who meet the requirements to participate in the testing, have been trained, and have signed the appropriate oath  Holistic raters  Writing collection verifier(s)  Reading test administrator(s)  Rating entry assistant  Technology staff

Test Security and Confidentiality  Confidentiality  Before handling secure materials, testing personnel must be trained and sign the appropriate oath  Personnel working in the AMS must read and accept a statement of confidentiality  No person may view, reveal, or discuss the contents of an online assessment before, during, or after a test administration unless specifically authorized by TEA  If circumstances necessitate that an online assessment be examined, permission must first be obtained from TEA  No person may duplicate, print, record, write notes about, or capture by electronic means any portion of a secure assessment without prior approval from TEA  No individual other than the student may respond to test items  No person may review or discuss student responses or performance data during or after a test administration unless specifically authorized to do so by the procedures outlined in the test administration materials

Test Security and Confidentiality  Two categories of irregularities:  Serious  Procedural  Serious irregularities constitute severe violations of test security and/or confidentiality and can result in the individual(s) responsible being referred to the TEA Educator Standards and Certification Legal Division for consideration of disciplinary action including:  Placement of restrictions on the issuance, renewal or holding of a Texas educator certificate, either indefinitely or for a set term  Issuance of an inscribed or non-inscribed reprimand  Suspension of a Texas educator certificate for a set term  Revocation or cancellation of a Texas educator certificate without opportunity for reapplication for a set term or permanently

Test Security and Confidentiality  Testing Irregularities (Serious)  Directly or indirectly assisting students with responses to reading test questions or holistic writing samples  Tampering with student responses or writing samples  Falsifying TELPAS holistic ratings  Unauthorized viewing of secure test content  Discussing secure test content, student responses, or student performance  Scoring student reading tests, either formally or informally  Unauthorized duplicating, recording, or electronically capturing secure test content (online reading test)  Teachers sharing answers to the online calibration activities or practice rating activities (online training)

Test Security and Confidentiality  Testing Irregularities (Procedural)  Eligibility errors  Testing ineligible students  Failure to test eligible students in all appropriate domains  IEP Implementation Errors  Failure to provide a prescribed accommodation  Providing an unauthorized accommodation  Improper accounting for secure materials  Lost or misplaced writing samples or other confidential or secure materials  Rating rosters and writing samples must be secured until the assessments are complete  Rosters should be given to CTCs to be stored  Writing samples remain confidential but should be placed in the student’s permanent folder after the assessment has been recorded in the AMS

Test Security and Confidentiality  Testing Irregularities (Procedural)  Monitoring errors  CTC did not require raters to return confidential materials  Test administrator left a room unattended when students or secure materials were present or when secure online tests were visible  Secure online tests were left open and visible during a lunch break, short break in room, or restroom break  Testing personnel did not monitor students during a break  Testing personnel did not ensure that students worked independently during the online reading test  Students were not prevented from using cell phones or other electronic devices to take pictures or send messages  A student was allowed to remove secure materials

Test Security and Confidentiality  Testing Irregularities  Procedural errors  Test administrator failed to issue the correct materials or non-allowed materials were provided to students  Untrained or improperly trained personnel were allowed to rate students or administer tests  Test administrator failed to use the test administrator manual or failed to read the bolded test administration instructions verbatim  Displays that might provide assistance were visible  TELPAS writing collection was not submitted in accordance with the required assembly criteria  Test administrator failed to provide a student with the correct student authorization to access the reading test

Test Security and Confidentiality  Reporting Testing Irregularities  Contact Teresa Daugherty immediately upon discovery  Incidents involving disciplinary actions taken against students for cheating  Contact Teresa Daugherty

T Texas E English L Language P Proficiency A Assessment S System Overview: What is TELPAS? TELPAS is the assessment tool that fulfills federal requirements for assessing the English language proficiency of ELLs in grades K-12

TELPAS assesses the proficiency of students in four domains and reports student performance in terms of four English language proficiency levels: What Does TELPAS Measure? Domains Assessed  Listening  Speaking  Reading  Writing Proficiency Levels  Beginning  Intermediate  Advanced  Advanced High

 Grades K–1  Holistically rated observational assessments of listening, speaking, reading, and writing  Grades 2–12  Holistically rated observational assessments of listening and speaking  Holistically rated writing collections  Multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, 10–12 Assessment Components Students’ online reading test answers, holistically rated assessments, and all other student data are submitted through the Assessment Management System

TELPAS Student Rating Roster Principal’s signature verifies: Rater is a trained and calibrated rater Additional rater meets the requirements Roster is completed properly Ratings are accurately displayed

Rater Credentials  Rater must:  Have the student in class at the time of the spring assessment window  Be knowledgeable about the student’s ability to use English in both instructional and informal settings  Hold valid educational credentials  Be appropriately trained in the holistic process  Rate the student in all eligible domains  May include bilingual teachers, ESL teachers, general education teachers, special education teachers, G/T teachers, and teachers of enrichment subjects Paraprofessionals may NOT serve as raters!!

Grades K–12 Holistic Rating Training Flowchart New Raters Online Basic Training Course If not calibrated: Supplemental Holistic Rating Training Final Online Calibration Activity Set 3 Online Calibration Activities Sets 1 and 2: Set 2 required if not successful on Set 1 Fall ELPS-TELPAS Professional Development (For new teachers and new prospective raters -- recommended) Returning Raters Online Calibration Activities Sets 1 and 2: Set 2 required if not successful on Set 1 Spring TELPAS Administration Procedures Training Covers holistic rating training requirements and procedures for conducting TELPAS

Online Training Components  Online Basic Training Course  Required for:  All NEW raters  All raters who have not completed training within the last three school years  Any rater who failed to calibrate on the 1 st or 2 nd attempt last year  Two basic courses  K-1: Covers all four language domains (listening, speaking, reading, and writing)  2-12: Covers the listening, speaking, and writing domains  Must be completed before attempting the online calibration  Approximate time to complete: 4-5 hours RATERRESPONSIBILITIES

Online Training Components  Online Calibration  Required for ALL raters (new & returning)  Consists of 3 sets of (10) students to be rated in all applicable domains  Approximate time to complete: 1 hour RATERRESPONSIBILITIES

Training Certificates & Professional Development Credit  Training certificates are generated for raters who complete training courses and calibration activities  *Certificate of completion issued when a rater completes an online course  *Certificate of successful completion issued when a rater demonstrates sufficient calibration (70 percent or better) on a calibration set  Five hours are awarded for the K–1 and 2–12 basic training courses  Two hours are awarded (in all) for calibration * Raters must provide a copy to the CTC for documentation

Supplemental Support Providers  Purpose:  To provide a system of supplemental support to assist raters who have not successfully calibrated by the end of the second set  Each campus must assign at least one SSP  Requirements for SSP  Be a fully trained rater in the applicable K-1 or 2-12 grade span  Complete the recorded web-based training  Calibrate successfully on either set 1 or set 2

End Dates for Holistic Rating Training  TEA recommends completion of training requirements by the first day of the TELPAS assessment window (March 17)  Basic training courses and calibration activities will be open throughout TELPAS assessment window to:  allow districts to handle extenuating circumstances  allow raters to refer back to course information and practice activities as they rate their students

* KISD window closes on April 4th to provide adequate time for verification of completion Key Holistic Training Dates

Monitoring Course Completions & Calibration Activities (CTC Responsibility)  Statewide rater lookup tool: Texas TrainingCenter  Reports for online training and calibration  TELPAS Returning Rater Planning Roster  Uses records from the last five school years to generate a list of previously trained raters  TELPAS Confidential Course Completion Roster  Lists online basic training course status and performance by user for the current year  TELPAS At-a-Glance Training and Calibration Report*  Lists training course and calibration status for all registered users for the current year  Identifies “Time Spent” on calibration activities  TELPAS Confidential Calibration Summary Report  Provides calibration summary information by grade cluster (K–1, 2, 3–5, 6–8, 9–12) and for grade clusters combined

 New: “Time Spent” column documents how long the rater spent on the calibration activities  If “Time Spent” field indicates an unlikely value for successfully working through the scenarios and rating the students, CTC must investigate  If the rater did not perform the calibration activities independently, CTC must report this irregularity  These types of irregularities fall into the “Serious” category that could result in severe consequences *TELPAS At-a-Glance Training and Calibration Report

CTC appoints individual(s) to verify the collection of writing samples meets the criteria required Assembly & Verification of Grades 2-12 Writing Collections

Writing Collection Verifier Credentials  May be LPAC administrators, school counselors, or other suitable staff  May NOT be paraprofessionals  May NOT be teachers serving as TELPAS raters this year

 Raters are responsible for assembling writing collections that accurately depict the ability of the students to communicate in writing  Writing samples should come from a variety of core content areas  Writing samples should be taken from authentic classroom activities that are grounded in content area TEKS and ELPS  Recent writing samples should be weighted more heavily in the event that a student’s rating is borderline between two levels of proficiency  Classroom observations are not used for these grade levels Assembly & Verification of Grades 2-12 Writing Collections

 Requirements for samples:  Must contain at least 5 writing samples  At least 1 narrative writing sample about a past event  At least 2 academic writing samples from math, science, or social studies  Assigned on/after February 17, 2014  Should reflect current proficiency  Each sample must include student’s name and date  Cover sheet and verification checklist (Appendix C) must be completed and stapled to student’s writing samples  Photocopies of classroom writing assignments may be used if clear and legible  Writing samples may be typed if spelling/grammar checkers disabled Assembly & Verification of Grades 2-12 Writing Collections

Writing from Authentic Classroom Activities  Do not gather all of your LEP students and have a “writing party” for TELPAS  Writing samples should be collected from classroom assignments in which all students participate

The district coordinator is required to submit a testing irregularity incident report to TEA if the student writing samples submitted are based on incorrectly assembled writing collections Assembly & Verification of Grades 2-12 Writing Collections

Validity and Reliability  CTC oversees procedures to ensure validity and reliability of holistic ratings Killeen ISD’s policy is to implement the 1 st and 4 th recommendations of TEA

Procedures to Ensure Validity & Reliability  As was the case last year, there must be a second set of eyes reviewing the rater’s assessment for each student  Writing samples must be reviewed by a trained and calibrated 2 nd rater, but he/she does not have to have the student in class  Other holistic domain ratings can be corroborated by any certified professional who has a knowledge of the student’s listening and speaking capabilities in an academic and social environment  UNLIKE primary raters, 2 nd raters need not rate all domains; each needs to sign appropriate form Validity and Reliability

TELPAS Assessment Eligibility Requirements  Campuses are required to assess all K-12 ELLs enrolled during the TELPAS testing window*:  Currently identified as LEP  LEP code = 1 in eSchoolPlus  Includes parent denials  Includes homebound students  Does NOT include students who have been exited from the program and who are in their 1 st or 2 nd year of monitoring  LEP codes F, S in eSchoolPlus are NOT tested * In rare instances due to ARD specifications or other unusual circumstances, a student may not be required to participate in one or more TELPAS domains--see DCCM Page T-4

Identifying Eligible ELLs CTC Responsibility 1.Use the Advanced Search tab in eSchoolPlus to find currently identified LEP students 2.KISD Connect Precode report (filtered on LEP = C) should match the students found in #1 3.*Use KISD Reporting (SSRS) to identify students who were previously enrolled as LEP and who were not exited from the program * Use this report with either of the other two methods to make sure your list is complete.

Key Dates in Determining Which Campus is Responsible for Assessing Students  Responsibility for assessing students who enroll or withdraw before the testing window  Student withdraws/enrolls before March 17  Sending campus:  Do NOT enter any ratings  Remove student from all online test sessions and holistic rating entry groups  If student has writing samples, give them to receiving campus  Receiving campus:  Responsible for assessing all domains  Enter holistic ratings  Administer online reading test

 Responsibility for assessing students who enroll or withdraw during the testing window  Student withdraws/enrolls on or after March 17  Sending campus:  Responsible for entering all holistic ratings  If student has not taken the online reading test, remove student from all test sessions  Receiving campus:  Responsible only for administering the online reading test (if student has not already completed the test) Note: Students whose last day is March 7 th, are not officially withdrawn until March 17 th so the sending campus must enter holistic ratings for these students Key Dates in Determining Which Campus is Responsible for Assessing Students

 Timeline  Holistic rating completion/rating roster turn-in to CTC  Earliest Date: 3/17/2014  Deadline: 4/4/2014*  Assembling & verifying writing collections (grades 2-12)  Earliest Date: 3/17/2014  Deadline: 4/4/2014* Important Dates * KISD window closes on April 4th to provide adequate time for verification of completion

TELPAS Student Rating Roster Rating Section Legend Signatures

Properly Completing the TELPAS Student Rating Roster (Rating Section) Place one name—the entire name—on one line (if possible) Grade level must be K, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, or 12 Rating domain entries must be B, I, A, H, E, or X NO substitutions or other abbreviations allowed The Reading (K-1 only) column should be blank for grades 2-12 There should be NO other blank entries

Properly Completing the TELPAS Student Rating Roster (Rater Information Section) Rater A and Rater B Information columns must be completed Rater A entries must be 1, 2, 3, 4, 5, 6, 7, OR 8 Rater B entries must be 1, 2, or 3 Consult the Rater Information listed below the roster to determine the correct value for each

Properly Completing the TELPAS Student Rating Roster (Signature Section) Rater must sign and date the roster Additional rater (almost all should have one) must sign and date the roster Principal must sign and date the roster Nobody else may sign for the principal Campus Name must be written on the roster

What’s Wrong with this Picture?

..

So… Now that you know what a rating roster should NOT look like, what might a correctly completed roster look like?

TELPAS Writing Collection Cover Sheet

Properly Completing the TELPAS Writing Collection Cover Sheet (Front Side) Student Name, Campus Name, Enrolled Grade Level, and Number of Writing Samples must be legibly written on the cover sheet Rater must sign the cover sheet Additional rater (most should have one) must sign the roster Writing Rating must reflect just the final rating

Properly Completing the TELPAS Writing Collection Cover Sheet (Back Side) All boxes must be initialed by the rater and/or verifier as indicated unless there is documentation attached explaining why the criteria is not met Verifier must print, sign, and date the sheet on the appropriate lines

Online Reading Tests For Grades 2–12

 New standards were set for TELPAS reading**  Standards were adjusted to meet the new definition of “grade level-appropriate” that accompanies the increased rigor of STAAR  Domain weights have been shifted in the composite score calculations:  Reading: 50% Previously 75%  Writing: 30% Previously 15%  Listening: 10% Previously 5%  Speaking: 10% Previously 5% TELPAS Reading Test Change **What this means for you: TELPAS Reading scores may be lower overall this year

Accommodations  Eligible students with disabilities:  Majority of testing accommodations available for STAAR reading and STAAR English I & II are available for the TELPAS reading test  Large print/projection device (project test on wall)  Colored overlay (tape to monitor)  Individual or small group administration  See Accommodations Resource page  Non-allowed accommodations  Braille administration  Oral administration  Dictionary of any kind

Accommodations  If a student with a disability is allowed a testing accommodation, the accommodation type(s) must be indicated at the time of testing:  Type 1 (accommodations approved locally)  Available for students who meet specific eligibility criteria  Decision is made by the appropriate team of people at the campus level; e.g., ARD committee & LPAC  No ARF required  Type 2 (accommodations requiring TEA approval)  Appropriate campus level teams determine whether or not the student meets all of the criteria  If all criteria is met, an ARF must be submitted to TEA

Accommodations  Linguistic Accommodations:  No linguistic accommodations are allowed  Only test directions may be clarified, translated, or reworded in simplified English  No dictionaries of any type may be used  Extra time is not needed because the test is not timed (but must be completed within the school day) Linguistic accommodations are designed for STAAR and STAAR-L assessments to minimize the impact of language deficiencies on the assessment of subject knowledge and skills

General information  Multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, 10–12  Administered in the TestNav 7 format  Accessed from the Texas Assessment Management System In rare circumstances (juvenile detention centers, homebound), a paper administration of a reading test for grade 2 or above may be authorized by TEA. Refer to the 2014 District and Campus Coordinator Manual (page T-10) for more information about submitting a formal request for a paper administration.

Reading Test Administration Procedures  Test administrators must become familiar with the test administration directions  Sentences are shorter, language is simpler  TA’s may adjust the language and specificity of the administration directions to the level of English proficiency of the students  TA’s must NOT change the substance of the information contained in the directions  TA’s may translate into the native language the administrative directions that they read aloud to the students before the test.  TA’s must NOT translate test items or reading selections

Gather Materials for Testing  TELPAS Manual for Raters and Test Administrators  Seating chart – must use district chart  Session roster of students to be tested  Printed student authorizations  Secure documents  Keep in locked storage before the test  Scratch paper for each student  Pencils for use with the scratch paper Note: All scratch paper and student authorization letters must be returned to the CTC and destroyed at the completion of the test session.

What’s Wrong with this Seating Chart? What test was administered? What is the location of the test? Campus? Room? What date was the test administered? Who are the test administrators/monitors? What times were the test administrators/monitors in the room? What times were the students testing?

Final Data Verification Window  Assessment window closes Wednesday, April 9  Verification window closes Friday, April 11  Allows districts time to verify completeness and accuracy of student data before scoring begins  If during verification process it is discovered a student was not tested, the student must be tested during the verification window  Reminder: KISD’s deadline for completion or ratings entry is April 4 th

Final CTC Duties  Bring the following items to KLSS at your scheduled time on Monday, April 7 th :  TELPAS Rater Oaths (for all raters)  TELPAS Writing Collection Verifier Oath(s)  TELPAS Reading Test Administrator Oath(s)  Online Basic Training Certificates  Online Calibration Certificates  TELPAS Student Rating Roster  TELPAS Writing Collection Cover Sheet (both sides) with writing samples for every student assessed  Seating Charts for online reading test  Session rosters for online reading test * Technology Staff Oath not needed because I will verify technologists have signed their oaths before giving them access to TAMS.

Resources  District and Campus Coordinator Manual  Coordinator Manual Resources Webpage  TELPAS Rater Manual  TELPAS Reading Test Administrator Manual  TELPAS Resources Webpage  PowerPoint training modules posted  Assembling and Verifying Grades 2–12 Writing Collections online course  Found on the Texas TrainingCenter  Coordinator’s and Rater’s User Guides for Online Holistic Rating Training  Educator Guide to TELPAS  User’s Guide for the Texas Assessment Management System  User Roles and Permissions for the Texas Assessment Management System  TestNav 7 Combined Technical Guide  Unified Texas Minimum System Requirements

Contact Information Teresa Daugherty, Director for Assessment & Accountability Direct line to office: Cell Phone: (254) Home Phone: (254) Brenda Gooding, Director’s Secretary : Matt Howell, Testing Coordinator: Deb Brockway, Testing Specialist: Rose Childers, Testing Specialist: Martin McGinnis, Technician: Renee Ham, Data Manager: