TELPAS 2014 Cindy Blair, DTC Nicole Taguinod Danny Pacheco January 14-16, 2014

Agenda Security and Confidential Jigsaw Break TELPAS

This training does not replace your responsibility to read and follow all manuals and supplements. READ THE MANUALS!!!

General Information Grades K-12 LEP students including parent denials Components ▫K-1 reading, writing, listening and speaking ▫2-12 writing, listening, speaking and on-line reading test Test Dates ▫Writing: February 17th to March 7th ▫Reading: March 17 h to April 4th (should not have “absent” students) ▫Late arrivals – March 17 th or later, reading test only

Dates 4

E11 Deadline LEP & Special Education Students The ARD and LPAC committee meet TOGETHER to determine domain by domain for rating and testing students. Documented on “ESL/Bilingual & Special Education Test Assignment and Accommodations” Form Deadline is February 21, 2014 NO BLANKET EXEMPTIONS.

Test Security and Confidentiality Protect the contents of all online assessment and student performance (ratings and writing samples) documentation Trained and oath prior to handling testing material. Oaths for each role Administered in strict accordance with instructions No viewing, discussing, providing answers to secure testing materials (paper or on-line)

Campus Test Coordinator Responsibilities TELPAS

Read all manuals Attend required test coordinator training sessions Identify and train a sufficient number of TELPAS raters and test administrators ▫District Bilingual Coordinator will oversee the remediation training for raters that fail to meet standards after the second set, however TEA establishes this as a campus coordinator responsibility to ensure that raters are trained and qualified Identify and train a writing collection verifier Train appropriate personnel to enter/verify student information in the online system or do it yourself Ensure computer systems have been checked before testing ▫Contact District technology if you have computer issues Campus Coordinator Responsibilities

Ensure that all eligible students are identified and tested Oversee the implementation of validity and reliability You and your principal are responsible for test security on your campus Supervise and actively monitor testing Be the campus contact for all questions about testing Report testing irregularities and security violations immediately to the district test coordinator Campus documentation transfer to DTC Campus Coordinator Responsibilities

Responsibilities of Testing Coordinators for Holistic Rating Training Ensuring raters understand the importance of being properly trained on the holistic rating process Ensuring new and returning raters understand which training to take and for which grade clusters Monitoring that all raters complete their training requirements and receive supplemental training support if needed Ensuring that any individual who serves as a rater but is not successful on the calibration portion of training is provided rater support during the TELPAS administration 12

Attend training session on administration procedures Complete holistic rating training requirements Assemble and verify student writing collections Rate writing collection Complete required documentation Maintain security and confidentiality of student’s writing collections and ratings Report test irregularities Sign all oaths TELPAS Rater Responsibility

Not a TELPAS rater or the CTC Attend campus testing training Complete online requirements Verify writing collection in accordance with manual and complete documentation TELPAS Verifier Responsibilities

Rater Credentials Have student(s) in class in spring assessment window (elementary have PE or fine arts teacher trained as a backup for primary rater) Be knowledgeable about student’s English ability Be trained in rating process Passed with a 70% or better Two attempts Prior to third attempt receive supplemental training

Training On-line at Texas Training Center ▫Site code: telpas2014 Test administration training for: ▫Raters ▫Verifiers ▫On-line administrators ▫Technology

Training Note: If a rater has not calibrated in the last three years they are “new” and must to the New Raters training and calibration

Assembling and Verifying Writing Collections 2 – 12 ▫ Five writing samples to include at least one narrative about a past event and at least two academic writing samples from math, science, or social studies. ▫ All samples must have student’s full name and date accomplished on them ▫ Only writing samples on or after February 17 th may be used

May be a “clean” copy from work by the student to include a journal No corrections by teacher or peers May be typed but spelling and grammar checker must be off The writing collection cover sheet and verification from Appendix A must be completed and attached on top of the samples for each student Assembling and Verifying Writing Collections

What Not to Be Include in Collections Copied from a textbook, lesson, or other written sources. In students own words Papers done with heavily use of a dictionaries or thesaurus Papers with teacher’s, peers, or parents corrections Written primarily in another language than English Worksheets or Q and A writing assignments Brief, incomplete, or rushed papers

Verifying the Collection Principal and CTC designate one or more campus verifiers ▫They complete training on the Texas Training Center and are trained and sign an oath on test administration ▫Raters are responsible for assembling the writing collection and providing to verifiers. Writing collections are to be kept secure like an answer document

On-line Reading Test Requires the TA to be trained and sign another oath if they were a rater or verifier. Students that take by paper will still have to have their answers transcribe into the TAMS. There is a special form and group that you will have that you will have to use in the on-line testing. This same process as for STAAR L You may sign up for one session on either February 20th 21 st, or 24 th. If session is full you must choose another time slot

Years in US Schools is often confusing because pre-K and Kinder are not included in the count. It starts with grade 1 New 60 day rule to be released Years in U.S. schools are important because they are used to determine accountability performance requirements for AYP and the Progress Measurement For more information refer to the LPAC Manual Years in U.S. Schools

TELPAS reading is conducted as an online only assessment Administered to all LEP students in grades 2-12 Since it is online, there are no test booklets or answer documents to handle or process There is a separate training for TAMS on February 20-24, This training will cover in detail the TELPAS online system TELPAS Reading

Refer to on-line accommodations It is possible that a required accommodation is not available with online testing. In those cases, we will have to request approval from TEA to give a paper version of the test and order the materials. This is not a last minute process. Plan Ahead!! TELPAS Reading Accommodations

All students must be assessed within the assessment window If a student is absent the day you have them scheduled to take TELPAS reading then move them to another session that will test later within the TELPAS assessment window The TEA expectation is that we test every eligible student within the TELPAS assessment window TELPAS Reading Make-Ups

TEA requires districts to implement one or more rating support and verification procedures for every campus with TELPAS-rated students SAISD has developed a TELPAS validity and reliability plan that meets TEA requirements Campus test coordinators will be expected to submit required documents to the district test coordinator by the requested deadlines in order to comply with our district validity and reliability plan An internal audit will be conducted by the Bilingual Department Validity and Reliability of TELPAS

For all language domains – grades K-12: Raters will collaborate with other teachers of the students in determining the student’s rating. One collaborator will initial the TELPAS Rating roster for each child For writing – grades 2-12: ▫5% of all writing collections will be randomly pulled for assembly verification by the campus test coordinator SAISD TELPAS Validity and Reliability Procedures

TEA has optional tutorials for students Students are required to have seen and accomplished a tutorial prior to testing (not the day of testing) Tutorials to Prepare Students for online TELPAS Reading Testing

Available Reports for Online Training and Calibration TELPAS Returning Rater Planning Roster TELPAS Confidential Course Completion Roster ▫Lists online basic training course completion and in-progress status and performance by user for the current year TELPAS At-a-Glance Training & Calibration Report ▫Provides a comprehensive list showing basic training course and calibration completions for all registered users for the current year TELPAS Confidential Calibration Summary Report ▫Provides calibration summary information by grade cluster (K–1, 2, 3–5, 6–8, 9–12) and for grade clusters combined 30

Who Can Access Reports from the Texas Training Center Campus testing coordinators receive administrative access upon approval by district test coordinators or district coordinator assistants 31

Important Notes about Reports Personnel with administrative authorization are able to access reports on demand to monitor TELPAS online training and calibration. The reports are updated nightly. In order for users to appear in the correct reports, their location (region, district, campus) must be up to date in the My Info section of the Training Center. Users who have registered in the Training Center and have started but not completed a calibration set are not included in the summary reports. Only completed sets are presented in the reports. However, users who have started a training course will appear in the course roster as being “in progress.” 32

Materials You need to let us know if you need extra manuals by Friday, January 17th If you need a paper test in lieu of the on-line reading, you must submit the waiver request information the DTC by Feb 17 th

Documentation Oaths ▫Four different (rater, verifier, on-line TA, and technology) Rater Roster ▫Do not use one in back of manual, use the one from the Testing Web site ▫All information must be completed and all signatures accomplished Required Documentation Checklist ▫All necessary forms

Tutorials All students are required to take the tutorial prior to the day of the test. May take as many times as campus wants. Same with all on-line tests Tutorials are about how to use the computer not necessary the type of test questions Keep a student roster for documentation of the tutorials

Information on page T-32 of the 2014 District and Campus Coordinator Manual Required to be submitted for ELLs in grades 1–12 with special circumstances that cause extenuating needs Identifying ELLs with extenuating needs will allow— ▫districts to better monitor and adjust instructional interventions and evaluate effectiveness of instructional programs ▫the state to inform and evaluate ELL assessment and accountability policies TEA Spring ELL Assessment Update 36 TELPAS Additional Data Collection

Unschooled Asylees/Refugees ▫Lack literacy skills in first language and basic subject- matter knowledge and skills ▫May also lack basic social skills and may have experienced trauma as a result of previous circumstances ▫This information is necessary to exclude eligible students’ STAAR results from state accountability ratings and will NOT be gathered during STAAR data collection TEA Spring ELL Assessment Update 37 Special Circumstance

Students With Interrupted Formal Schooling (SIFE) ▫Attend school in the U.S., withdraw and leave the U.S. for a period of time, and return to the U.S.  Gaps in schooling (in the U.S) significantly affect growth in English and learning of subject matter TEA Spring ELL Assessment Update 38 Special Circumstance

Disabling Condition ▫This disabling condition significantly affects growth in second language acquisition and academic achievement  Should be determined by the ARD in conjunction with the LPAC TEA Spring ELL Assessment Update 39 Special Circumstance

Ratings If a student is not rated in one or more domains, select one of the following: E = Extenuating Circumstances X = ARD Decision DOMAINSLEVEL ListeningBeginning SpeakingIntermediate ReadingAdvanced WritingAdvanced High

Entering Ratings TELPAS coordinators responsible for creating and managing Rating Entry Groups. Students may be placed in rating entry groups by grade, teacher, or program. Who can enter ratings:  TELPAS Coordinator  Rater  Rating Entry Assistant

Entering Ratings K-1 need to be grouped in a Rating Entry Groups so that student ratings can be entered online. Ratings entered for K-1 include listening, speaking, reading, and writing can be sorted one way for entering ratings and for reading another way. Ratings for students will be entered for listening, speaking and writing.

Prepare for TELPAS Reading GR 2-12 Links to the web-based tutorials available for each grade cluster on Testing Department website. No downloading or installation is necessary to access and use the tutorials. With NO sample items in the actual test, make sure to schedule lab time for students to practice with the tutorial.

DATES On-line reading begins on March 17 th Schedule of schools ▫High schools being on March 17 th - 21 st ▫Middle schools and academies on March 17 th – 21 st ▫Elementary schools on March 24 th – March 28 th ▫If you need to deviate from the schedule you must let us know so that technology will know who is testing. An will be sent out requesting your planned testing dates

TELPAS Reading Students in grades 2-12 are assessed through an online multiple-choice test. Grade Clusters

Testing Accommodations Refer to the TELPAS Reading manual (page 9) Not Permitted: ▫Reading assistance ▫Reference materials ▫Test questions or selections translated ▫Test questions, answer choices, or selections clarified

Reading Test Administrator Reading Test Administrator is the person who, during the test session, guides students through opening their tests, and begins the test itself. The test administrator is responsible for maintaining test security and for managing breaks/interruptions. Reading Test Administrator: ▫Rater ▫Certified Teacher

Computer Check Must turn on computers BEFORE testing Must complete TestNav System Check ▫Link available on Testing Department Website ▫Select 2014 Spring TELPAS Grades K-12

Computer Check If computers FAIL the system check and/or FAIL to launch TestNav: ▫Contact the SAISD with the following info ready:  Campus Name  Room Number  SAISD Tag Number

Student Authorization Letters Each student must have a Student Authorization Letter in order to log in to a test. The authorization letter contains the web address that students enter to access TestNav with the unique username and test coded needed. A password is not required to log into a test, so the password field will be blank. You can print these letters any time before students in the session are to log in to the test. The letters must be kept in a secure location until the test is administered and turned in to the campus coordinator after the test session. Click the GET AUTHORIZATION button on the Session Roster screen to access. TELPAS Reading Manual p: 19

Materials Needed for Testing Copy of manual Seating Chart Test Session Roster Student Authorization Letters (secure documents) Scratch paper for each student Pencils for each student TELPAS Reading Manual p: 19

Testing Environment At least one trained administrator for every 30 students. Computer monitors prepared to discourage students from viewing each other’s monitor. Bulletin boards and instructional displays that might aid students during testing must be removed or covered. The testing room should be quiet, well lighted, comfortable, with enough space to work. “Testing-Do Not Disturb” sign posted outside the testing room.

Testing Procedures Seating chart is completed to include students’ names, locations, and test administrator information. The test is untimed. Work stations are cleared of books and other materials. Student MUST remain seated and no conversing while testing. Each student must be allowed to work at his or her individual speed. NO reference materials are allowed. Allowed to use scratch paper, but all scratch paper must be turned in to the campus coordinator after testing. Active monitoring during the test session. After students have finished, they may read or leave the room. BEFORE a student who has finished testing leaves the room, test administrator must ensure the student’s test is in “Submitted” status. IMMEDIATELY after testing, turn in all test materials and sign the bottom portion of the reading test administrator oath. TELPAS Reading Manual p: 21

Other Testing Issues Answering student questions Computer monitor glare Student breaks Lunch Cell phones Emergencies Changing rooms TELPAS Manual p: 22-23

Starting a Test A test session MUST be started before any students can log in to TestNav and begin the test. A test session does not start until the TEST ADMINISTRATOR clicks the Start button on the Session Details screen, regardless of the scheduled start time and date. TELPAS Reading Manual p: 32

Launching the Test Before students in GR 2-5 can begin the test, TestNav must be launched on each student’s computer, and the login ID and test code found on each Student Authorization Letter MUST be entered by the Test Administrator. Do NOT begin a test for an ABSENT student. TELPAS Reading Manual p: 32

Test administrators guide students through the login process for GR 6-12 Launching the Test TELPAS Reading Manual p: 38

Monitoring Sessions Session Details screen Periodically click Refresh Real-time test status STATUS: Ready Active Exited Resumed Resumed-Upload Completed Marked Complete TELPAS Reading Manual p: 25

Resume If a student exits TestNav--- ▫Return to Session Details and select the checkbox next to that student’s name. ▫A resume checkbox is only available if that student’s status is Started, Exited, or Resume. ▫Click the Resume Test button to resume all students you checked. ▫Students launch TestNav and login using same Login ID and code from authorization letter. TELPAS Manual p: 25

Submitting Answers Student needs to click Final Submit before they are done Exiting TestNav alone does NOT submit answers Refresh to ensure students status are Completed

“Do Not Score” Session Details screen select student’s name. Click Edit button. Select Reading “Do Not Score” Score Code. A designation must be selected. Absent students are to be MOVED into a make-up session prior to stopping the session. TELPAS Reading Manual p: 28

Stopping a Session Ensure each student’s status is Completed or Marked Complete on the Session Details screen. Click the Stop button to stop the test session. Call us if you have questions/concerns

Secure TELPAS Information Content of the online reading test is secure and confidentiality must be maintained. Student Authorization Letters are to be kept secure until needed for testing. All student data in the TELPAS system or entered into the system is confidential. Passwords and user IDs used in the TELPAS system are secure and should be kept confidential.

TELPAS Reading Training Reading Test Administrators must be trained and sign the specific oath. Test administrator MUST read the TELPAS Reading Test Administrator Manual.

Reading Training Deadline Friday, March 7 th

Campus Coordinator Documentation Collect signed oaths from all raters Collect TELPAS Student Rating Rosters and retain for 1 year. Collect and put Student Writing Collections in the students’ permanent record files.

Process not changing Paper test booklets (including large print, if applicable) approved by TEA in rare circumstances Accommodations that are not available in TestNav Unavoidable technological problems that make online testing impossible Other special situations (e.g., homebound students, JJAEPs, etc.) 68 Paper Administrations of TELPAS Reading Spring 2014

Set up test session Choose correct form group type (transcribe paper form, not operational online test form) Transcribe responses Each question has one screen; test administrators will go screen by screen to transcribe the response to each question Responses must match exactly the responses indicated by the student in the test booklet Submit test for scoring For TELPAS, students must be put into rating entry groups so proficiency ratings and rater information can be entered 69 Paper Administrations of TELPAS Reading Process for Transcribing Student Responses

Paper testing won’t be approved on basis that student knows very little English has limited exposure to computers Don’t forget the TELPAS online student tutorials! 70 Keep in Mind…

Scenarios Ms. Smith is new to your campus and teaching this year. Assigned to her are 6 LEP students. Four are current LEP, of which 2 are parent denials. The other 2 of the six are in first year monitoring status. ▫What training and how will you monitor the training Ms. Smith needs? ▫ ▫Which students will Ms. Smith need to rate?

Ms. Smith reports to you that she failed the first two calibration sets. How do you confirm this? What training does she need now? Who do you contact? What action do you take if she fails the third set?

Ms. Smith has successfully completed the third set. However, she notifies you that one of her students that is a current LEP is also a special needs student and that the ARD has exempted them from all TELPAS domains. Is this allowable? How will this be indicated to Pearson/TEA? What parties need to be included in the ARD?

Ms. Smith just notified you that one of her LEP students has been restricted from using computers. How does this impact the TELPAS reading test? What actions do you need to take? Who will input the student’s answers into the on-line system?

Ms. Smith has completed her writing collections. She gives you a folder that contains the following samples for a student: A writing sample on steps to solve a math problem A narrative about something that happened during the holiday break A worksheet from science A copy for the student’s social studies journal about a historical figure contributions A writing about a familiar process Are these acceptable samples? What information must be on every sample?

Ms. Smith has a out of state student enroll in her class on March 20 th that the parent check as LEP. What does Ms. Smith do in regards to TELPAS testing for this student? Would the answer be different if the student enrolled from another Texas school? Ms. Smith’s late arrival student has had his LPAC on April 4 th. Does this student take the on-line reading test?

Ms. Smith has completed her paperwork. What form does she use to record the domain results on? What other information must be completed on the form? Whose signatures must be on the form? What are the requirements for validity and reliability?

Ms. Smith will be an on-line test administrator one day during the window. What training does Ms. Smith need to do this? Can the oath she signed for being a rater cover her for being the on-line test administrator? What access does she need in TAMS?

TELPAS Lab Time February 20, 21 and 24th You will need: ▫Laptop ▫LEP Student Roster ▫TELPAS Manual ▫Know how you want to group students for rating entry and reading test ▫Know dates you are going to administer the reading test ▫Reading Test administrator name(s)

Questions