4 Test Security and Confidentiality Requirements TELPAS manual pg. 4Maintaining the confidentiality of the TELPAS program involves protecting the contents of all online assessments and student performance documentation. This requires compliance with, but is not limited to, the following guidelines:Before handling secure test materials, all testing personnel who meet the requirements to participate in state testing must undergo training and must sign the appropriate security oath affirming that they understand what is considered confidential.Before accessing the secure online administrative features of the Assessment Management System, trained and qualified testing personnel who will be administering online assessments must first read and accept a statement of confidentiality.All tests must be administered in strict accordance with the instructions contained in the test administration materials.
5 Test Security and Confidentiality Requirements No person may view, reveal, or discuss the contents of an online assessment before, during, or after a test administration unless specifically authorized to do so by the procedures outlined in the test administration materials. If circumstances necessitate that an online assessment be examined, permission MUST first be obtained from TEA.No person may duplicate, print, record, write notes about, or capture by any electronic means any portion of a secure assessment instrument without prior approval from TEA.No individuals other than students during an assessment may respond to test items.No person may review or discuss student responses or student performance data during or after a test administration unless specifically authorized to do so by the procedures outlined in the test administration materials.
6 Penalties for Prohibited Conduct In accordance with 19 TAC §101.65, any person who violates, assists in the violation of, or solicits another to violate or assist in the violation of test security or confidentiality, and any person who fails to report such a violation, may be subject to the following penalties:placement of restrictions on the issuance, renewal, or holding of a Texas educator certificate, either indefinitely or for a set term;issuance of an inscribed or non-inscribed reprimand;suspension of a Texas educator certificate for a set term; orrevocation or cancellation of a Texas educator certificate without opportunity for reapplication for a set term or permanently.Release or disclosure of confidential test content could result in criminal prosecution under TEC § , Section of the Texas Government Code, and Section of the Texas Penal Code. Further, 19 TAC § stipulates that the State Board for Educator Certification may take any of the above actions based on satisfactory evidence that an educator has failed to cooperate with TEA in an investigation.Additionally, irregularities resulting in a breach of test security or confidentiality may result in the invalidation of students’ assessments.TELPAS manual pg. 5
7 Security Oaths TELPAS manual pg. 6 All district and campus personnel who participate in state-mandated testing and/or handle or view secure test materials or confidential information must meet the eligibility requirements and be trained and sign a security oath. Any person who has more than one testing role (e.g., a TELPAS rater who also serves as a reading test administrator) must receive appropriate training and sign a security oath for each role. Security oaths for TELPAS raters, writing collection verifiers, and test administrators can be found in Appendix A. NOTE: Any person who serves as a test administrator, even as a relief for a regular test administrator, must receive appropriate training and sign the test administrator oath. Each oath for TELPAS raters, writing collection verifiers, and test administrators must be read and completed after training and before handling or viewing any secure test materials or confidential information. Oaths must be returned to the campus coordinator and will be kept on file in the district for at least five years.TELPAS manual pg. 6
8 Testing Irregularities TELPAS manual pg. 6-8Serious vs. ProceduralEligibility ErrorIndividualized Education Program (IEP) Implementation IssueImproper Accounting for Confidential or Secure MaterialsMonitoring ErrorProcedural ErrorReporting of Testing IrregularitiesReporting of Disciplinary Actions Taken Against Students for Cheating on State Assessments
10 Rater Credentials TELPAS manual pg. 10 A TELPAS rater is a teacher designated to be the official rater of an ELL’s English language proficiency. Each teacher (including a substitute teacher) selected to rate a student must:have the student in class at the time of the Spring assessment window;be knowledgeable about the student’s ability to use English in instructional and informal settings;hold valid education credentials such as a teacher certificate or permit;be appropriately trained in the holistic rating process as required by the TELPAS administration materials in accordance with 19 TAC, Chapter 101; andrate the student in all eligible language domains.Raters may include bilingual teachers, ESL teachers, general education teachers, special education teachers, gifted and talented teachers, and teachers of enrichment subjects.Paraprofessionals may NOT serve as raters. The teaching relationship of the rater to the student rated is submitted with the student’s holistic ratings as part of the assessment process.TELPAS manual pg. 10
11 TELPAS manual pg. 13 New Raters Returning Raters Fall ELPS-TELPAS Professional Development(For new teachers and new prospective raters -- recommended)Spring TELPAS Administration Procedures TrainingCovers holistic rating training requirements and procedures for conducting TELPASNew RatersReturning RatersOnline Basic Training CourseOnlineCalibration ActivitiesSets 1 and 2:Set 2 required if not successful on Set 1OnlineCalibration ActivitiesSets 1 and 2:Set 2 required if not successful on Set 1Summary of process:Teachers unfamiliar with the ELPS and/or TELPAS should receive foundational training in the fall as a best practice. Spring TELPAS rater training will be a smoother process for teachers who already have this foundation.In the spring, testing coordinators cover holistic rating training requirements of raters during TELPAS administration procedures training.New raters complete an online basic training course, which includes practice rating activities for each language domain – listening, speaking, reading (K–1 only), and writing.New raters and raters from previous years complete calibration activities online to ensure that they are applying the PLD rubrics consistently and accurately.Raters from previous years have the option of reviewing the online basic training course, if desired, before completing calibration activities.There are two sets of initial calibration activities. Each set contains 10 students. Each language domain is represented in each set. Raters successful on the first set do not calibrate further.Only individuals who do not rate accurately enough on the first set complete the second set. Those not successful on the second set will receive supplemental training, followed by the third and final calibration set.Individuals not successful on the final set will either not be used as raters (a district decision) or will be provided rater support in accordance with test administration regulations.If not calibrated: Supplemental Holistic Rating TrainingFinal OnlineCalibration ActivitySet 3TELPAS manual pg. 13
12 End Dates for Holistic Rating Training TEA recommends completion of training requirements by the first day of the TELPAS Reading Assessment window (March 18)Basic training courses and calibration activities will be open throughout the TELPAS assessment window toallow districts to handle extenuating circumstancesallow raters to refer back to course information and practice activities as they rate their studentsDCCM-TELPAS pg. T-9
13 Training Certificates TELPAS manual pgsTraining certificates are generated for raters who complete training courses and calibration activities.A certificate of completion is issued when a rater completes the online basic training course.A certificate of successful completion is issued when a rater demonstrates sufficient calibration (70 percent or better) on a calibration set.
14 General TEA Definitions of New and Returning Raters A district may, at its discretion, require a returning rater to repeat new rater training.This may be advisable if testing personnel believe that a returning rater who was unable to meet rating accuracy requirements in the past would benefit from retaking the online basic training course prior to calibration.Additionally, TEA recommends that districts consider requiring this if they have not completed TELPAS training since the 2008–2009 school year.TELPAS manual pg. 14
15 General TEA Definitions of New and Returning Raters Training for K–1 and 2–12 is separate because of differences in the tested components and rating rubrics (PLDs).“Completed” means that the rater completed all required training. It does not necessarily mean that the rater was successful in meeting training requirements.Note – Raters who completed K-1 training but not 2-12 training will be new raters if they switch to 2-12 training, and vice versa.Raters who have completed K–1 training but not 2–12 training will be new raters if they switch to 2–12 training, and vice versa.15
16 Online Training Components TELPAS manual pgs.14-15Online Basic Training Course (Required for New Raters)One for raters of K–1 and one for raters of grades 2 and aboveIncludes rating activities to give raters opportunities to practice applying the rubrics (no state-required level of accuracy established)Online Calibration (Required for New and Returning Raters)Separate calibration activities for grades K–1, 2, 3–5, 6–8, and 9–12Assembling and Verifying Grades 2–12 Writing CollectionsOptional course that may be used to supplement test administrator procedures training
17 Grade Clusters of Training K–1 training components are separate from those of grades 2 and aboveIt is important that raters know which grade cluster of training to completeFor raters with students in multiple clusters in grades 2–12Rater required to train in the cluster with most ELLsAs a best practice, rater should review some online basic training course practice activities in additional cluster(s)For rater with students in multiple clusters including K–1Rater required to train in K–1 and one other cluster in grades 2–12Rater of K–1 who will rate more than one additional cluster within grades 2–12 should train in the cluster (2, 3–5, 6–8, 9–12) with the most ELLsAs a best practice, rater should review some online basic training course practice activities in other cluster(s)DCCM-TELPAS pg. T-6
18 Online Calibration Activities Raters complete only as many sets as it takes to calibrate.Many raters will be able to calibrate on the first set of activities, and many others will be able to calibrate by the end of the second set.With supplemental support, very few raters should have difficulty calibrating by the end of the third and final set.TELPAS manual pg.17Important Note:Individuals are not authorized by TEA to serve as raters unless they complete the state-required training and calibration activities.Raters who complete all requirements but do not successfully calibrate may be authorized to serve as raters at the discretion of the district, but districts are required to provide rating support in all domains for these raters.
19 Online Calibration Activities TELPAS manual pgsThere are three sets of online calibration activities.Each calibration set contains 10 students to rate, and all holistically assessed language domains are represented in each set.For K–1: listening, speaking, reading, and writingFor 2–12: listening, speaking, and writingA rater needs to rate at least 70 percent of the students correctly to demonstrate sufficient calibration.
20 Supplemental Support After Second Calibration Set for Raters TELPAS manual pg.17Raters not successful after calibration set 2 to get supplemental support and then complete set 3 before the start of testing windowRaters will need an access code to complete set 3Supplemental training resources to be posted in coordinator Resources section of Training Center websiteNote – Districts, not ESCs, have primary responsibility for supplemental training of raters.Districts, not ESCs, have primary responsibility for supplemental training of raters.
21 Criteria for Supplemental Support Providers DCCM-TELPAS pg. T-7A supplemental support provider must:be a 2011–2012 fully trained and calibrated rater in the applicable K–1 or 2–12 spancomplete the recorded Web-based trainingcalibrate on either set 1 or set 2
22 Training of Supplemental Support Providers DCCM-TELPAS pg. T-7Training delivered through a Web-based recorded presentation that is accessible from the coordinator resources section of the Training CenterSeparate training for K–1, 2–5, and 6–12Training will be available beginning January 28Both new and returning supplemental support providers need to complete this trainingDistricts should designate enough supplemental support providers to cover the needs of the districtEncouraged to train at least one supplemental support provider for K–1, 2–5, and 6–12Reviewing the number of raters unable to calibrate by end of calibration set 2 last year may help anticipate this year’s needsDistricts with large ELL populations may find it beneficial to have a supplemental support provider on each campus
23 Two Basic Models for Providing Supplemental Support DCCM-TELPAS pg. T-8Individual or group sessionsRaters attend a one-on-one or group session with a supplemental support provider before completing their third and final calibration set.Brief meeting followed by additional consultation at rater’s requestRater meets briefly with the supplemental support provider for instructions on resources to review.Rater schedules time with the support provider to get clarification, if needed, before completing the third and final calibration set.Note: The models are described in detail in the recorded Web-based training.
24 Responsibilities of Testing Coordinators for Holistic Rating Training Ensuring raters understand the importance of being properly trained on the holistic rating processEnsuring new and returning raters understand which training to take and for which grade clustersMonitoring that all raters complete their training requirements and receive supplemental training support if neededEnsuring that any individual who serves as a rater but is not successful on the calibration portion of training is provided rater support during the TELPAS administration
25 Available Reports for Online Training and Calibration TELPAS Returning Rater Planning RosterUses records from the 2008–2009, 2009–2010, 2010–2011, and school years to generate a list of previously trained ratersTELPAS Confidential Course Completion RosterLists online basic training course completion and in-progress status and performance by user for the current yearTELPAS At-a-Glance Training & Calibration ReportProvides a comprehensive list showing basic training course and calibration completions for all registered users for the current yearTELPAS Confidential Calibration Summary ReportProvides calibration summary information by grade cluster (K–1, 2, 3–5, 6–8, 9–12) and for grade clusters combinedhttps://texas.pearson.desire2learn.com/
26 Important Notes about Reports Personnel with administrative authorization are able to access reports on demand to monitor TELPAS online training and calibration.The reports are updated nightly.In order for users to appear in the correct reports, their location (region, district, campus) must be up to date in the My Info section of the Training Center.Users who have registered in the Training Center and have started but not completed a calibration set are not included in the summary reports. Only completed sets are presented in the reports.However, users who have started a training course will appear in the course roster as being “in progress.”
28 Assemble and verify grades 2–12 student writing collections TELPAS Manual pgsAssembling Grades 2-12 Writing CollectionsType 1: Basic descriptive writing on a personal/familiar topicType 2: Writing about a familiar processType 3: Narrative writing about a past eventType 4: Personal narratives and reflective piecesType 5: Expository and other extended writing on a topic from language artsWhat Not to Include in a Collection (p. 23)Verifying the Writing Collection Components (p. 24)
29 Prepare to rate your students Listening (pg.28)The ability to understand spoken language, comprehend and extract information, and follow social and instructional discourse through which information is providedSpeaking (pg.29)The ability to use spoken language appropriately and effectively in learning activities and social interactionsReading (K-1 – pg.29)The ability to comprehend and interpret written text at the grade appropriate levelWriting (pg.30)The ability to produce written text with content and format to fulfill grade appropriate classroom assignmentsProcedures for Rating Students (p. 33)TELPAS Manual pgs
31 Browser-based TELPAS Student Tutorials Updated student tutorials made available by the end of January 2013New tools will be added for students in grades 3–12Available to assist students in becoming familiar with the browser-based testing interface used for TELPAS readingThe browser-based version of the tutorials can be accessed via a browser; no files need be downloaded or installedAccess the tutorials at
33 Roles That Can be Used for TELPAS Rating Entry Functions Rating entry assistantRole for personnel who will just enter holistic ratings and other rater information (this role cannot set up rating entry groups)Online session administratorRole for tech staff or other personnel who will help CTC create and manage online test sessions and/or rating entry groups
34 Create and manage rating entry groups Entering information in TAMSCreate and manage rating entry groupsCreating a Rating Entry GroupAdding Students to an Existing Rating Entry GroupRemoving Students From a Rating Entry GroupTELPAS Manual pgsEnter rating information onlineEnter proficiency ratings and rater informationExtenuating CircumstancesX – ARD DecisionRater InformationTELPAS Manual pgs
35 Rating Entry GroupsRatings and other rater information cannot be entered until the student is placed in a rating entry groupThese groups are not dependent on reading test sessions or reporting groupsStudents may be arranged according to their TELPAS rater or in any other campus groupingThe enrolled grade level in PEIMS does NOT restrict the organization of students in rating entry groupsTesting coordinators or online session administrators have access to create these groupsIt is recommended that districts create rating entry groups 1 to 2 weeks before testing
36 Creating TELPAS Rating Entry Groups TELPAS Manual pgs20132013For more information about how to use this function, refer to section 10 of the User’s Guide for the Assessment Management System.To create a new Rating Entry Group, click New TELPAS Rating Entry Group at TELPAS Holistic Ratings > Manage Rating Entry Groups, and then enter the rating entry group name. Again, the button will be disabled for users who do not have a role associated with access to this function.Note – For more information about how to use this function, refer to section 10 of the User’s Guide for the Assessment Management System.
37 Creating TELPAS Rating Entry Groups 2013Individual students or whole groups can be added to a rating entry group.
38 Manage TELPAS Rating Entry Groups 2013This view shows the list of rating entry groups that have been created for a specific campus. Personnel assigned to enter ratings will need to know which group(s) they are responsible for. To view the students in an existing Rating Entry Group, click the Rating Entry Group name.
39 Enter Holistic Rating Information Screen TELPAS Manual pgsHolistic ratings and rater information entered from the TELPAS Student Rating Rosters for grades K–12 ELLsInformation can be entered/updated at any time during the TELPAS administration window
40 TELPAS Student Rating Roster 2013Person(s) assigned the role of rating entry assistant will use the information supplied by raters on this roster to enter the rating information in the online system.
41 Enter TELPAS Holistic Rating Information screen 2013
42 Enter TELPAS Holistic Rating Information screen To enter holistic rating information for a student, click the "+" next to the rating entry group name to expand the group, and then click the student’s name.Using the information provided on the TELPAS Student Rating Roster, enter the student’s proficiency ratings for the language domains. Transfer the rater information from the roster by selecting a response to the two questions in the Enter Rater Information section.If a student meets state-established criteria for not being assessed, select Extenuating Circumstances or ARD Decision for the applicable language domain(s) in accordance with instructions in the test administration manuals. If Extenuating Circumstances or ARD Decision is selected for every domain, select No Domains Rated in the Enter Rater Information section.
43 Create test sessions Creating a New Test Session TELPAS Manual pgsCreating a New Test SessionAdding/Removing StudentsModifying a Test SessionMoving Students to Another SessionPrinting Authorizations
44 Roles That Can be Used for TELPAS Reading Online session administratorRole for tech staff or other personnel who will help CTC set up and manage online test sessions and/or rating entry groupsOnline test administratorRole for reading test administrators who just need limited permissions such as starting/stopping sessions and resuming tests
45 Ensure that TestNav has been configured BEFORE Creating Sessions Proctor caching servers should be designated under Test Setup > Configure TestNav BEFORE test sessions are createdAfter inputting your server information and saving, you must also verify the Configuration Details and Save
46 Creating TELPAS Reading Test Sessions When creating the session, ensure that a server name appears in the Proctor Caching Server fieldCTCs and Online Session Administrators can edit this field if necessaryNote – For instructions about how to create online test sessions, refer to page 52 in the TELPAS Manual to 8.2 in the User’s Guide for the Texas Assessment Management System.For instructions about how to create online test sessions, refer to page 53 in the TELPAS Manual and to 8.2 in the User’s Guide for the Texas Assessment Management System.
47 Conduct Administration Testing EnvironmentThere must be at least one test administrator for every 30 students. Smaller sessions may be advisable in some situations.To support test security during online testing, testing staff should make a determined effort to prevent students from seeing one another’s monitor. This may include providing an obstruction such as a manila folder taped to each side of the monitor or a cardboard carrel placed around each workstation.Bulletin boards and instructional displays that might aid students during testing must be covered or removed. Any rooms to which students may be relocated must also be prepared.No element of the testing room’s environment should hinder any student’s performance. The testing room should be quiet, well lighted, well ventilated, and comfortable. Each student should have enough space in which to work.A “Testing—Do Not Disturb” sign should be posted outside the testing room.
48 Conduct Administration Scheduling- Districts may establish starting times for testing. A student who arrives after testing has begun may be tested if sufficient time remains in the day and if the student has not had contact with students who have already completedtesting.Every effort should be made to administer the TELPAS reading test to students who are absent on a given day of testing within the TELPAS window. If originally scheduled, they should be moved to another test session and assessed later in the testing window. students are not present for the test session for which they were.
49 Testing Procedures■ Ensure that the seating chart has been completed, including the names of students testing and the students’ locations in the room. Also include the names of all test administrators/monitors involved in a session. If a seating chart has not been provided for you, contact your campus coordinator. If students are moved to another room to finish testing, an additional seating chart must be completed.■ Make sure that all student workstations are cleared of books and other materials not required for the test.■ Students must remain seated during testing and are not allowed to converse while testing.■ Each student must be allowed to work at his or her individual speed. Since the reading test is untimed, each student must be allowed to have as much time as necessary to respond to every test item. Districts are not required to test beyond the regular school hours, but they are free to do so if they choose. Districts should exercise judgment about starting a test session after lunch, as some students may not have enough time to work at their individual speed to respond to the test items before the end of the school day.
50 Testing Procedures ■ Students must not use reference materials. ■ Students are allowed to use scratch paper since they do not have test booklets in which to write notes. All scratch paper must be turned in to the campus coordinator after testing■ Test administrators must actively monitor the testing room while students are working. Test administrators should confirm that students do not have access to non-allowed materials.■ Some students may finish a test earlier than others. After students have finished testing, students may be allowed to quietly read books or leave the testing room.■ Before a student who has finished testing leaves the room, the test administrator must ensure that the student’s test is in “Submitted” status.
52 Starting and Monitoring a Test Session Starting a Test SessionMonitoring Student Status During a Test SessionReadyActiveExitedResumedResumed-UploadCompletedMarked CompleteExiting a Student’s TestResuming a Student’s TestStopping a Test Session
53 Test Session Details Functions Resume TestMark Test CompleteAdd StudentsRemoveMoveFor more information about how to use these functions, refer to page 64 in the TELPAS Manual and in 8.2 in the User’s Guide for the Texas Assessment Management System.
54 Score Codes Score Codes Score Absent ARD Decision TEA-Approved Paper AdministrationOther Student Not to Be ScoredTELPAS Manual pg. 67“Score” selection should be chosen only if you are marking a test complete because a student did not submit on his own. A student’s test is automatically scored when the student clicks the Final Submit button at the end of the test.
55 Mark Test CompleteReading tests should only be marked complete for the following reasons:“Do not score” situationsAbsence for entire testing windowARD DecisionTEA-approved paper administration for a student already in an online test sessionOther (illness or testing irregularity)Student forgot to click Submit before exiting out of the testTELPAS Manual pg. 67District coordinators, campus coordinators, and online session administrators have access to complete this task.
56 Student Test Details TELPAS Manual pg. 68 Accommodations Information - Accommodations are now separated into Type 1, 2, and 3. Refer to the Accommodation Resources page at for detailed information about accommodations.Type 1—available for students who have a specific need and who routinely, independently, and effectively use the accommodation during classroom instruction and testingType 2—includes the requirements of Type 1, along with additional specific eligibility criteriaType 3—requires the submission and approval of an Accommodation Request Form to TEANote – If the student doesn’t receive reading test accommodations, the fields should be left in the “<select>” position.If the student doesn’t receive reading test accommodations, the fields should be left in the “<select>” position.56
57 Appendices Appendix A Appendix B Appendix C Appendix D Oaths of Test Security and ConfidentialityAppendix BStudent Rating RosterAppendix CWriting Collection Cover SheetWriting Collection Verification ChecklistAppendix DTELPAS Rater’s User Guide for Online Holistic Rating Training
59 Second Semester Immigrant Non-English Readers ELLs in grades 2–12 who first enter U.S. schools in second semester are no longer permitted to receive automatic score of beginning without taking TELPAS reading testNow required to take testWill receive scores based on test performance
60 Students who MoveIf new ELL enrolls before March 18 (start of testing window), receiving campus responsible for all assessmentsIf new ELL enrolls on or after March 18, receiving campus only responsible for grade 2–12 reading test (if not already administered)Applies whether new student is from another school district, state, or country
61 Newly Enrolled ELLsNo holistically rating ELLs from other Texas districts, states, or countries who enroll on or after first day of testing window (March 18)2–12 reading test still required
62 Key Dates for Holistically Rated Components TELPAS 2013 DATESJanuary 2013New teacher foundation training (information forthcoming from Bilingual)January 14Assembly and Verifying Grades 2-14 Writing Collection Course AvailableJanuary 15TELPAS Campus Coordinator Training 8:30 CAB CafeteriaJanuary 28Online basic training courses for NEW K-1 and 2-12 raters available (and for those that need refresher)Supplemental support provider recorded web-based training available (one per campus)February 18Writing samples collection window opensCalibration window for RETURNING raters (first 2 sets)February 27Third and final calibration set availableMarch 18TELPAS Reading test for grades 2nd, 6th and 9thMarch 19 to April 5thTELPAS Writing, Listening and Speaking entered in TAMSMarch 19TELPAS Reading test for grades 3rd, 7th and 10thMarch 20TELPAS Reading test for grades 4th, 8th and 11thMarch 21TELPAS Reading test for grades 5th and 12thMarch 22TELPAS Reading make-up dayThis table shows some key dates for the holistically rated components of TELPAS.