Presentation on theme: "2011 Spring TCAP Training Jefferson County Public Schools 1."— Presentation transcript:
2011 Spring TCAP Training Jefferson County Public Schools 1
Test Security Law T.C.A states: Any person found not to have followed security guidelines… immediate suspension grounds for dismissal, including tenured employees revocation of state license 2
Acknowledgement of Test Security Policy For school/system use All personnel involved in the testing process must be trained. Training documentation should be retained for system records 3 AER Website on Tools & Resources page
TN Test Security All test materials must be secured before and after the test administration. Test materials should be stored in a locked room that is inaccessible to unauthorized persons. Handling of test materials must be restricted to authorized personnel at all times. Return test materials immediately after each test session. 4
Test Audits State Test Security Measure: Conduct random visits during testing to ensure test security and consistency of administration. Random audits may take place during any test administration. Test auditors show up unannounced. 5
Test Materials Quantity Verification All test materials must be kept secure by implementing check-in, check-out and quantity verification procedures for all test materials at the system level, at the school level, and for each test session. 6 AER Website on Tools & Resources page
TN Test Security Standard copyright laws must be maintained at all times. Test items may not be reproduced or distributed in any way, for any reason, by any person. Test content may not be paraphrased for use directly in instructional activities, study guides, or classroom resources. 7
TN Test Security Test materials should not be read, reviewed, or analyzed before, during, or after test administration unless indicated in test instructions or special accommodations. Discussion of test content or specific test items with students, parents, or professional colleagues is prohibited to protect the validity of the test. 8
TN Test Security A secure environment must be ensured during testing. Turn off all communication devices during each test session. Maintain confidentiality of student specific accountability demographic information and test results at all times. 9
Secure Testing Environment Any information regarding the content being measured on the test must be concealed during the test administration. Including but not limited to the following: 10 Maps Charts Posters Student Work Bulletin Board Items Writing Formulas Word Lists Parts of Speech Graphic Organizers Number Lines Definitions Word Walls Displays Models
TN Test Security Carefully adhere to all test directions and accommodation instructions. Make sure all students receive the correct test materials. Follow all time limits outlined in the test directions. Follow all schedules set by the school/system. Remain with students and be observant and non-disruptive throughout the testing session. 11
TN Test Security Ensure that students respond to test without assistance from anyone. Test administrators must ensure appropriate monitoring that does not include coaching or illegal assistance. Test administrators must not read test items or passages to students unless indicated in instructions or accommodations. 12
Breach of Testing Security Report 13 Immediately report any test security concerns to building/system testing coordinator. Any breach must be completed as a Report of Irregularity online.
Questions??? *Use of proctors *Please have materials back to central office as quickly as possible so that we may get them sent in on time. 14
RANDA Order Entry & Communication Reports of Irregularity (RIs) School Group Lists (SGLs) Claiming in FSD System Contact information ASSESSMENT VENDORS
SPRING 2011 ACHIEVEMENT REPORTS New Quick Score Reports In RANDA Part of Faculty/Student Data Will be able to review after students assigned to Teacher Roster
SPRING 2011 ACHIEVEMENT REPORTS POSTED ON PEARSONACCESS IPRs & Labels System & School Summary Reports System Student Data files
PEARSONACCESS SAT 10 (K-2) Achievement (3-8) Gateway EOC
PEARSONACCESS Be sure to check out these features now available: Dynamic Rostering EDvantage TN
PearsonAccess SPECIAL FEATURES Select Assessment
PearsonAccess SPECIAL FEATURES Page 2- Edvantage User Guide Page 1- Dynamic Rostering
PearsonAccess Help desk number: (888) Unlock Account & Upload Assistance Do not call the help desk to set up new users. STCs must assign users (system & school) State assigns STCs (if it cant be done in the school system)
NEW CUT SCORES SPRING 2011 RCPI cut scores and number of items per Reporting Category will be available after testing New policy decision for 2011
ACHIEVEMENT LEVELS Note: Not used for Social Studies which still retains Advanced, Proficient, and Below Proficient
TEST OPTIONS FOR SPRING 2011 Achievement Test (ACH) Modified Academic Achievement Standards (MAAS) English Linguistically Simplified Assessment (ELSA)
ELSA AYP for ELL students Simplified language T1 & T2 students cannot take ELSA Same ELL accommodations Must take all ELSA subtests Cannot mix ACH & ELSA Cannot mix ACH & MAAS
ALTERNATIVE SCHOOL STUDENTS Order materials from remanding school Must be coded back to the remanding school. Send answer documents back with those from remanding school. Systems/schools will not be able to complete an SGL for Alternative School Students.
LATE ACHIEVEMENT ORDERS Double check your Braille and LP orders immediately!
PRE-ID ANSWER DOCUMENTS AND TAG FORMS Immediately check answer documents and TAG forms to see if quantities are sufficient. Check for: Grade level change New students- USID
Maximum 49 Bubble on Answer Doc Select Test TAG FORM: FORMERLY KNOWN AS GIS TAG: TEST ADMINISTRATION GROUP
REVISED ANSWER DOCUMENT From TAG Header From TAG Header Dark Headings not uploaded by state
PREID LABELS Do NOT bubble the following on Pre-ID Answer Documents: +Name+DOB +Ethnicity +USID+Gender
PRE-ID IN PEARSONACCESS Upload Student Demographic Data from EIS: Last name, First name Student USID number DOB Gender Ethnicity Grade
INSTRUCTIONAL AVAILABILITY For Traditional schedules, select from among the following: 150 days or more days 74 days or fewer For Modified schedules, select from among the following: 75 days or more days 37 days or fewer
REVISED ANSWER DOCUMENT Teachers bubble their license numbers and select the content area(s) they teach. If already uploaded, message will cover grids.
TEACHER LICENSE NUMBERS Use new number from the look-up site. It is not the Social Security Number!
2011 ACH TESTING WINDOW April 11-April 22, 2011 April 22, 2011 is Good Friday Systems select no more than 6 consecutive school days Systems do not have to use 6 days Spring Break can not interrupt the test window
2011 ACH TESTING WINDOW All schools within a system must follow the system testing window All students in a grade level within a school must adhere to same test schedule (EXCEPTIONS: SPED, ELL, make-up) ELL and SPED students may not be tested outside the system/state testing window
White boxes MUST be in warehouse within 3 week days after testing is complete, April 27 is last possible day 2011 ACH TESTING WINDOW
All students in grades 3 –8 must adhere to the following test schedule: Day 1 –Reading/Lang. Arts (Parts 1 & 2) Day 2 –Mathematics (Parts 1 & 2) Day 3 –Science (Parts 1 & 2) Day 4 –Social Studies (Parts 1 & 2) Exceptions: SPED, ELL, & make-up testing 2011 ACH TESTING WINDOW
NEW ACH LAW Beginning with , ACH testing shall begin no earlier than the first Monday occurring on or after April 22 Testing window for to April 23 – May 4, 2012 Law can be found at:
ACH tests shall not be administered prior to the completion of one hundred fifty (150) days of instruction. LEAs with schools beginning on the second Monday in August or before shall test during the first week of the testing window. NEW ACH LAW
Each local board of education shall develop a policy by which student scores on the ACH tests (grades 3- 8) comprise a percentage of the student's final grade for the spring semester in the subject areas of mathematics, reading/language arts, science, and social studies. The percentage shall be determined by the local board from a range of no less than 15% and no more than 25%. The policy shall utilize performance levels determined by the State Board of Education and be developed and implemented for the spring semester of NEW ACH LAW
PLANS FOR QUICK SCORES SPRING 2011 Quick Scores: SGLs and RIs must be completed before release Released before SDDV clean up Will not be released if there are duplicates or other issues Will feature the achievement level Will not have score to use as grade until Spring 2012
HAND SCORE REQUESTS Hand scoring requests will only be considered for extraordinary circumstances. Must have a reason (other than a lower score than previous years) for requesting hand score.
SAT 10 (K-2) Systems must order directly from Pearson (not on RANDA) Uploads to PearsonAccess for SAT 10 SAT 10 Reports will still be in PearsonAccess Delivery of tests and reports will come directly from Pearson Direct all questions about SAT 10 (K-2) to: Vicki Gray, Pearson SAT 10 Consultant
Secondary Diagnostic Assessments Spring 2011 Regional Training March
50 Secondary Diagnostic Assessments Enabling legislation enacted May 2007 Public Chapter No. 273: –SECTION 1. Tennessee Code Annotated, Section (b), is amended by deleting the existing language and by substituting instead the following: As a strategy for assessing student readiness to enter and succeed in postsecondary training, every public school student shall take a series of three (3) examinations, one (1) administered at grade eight (8), one (1) administered at grade ten (10), and one (1) at grade eleven (11). These assessments shall be approved by the Commissioner of Education and provide educators with diagnostic information to assist in developing interventions for the purpose of increasing high school graduation rates and improving student preparation for postsecondary achievement. Each year, the results of such examinations shall be analyzed and reported by the Commissioner of Education to the Select Oversight Committee on Education. –SECTION 2. This act shall take effect July 1, 2007, the public welfare requiring it.
ACT Explore/Plan for Tennessee 2011 Testing Window September 19 – November 11,
ACT Explore/Plan for Tennessee Testing Testing of students does not have to be simultaneous throughout the system. Students may test at different times, by grade sections, etc. All testing must occur during the testing window. 53
ACT Explore/Plan for Tennessee Future Testing Windows 2011 September 19 – November September 17 – November 9 54
College Board Fall New Diagnostic Products ReadiStep is an established, valid, reliable and norm-referenced preliminary college preparation assessment instrument for eighth grade students for the purpose of diagnosing the academic strengths and deficiencies of students before entrance into high school.
Secondary Assessments 56
End-of-Course (EOC) Assessments Algebra I Biology I English II ELSA* Algebra I (NEW) ELSA English II (NEW) U.S. History English I Algebra II (NEW) *English Linguistically Simplified Assessment
English III Field Test (Pilot) o Administration Date: Tuesday, May 10 (no make-up date) o Administered only to students enrolled in English III at the time of the field test o Materials shipped directly to public systems from Pearson o Test administration manual to be included in shipment o Not possible to pre-code/pre-slug the English III answer documents o 12 Versions, 65 Items o Available in large print but not braille o Practice test and item sampler available September 2011 o Operational December 2011 o Braille version available Spring
ELSA Eligibility The ELSA Algebra I and ELSA English II exams are appropriate for students who are eligible for English as a Second Language (ESL) services. ELSA testers must be enrolled in Algebra I or English II. Ineligible Students: o T1 or T2 Students o Students who have transitioned out of an ESL program ELL Contact: Steven Nixon ELL Assessment Consultant
Characteristics of ELSA Exams Language for an ELSA test item is simplified to assist in measuring the intended knowledge or skill; however, the knowledge or skill is NOT simplified. Uses high-frequency (common) words Reduces wordiness Avoids words with multiple meanings Uses concrete words, not abstract Reduces complexity of sentence structure Uses the simplest verb forms Uses a context that is no more complex than required *EOC ELSA exams are not available in large print or Braille.
Sample ELSA Algebra I Item
Gateway or AYP/EOC? Gateway Entered high school prior to the school year Previously earned a credit in Algebra I, Biology I, or English II AYP/EOC Enrolled in Algebra I, Biology I, or English II (Regardless of grade level or graduation requirements, a student must be administered the AYP/EOC exam if enrolled in an AYP/EOC class.) Enrolled=EOC
Transition Scenarios 63
AYP/EOCs AYP/EOC o Algebra I/ELSA o English II/ELSA o Biology I (55 Operational Items, 10 Field Test Items, Untimed) EOC o English I o Algebra II (55 Operational Items, 10 Field Test Items, Untimed) o U.S. History (50 operational Items, 10 Field Test Items, Untimed)
EOC Exam Scores The end-of-course test grade will count 20% of the second semester grade for the and school years and 25% of the second semester grade in subsequent school years.
EOC Testing for AP and IB Students A student enrolled in an Advanced Placement (AP) or International Baccalaureate (IB) section of a course with a state end-of-course (EOC) exam should be administered the state exam only if the student did NOT take the state exam while enrolled in a prerequisite course. For example, if a student did not earn a credit in a standard US History course prior to enrolling in AP US History, he or she would be required to take the state US History EOC exam upon completing the AP US History course. The purpose of this guidance is to ensure a student enrolled in an AP or IB course is not administered a corresponding state EOC exam twice. A student should only retake a state EOC exam if he or she failed a course with a state EOC exam and is re-enrolled in the course. 66
Alternative Performance-Based Assessment Rubric The Alternative Performance-Based Assessment (APBA) Rubric may be used for any SPED student enrolled in an EOC class. The rubric may only be used to assist the student in passing the class; points may NOT be added to the students assessment score for the purpose of meeting the Gateway diploma requirement. SPED Contact: Lori Nixon Special Education Assessment Consultant
Spring 2011 Test Administration Dates AYP/EOC and Paper-Pencil Gateway Algebra I/ELSA- May 3 English II/ELSA- May 4 Biology I- May 5 Make-up Testing- May 6 EOC U.S. History, English I, and Algebra II (last 10 instructional days) Online Gateway Window 1: February 28-March 11 Window 2: May 2-20 All schools in the system /district must follow the same AYP/EOC and EOC schedule.
Spring 2011 Scanning and SDDV AYP/EOC Scan Window: May 6-16 EOC Scan Window: May 6-26 AYP/EOC SDDV Window: May EOC SDDV Window: May 16-June 8 SDDV: Student Demographic Data Verification 69
EOC Quick Score Reports Performance levels for Algebra II will be reported after standard setting. With the exception of U.S. History, numeric grades will be provided for all EOC assessments; raw scores will be provided for U.S. History.
EOC Cut Scores
2011 Algebra II Standard Setting The Algebra II standard setting will be held June o Committees will comprise teachers, principals, supervisors, and directors of schools. o Said committees will recommend cut scores. o The cut scores will be submitted to the state board of education in July for approval. o Algebra II reports will be mailed to public systems and private schools in September.
Fall 2010 EOC Reports o Reports will be shipped to public systems and private schools in late March. Algebra II reports will be provided after standard setting. o Reports, in paper and/or electronic format, include Individual Profile Reports (IPRs), labels, and CDs (school and system reports).
EOC Met/Not Met In the Diploma Requirement field of the answer document, bubble Yes for those students for whom the EOC Algebra I, Biology I, or English II assessment will be used to satisfy the students Gateway diploma requirement. The Yes bubble must be filled in to ensure met/not met status is reported for said students. A1 is no longer used to identify EOC testers who have a Gateway diploma requirement. U.S. History labels do not include scale scores.
SchoolHouse to PearsonAccess o Student Demographic Data Verification (SDDV) is now completed in PearsonAccess. o Training Webinars were conducted last fall. An archived Webinar and a pertinent PowerPoint are available in PearsonAccess. o The EOC reports currently housed in SchoolHouse are scheduled to be moved to PearsonAccess in April.
PearsonAccess SDDV Survey PearsonAccess Customer Satisfaction Survey The Student Demographic Data Validation (SDDV) process was moved to PearsonAccess for the EOC Fall 2010 administration. The Tennessee Department of Education and Pearson would like to collect your feedback on this experience. Your input will be used to help us improve Pearson products for you and your coworkers. Your responses will be shared with the Tennessee Department of Education and the appropriate Pearson teams. However, your identity will remain anonymous unless you choose to provide us with your address. This survey will take approximately 5 minutes to complete. Thank you for participating in this survey. 77
Algebra II Reference Page Updated Reference Page 78
Revised EOC Answer Document American Indian or Alaska Native Asian Black or African American Hispanic/Latino Native Hawaiian or Other Pacific Islander White Pearson will not pre-ID the Spring 2011 EOC answer documents.
Unique Student Identification Numbers (USIDs) Student Unique Identification Numbers generated by EIS (State ID) must be coded in the Unique Student ID field. If the number has fewer than nine digits, pre-fill the empty bubbles, using leading zeros. If a USID is not available, an Alternative ID number must be used. Social Security Numbers may not be used. 81
New EOC Resources
Gateway Exams (Paper-Pencil and Online) o Mathematics o Language Arts o Science –55 Operational Items –7 Field Test Items –Untimed
Online Gateway Testing Gateway assessments must be taken online. Exceptions include the following: o Homebound Students o Students requiring a modified format (i.e., large print or braille ) o Students pre-approved by the Office of Assessment Online Gateway testing features a read-aloud function for Special Education students whose IEPs allow for the read-loud or Prompting accommodation. Before testing, students will be able to practice answering questions online either with or without the read-aloud function. Students will be able to practice as many times as needed prior to live testing.
Online Gateway Testing: Practice Items
Online Gateway Testing: Features
Online Gateway Testing: Reports Class Reports Individual Profile Reports (IPRs) Labels Comprehensive Data Files (CDFs) [NEW] All reports for online Gateway testing are available in PearsonAccess.
Online Gateway Testing: Resources
Special Education Assessment Updates Lori Nixon Special Education Consultant Office of Assessment, Evaluation, and Research
Portfolio Looking Ahead Orders will be placed in September Teachers Manual and activities will be revised Portfolio Forms will remain same –Date will not change –Form Number: ED-3089 (Updated 6/2010)
Accommodations Must be implemented throughout the school year on a routine basis Are based on individual need –Allowable –Special Education Special Accommodation codes were changed at beginning of year
Special Accommodation Chart A. Extended Time B. Read Aloud Internal Test Instructions/Items C. Prompting Upon Request D. Interpreter Signs/Cues Test E. Manipulatives F. Assistive Technology G. Calculator H. Scribe I. Unique Accommodation
Special Accommodations A. Extended Time –Not applicable for any Secondary Assessment –Not all Extended Time is the same B. Read Aloud Internal Test Instructions/Items –Do NOT read aloud charts/graphs/timelines… Prompting Upon Request if student has need C. Prompting Upon Request –Test Administrator reads verbatim –Test Administrator may not work out problems or explain any text
Special Accommodations H. Scribe –Is only Special for Writing –If used for Achievement/Secondary, student test book must travel with student answer document G. Calculator –Special Accommodation for Achievement Science –Code only if used for Ach. Science
Special Coding Issues Functionally Delayed Gifted Speech
Functionally Delayed and Coding Functionally Delayed (FD) is a TN Disability category Coding depends on assessment type –Assessment Type Alternate –Portfolio General –Achievement –Secondary
Functionally Delayed Alternate Assessment-Portfolio PRIMARY disability is Functionally Delayed code Functionally Delayed Do NOT code Special Education Hours for a student whose PRIMARY disability is FD AYP Implications –Non-Participant –Non-Proficient
Functionally Delayed General Assessments (Achievement/Secondary) Consider both Primary and Secondary disability category Two Scenarios: –FD primary disability w/ Secondary Disability (IDEA) Code SPED hours and special accommodations Do not code FD –FD primary disability w/o Secondary Disability Code FD and special accommodations Do not code SPED hours
99 Online Assessment Applications
Where does the TVAAS Teacher Report data originate? Student Takes Test, Answer Document completed (revised answer document) Group Information Sheet (now the Test Administration Group Header) Completed GIS(TAG) & Answer Documents Scanned Students Claimed on TDOE Randa Solutions Website - Faculty Student Data TVAAS Teacher Reports Delivered Electronically on The Restricted TVAAS Website
101 Faculty/Student TDOE strongly encourages schools/systems to have teachers do their own claiming in Faculty Student Claiming (FSD) on the TDOE Randa Solutions website Principals and STCs will verify accuracy of claimed students on the TDOE Randa Solutions website Help Manuals and Online Training will be provided for Teacher Claiming on the Resources Tab on the TDOE Randa Solutions Website.
102 Faculty/Student Students who were pre-assigned either through Pearson Access or by bubbling the license number on the student answer document will appear in the roster. Coded on Ans Doc
103 Faculty/Student Students who were not pre-assigned may be added to the roster by selecting them from the TAG. Schools should consider reporting & rostering when determining the organizational principle for the TAG..
Faculty/Student Students may be added by a name search…
Once a teacher has completed the roster of ALL students for whom they have been instructionally responsible at any point in the academic year, they will verify that the roster is complete and continue to claiming for teacher effect. Faculty/Student
106 Once a teacher has completed the roster of ALL students for whom they have been instructionally responsible at any point in the academic year, they will continue to Edit the roster for the TVAAS Teacher Report. All students on a roster will default to 100% for the portion of Instruction given by teacher(s). Exclusions for SpEd and Instructional Availability will be based on coding from the answer document. Instruction percentage and student instructional availability may be edited by the teacher. Faculty/Student
107 Faculty/Student A new look for Administrators – The School Level Audit Access all reports from the Audit Page
108 Faculty/Student System Level Audit Access all reports from the Audit Page
109 Faculty/Student EOC Claiming will also verify the TLN at Log In
110 Need Help? New help manuals and webinars posted