Presentation on theme: "Dr. John D. Barge, State School Superintendent End of Course Tests Pre-Administration Webinar Spring 2011 March 8 - 9, 2011 While you are waiting, please."— Presentation transcript:
Dr. John D. Barge, State School Superintendent End of Course Tests Pre-Administration Webinar Spring 2011 March 8 - 9, 2011 While you are waiting, please do the following: Configure your microphone and speakers by going to: Tools-audio-audio setup wizard Enter/edit your profile information by going to: Tools-Preferences-My profile... Complete the information on the identity tab, click OK To view the profile of another user, hover your mouse over his or her name in the participants window Our session will start momentarily
AGENDA Introductions Whats New Purpose/Overview Use of Calculators Scheduling Considerations/Test Makeup Procedures Students to Be Tested/Accommodations/State Required Codes Grading System Personnel Responsibilities/Examiner Training Security/Testing Irregularities Receipt, Return and Tracking of Materials Scores and Reports EOCT Important Dates/EOCT Resources Contact Information
Whats New? 1.Batched Class Rosters One PDF per content area on a daily basis Current: School ABC has 5 American Literature Class Reports & 3 US History Class Reports posted on PearsonAccess on 02/02/2011. Future: In addition to the Class Roster postings noted above, School ABC will also get 1 PDF for all American Literature Class Reports & 1 PDF for all US History Class Reports on 02/02/ Separate codes for Irregularities and Invalidations
The purpose of the EOCT is to assess student achievement of the state adopted curriculum in core courses and to provide diagnostic data in support of improved student achievement. Purpose
Overview Ninth Grade Literature and Composition American Literature and Composition Biology Physical Science U. S. History Economics/Business/Free Enterprise Mathematics I: Algebra/Geometry/Statistics Mathematics II: Geometry/Algebra II/Statistics
Overview TestTotal # Items # Items Scored Ninth Grade Literature 8068 American Literature8068 Biology8068 Physical Science8068 U. S. History8068 Economics8068 Mathematics I6254 Mathematics II6254 Two core forms per subject area
Overview Scale Scores Does Not Meet Meets Exceeds450+
Overview End-of-Course Tests may be administered via paper and pencil or online. – Paper/ pencil assessments are only available during the winter, spring and summer administrations. – Online assessments are available for all administrations and should be considered for groups who need scores returned quickly (i.e., seniors who may need the passing score to graduate).
Overview Each test booklet is divided into two sections. Students may complete Sections I and II in day one or Section I in day one and Section II in day two. Students may not complete a portion of a section and then complete the remainder of the section later in the day or the next day. This will result in an invalidation of the test. – For example, if a student becomes ill during Section I and does not complete that section, the student may not complete the remainder of the Section I upon return to school.
Calculators are allowed for Mathematics I, Mathematics II, Physical Science and Economics. Calculators that store text or graphing calculators cannot be used. – Examiners should verify appropriate calculator use prior to the beginning of testing. Electronic testing format provides 4-function calculators. Use of Calculators
Scheduling Considerations EOCT may be scheduled at any time during the state testing window. – Individual subject areas should continue to be administered on the same or consecutive days within the system. – At no time should some students complete a test one week and another group of students complete the same test the following week. – Systems must complete the Administration Details page in PearsonAccess during the enrollment window (Test Setup/Enter Administration Details).
Scheduling Considerations Schools must adhere to the testing times prescribed in the Examiners Manuals. – Allowing too much or too little time may result in an invalidation. When scheduling tests, consider the optimum time to administer the tests. – Consider logistics, including time and staffing. – During one-day test administrations, lunch should not serve as the break between sections I and II.
Test Make-Up Procedures The purpose of the make-up days is to administer the tests to students who are unexpectedly absent during the regularly scheduled administration. Make-up days are designed for students who have unplanned/unavoidable absences.
Students To Be Tested Any student, regardless of grade-level, enrolled in an EOCT course must take the appropriate EOCT. – For example, if a student is taking a course to complete the state requirement for Mathematics I, that student must take the Mathematics I EOCT, regardless of the course title assigned by the local system.
Students To Be Tested Students who are: – taking a block-scheduled course who complete the full year course in one semester will be tested at the end of that semester. – following a traditionally scheduled (36-week) course will be tested at the end of the second semester of the course. – completing a course at the end of one semester (typically Economics) will be tested at the completion of the course.
Students To Be Tested Students enrolled (or dually enrolled) in: – alternative schools. – credit recovery or make-up courses. – college courses, online courses, or correspondence classes and are receiving credit towards graduation for an EOCT course. Middle School students enrolled in an EOCT course, whether or not they receive HS credit for the class. – These students will also be required to take the appropriate CRCT.
Students To Be Tested Students with disabilities and English Language Learners (ELL) who are enrolled in EOCT courses for credit. – Students who receive accommodations for instructional and classroom assessment purposes may also be eligible for accommodations during the administration of End-of-Course Tests. – Accommodations provided for statewide assessment must be listed on IEP, IAP, or ELL TPC and should be consistent with the students instructional program.
Students enrolled in your system who are also enrolled in EOCT courses via Georgia Virtual School (GAVS) – Must be administered the appropriate EOCT at their home school. – It is the school test coordinators responsibility to ensure that these students answer documents are coded accurately (30 under SDU A) so that results may be reported to GAVS. – Documents not coded to reflect students enrollment with GAVS could delay or interfere with student grade reports. Students To Be Tested
Students enrolling from non-accredited programs. – Must take and pass the EOCT with a minimum of 70 grade conversion score to receive credit for the course. – It is the responsibility of the local school system to determine whether criteria are met for awarding credit. If a student wishes to transfer credit in an EOCT course completed at an accredited institution, they are not required to complete the EOCT.
Only approved accommodations (listed in the Accommodations Manual and the Student Assessment Handbook) may be used. Use of accommodations not on the list must be approved in advance by Melissa Fincher, Associate Superintendent of Assessment and Accountability at the Georgia Department of Education ( ). Four to six weeks should be allowed for these requests to be reviewed. Accommodations
Grading The EOCT will count as 15% of the students final course grade. Students must earn a 70 or higher final course grade to pass the course and earn credit for graduation. If your school awards 1.0 credit upon completion of a year long course, the EOCT should count as 15% of that final grade. If your school awards 0.5 credit at the end of the first semester, and 0.5 credit at the end of the second semester, the EOCT should count as 15% of the final second semester course grade.
Grading If a student is absent on the day of the test and misses all make-up opportunities, the student may receive an Incomplete and take the EOCT during the next available testing window. A school may not issue a zero for an EOCT grade in lieu of a test administration. – However, if you feel that a student is intentionally absent on all testing/make-up days, document all testing opportunities made available to the student and contact parent. After sufficient attempts have been made, a school can issue a zero for 15%, or an Incomplete.
Grading EOCT scores must be included on or with students report cards. If student report labels were ordered, they are to be placed on students permanent record folder. – Systems may request these labels on the PearsonAccess Administration Details page during each enrollment period.
System Personnel Responsibilities Detailed descriptions of roles and responsibilities are provided in the SAH, Superintendent System Test Coordinator (STC) Principal School Test Coordinator Examiner Proctor
Examiner Training Documentation of attendance at the district and building level (include agenda and materials used). Ensure examiners have an opportunity to review examiner manual prior to testing date (in a secure environment). Examiners should be clear on logistical procedures in place for security of materials.
Security All EOCT must be administered and supervised by a Georgia-certified educator. Maintaining test security and test integrity is critical. Students and teachers need to understand test protocols and the ramifications of not following testing procedures. Violations may result in invalidation of students tests and/or referral to the Professional Standards Commission for disciplinary action.
Security Student Test Booklets must be kept secure at all times. Shrink-wrapped packages must remain sealed until Test Coordinators are ready to prepare test materials for administration. Students must write their names on the cover of their test booklet and any scratch paper.
Security Test Coordinators and/or Examiners should keep a record of all students tested for each EOCT administration. In addition to students name and EOCT administered, please remember to include form numbers for each student in your documentation. Refer to the Student Assessment Handbook for additional security information.
Testing Irregularities All personnel in the local system must follow protocol as they become aware of testing irregularities. Signs of any testing irregularity must be dealt with immediately. – Test Examiner > School Test Coordinator > System Test Coordinator > Melissa Faux
Testing Irregularities All irregularities must be coded, documentation completed and submitted on the Testing Irregularity Form in the MyGaDOE Portal. Once the irregularity code is received, it may be used on future common place irregularities but all irregularities must still be documented in the portal. Only the GaDOE may invalidate assessments.
Testing Irregularities When entering the documentation into the portal, you must include the form number of the test that needs to be coded as an irregularity or invalidated. Portal documentation must clearly indicate if a score should be invalidated, or counted as an irregularity. Failure to include the form number when completing the Testing Irregularity Form will result in the delayed and/or inaccurate reporting of scores.
Testing Irregularities - Paper On answer documents, you must: – Fill-in the appropriate irregularity or invalidation bubble. – Grid the 5-digit SDU B code. – Failure to grid both the correct SDU-B code and fill-in the correct corresponding bubble will result in the delayed and/or inaccurate reporting of scores.
Testing Irregularities – Some Scenarios to Avoid BubbleIrregularity CodeScore INVValid IRR codeInvalidated INVNo codeScored As Is IRRValid INV codeInvalidated IRRNo codeScored As Is No BubbleValid INV codeInvalidated No BubbleValid IRR codeScored as an IRR Failure to grid both the correct SDU-B code and fill-in the correct corresponding bubble will result in action listed in the right-hand column.
Testing Irregularities – Online For online students, follow these steps in PearsonAccess: – Test Management Overview/Register Students (find & select student)/Assigned Tests (Choose the subject)/Edit – Select yes using the drop down options for either the Irregularity or Invalidation box. – Enter the 5-digit SDU B code. – Failure to select yes for the correct indicator (irregularity/invalidation) and/or failure to enter the correct corresponding SDU-B code will result in the delayed and/or inaccurate reporting of scores.
Student Authorization Ticket Testing Irregularities – Online To avoid a student testing under another students GTID, you must : print all Student Authorization Tickets have students verify and sign their names before testing begins Students must verify and sign their names Allb, Allcorrect
Receipt of Materials Materials will be delivered on April System Test Coordinators must: – Ensure sufficient quantities of materials are provided for each school. – Locate pickup/return instructions, memo, return labels, and airbills/bills of lading. – For any discrepancies, contact Pearson Customer Call Center at School Test Coordinators should sign for materials and verify counts. – Upon receipt use security checklist (found in shipment) to inventory all materials. Please document any instances of missing test books in the portal. Test Examiners should sign for materials and verify counts.
Answer Documents Complete Following Sections for All Students (with or without Pre-ID labels) Place Pre-ID Label here
Please place Pre-ID Labels in box located at the bottom left hand corner of answer document. – Please do not submit documents with labels placed incorrectly on answer document; this may delay scoring. For students without Pre-ID Labels, all demographic information must be bubbled (in addition to aforementioned information). Answer Documents
Complete Following Sections Only if Applicable SRC must be coded for students with IEP, ELL/TPC, or 504 IAP, with or without accommodations Types of accommodations: – S – Setting – P – Presentation – R – Response – SC – Scheduling Identify basis of accommodations: – IEP, ELL/TPC, or 504 IAP – Only complete this section if an accommodation was actually given Answer Documents – FOR TEACHER USE ONLY
If applicable, code Braille or Large Print. The PTNA option should only be bubbled by the Examiner if a student is present and can not or will not take a test. If a student answers one question on any section of the test, PTNA should not be bubbled. Answer Documents – FOR TEACHER USE ONLY
Complete Following Sections Only if Applicable State Directed Use (SDU A and SDU B) SDU A – Code for Georgia Network for Educational and Therapeutic Support (GNETS) and Georgia Virtual School (GAVS) SDU B – Two codes, one for Irregularity and one for Invalidation – Call GaDOE for code – Melissa Faux at – The 5 digit SDU-B code must be gridded (paper) or entered online in addition to indicating the appropriate corresponding bubble. Answer Documents – SDU A/SDU B
Class Identification Sheet Complete only one Classroom Identification Sheet per group. Results will be reported based on how answer documents are grouped behind Classroom Identification Sheets; you may group students in whatever manner meets the reporting needs of your school/system.
Return of Materials Materials to be returned to Pearson: Completed Answer Documents with Classroom ID Sheet Test Booklets – Test booklets (used and unused) are bar-coded and scanned upon receipt. – Check each test booklet to ensure there are no Answer Documents in the books. It is critical to the success of the EOCT that all documents are returned immediately after test administration. Promptly returning your materials helps ensure timely results can be returned to your system. – Failure to return secure testing materials may result in referral to the Georgia Professional Standards Commission (PSC).
Return of Materials Do not return the following materials to Pearson: Destroy/Shred all manuals, unused/voided answer documents, scratch paper. You must ensure all answer documents have been accounted for PRIOR to destroying the unused/voided documents. Please keep the test booklet security checklist for your records.
Return of Materials Answer Documents – Returned by FedEx Overnight or K2 Logistics/AAA Cooper (larger systems). – Use Pearsons purple return labels along with FedEx airbill (purple) or K2 Logistics/AAA Cooper overnight airbill. Test Books – Returned by FedEx Ground or K2 Logistics/AAA Cooper (larger systems). – Use Pearson white return labels along with FedEx ground label (red) or K2 Logistics/AAA Cooper freight bill.
Check on the status of your shipments to and from Pearson: – Test Setup>Order Additional Materials and Tracking>Orders from Pearson or Shipments to Pearson Tracking of Materials
Scores and Reports Systems will receive a full set of reports for each main administration. These reports include: Preliminary Class Roster (electronic only-PearsonAccess) with the 5-day turnaround (Rapid Scoring). – Includes Student Name, DOB, GTID, Grade Level and Grade Conversion. – Posted electronically to PearsonAccess within 5 days from the date answer documents are received for scoring. – Class Rosters will be posted once a representative sample has been received. Once Class Rosters are available, Preliminary Class Roster Reports will be removed from PearsonAccess.
Class Roster Reports (electronic only-PearsonAccess) will post once a representative sample of subject areas have been received. – Once Class Rosters are posted, Preliminary Reports will be removed from PearsonAccess. – Includes Scale Score, Performance Level, Grade Conversion score, and domain level information for each student in a specific class. – The batch printing of Class Rosters will be available Individual Student Reports (electronic or paper if requested) – Includes Scale Score, Performance Level, and a Grade Conversion score. – Posted electronically or sent at the end of the administration with summary reports. – One copy should be filed in the students permanent record and one given to student/parent. Scores and Reports
Summary Reports (system, school and class) – Generated by subject and present summary statistics for a particular group of students. Content Area Summary Reports (system and school) – Provides information for school, system and state at the Domain Level. Data File – Posted to GaDOE portal at the time summary reports are posted. Five day Rapid Scoring and Reporting – Once weve received representative sample: Dependent upon accuracy of answer documents. Dependent upon when answer documents are shipped and received. Online Testing – results posted within 5 days of testing.
Delays in Scoring and Reporting Late shipping Errors in packing documents for return Errors in coding answer documents Invalid/incorrect or no form numbers Labels placed incorrectly on answer document Bent/folded or torn answer document Stray marks Students administered the same test twice Scores and Reports
Important Dates – Spring/Summer 2011 TaskStart DateEnd Date March mid-month online testingMarch 7, 2011March 11, 2011 Summer 2011 enrollment counts entered on PearsonAccessMarch 21, 2011April 1, 2011 Summer 2011 local scanning enrollment entered on PearsonAccessMarch 21, 2011April 1, 2011 Spring 2011 Materials DeliveredApril 11, 2011April 13, 2011 Spring 2011 Main AdministrationApril 25, 2011June 3, 2011 Spring 2011 Pickup Materials from systemsApril 26, 2011June 3, 2011 Summer 2011 AdministrationJune 20, 2011July 22, 2011 Summer 2011 Materials DeliveredJune 8, 2011
EOCT Resources Student Assessment Handbook Georgia Assessment Calendar Test Coordinators Manual Examiners Manual/Online Examiners Manual Interpretive Guide Content Descriptions Study Guides Mathematics I and II Formula Sheets Physical Science Periodic Table Physical Science Reference Sheet 52
Contact Information Georgia Department of Education Melissa FauxTony Eitel Pearson Sue BoeckmannRobin Jindrich-Cecil x x