Presentation is loading. Please wait.

Presentation is loading. Please wait.

System Test Coordinators’ Fall 2012 Conference General Session Assessment Division Recording Link (8/3/12):

Similar presentations

Presentation on theme: "System Test Coordinators’ Fall 2012 Conference General Session Assessment Division Recording Link (8/3/12):"— Presentation transcript:

1 System Test Coordinators’ Fall 2012 Conference General Session Assessment Division Recording Link (8/3/12): sid=2012003 sid=2012003 Recording Link: (8/16/12): id=2012003 1

2 Agenda 1.2012-2013 State Assessments 2.General Announcements & Student Assessment Handbook 3.State Assessments & CCGPS Transition 4.Reminders: Secondary Assessment Transition Plan 5.Planning for Test Administration 6.Assessment Administration 7.Post Administration 8.Ethics and Assessment 9.Major Topics for each Assessment Program 10.Questions & Answers 2

3 Assessment & Accountability Assessment Administration – Anthony (Tony) Eitel ∞ Bobbie Bable ∞ Melissa Faux ∞ Deborah Houston ∞ Michael Huneke ∞ Mary Nesbit-McBride ∞ Vacancy Assessment Research & Development – Dee Davis ∞ Sheril Smith ∞ Niveen Vosler Race to the Top Specialists: ∞ Jan Reyes ∞ Robert Anthony ∞ Dawn Souter Accountability – Joanne Leonard ∞ Nancy Haight ∞ Cowen Harter ∞ Donna Kelly ∞ Meg Connor Race to the Top Growth Model ∞ Allison Timberlake ∞ Qi Qin Associate Superintendent Support Staff ¤ Melissa Fincher ¤ Connie Caldwell ¤ Joni Briscoe 3

4 Contact Information Criterion Referenced Competency Tests (CRCT) Vacant End of Course Tests (EOCT) Melissa Faux 404.656.5975; Georgia High School Graduation Test (GHSGT), Writing Assessments, Online Assessment System Michael Huneke 404.232.1208; National Assessment of Educational Progress (NAEP), Georgia Kindergarten Inventory of Developing Skills (GKIDS) Bobbie Bable 404.657.6168; Criterion Referenced Competency Tests - Modified (CRCT-M) Mary Nesbit-McBride 404.232.1207; ACCESS for ELLs, Georgia Alternate Assessment (GAA) Deborah Houston 404.657.0251; 4

5 Contact Information Melissa Fincher Associate Superintendent, Assessment and Accountability (404) 651-9405; Melodee Davis, Ph. D. Director, Assessment Research and Development (404) 657-0312; Anthony (Tony) Eitel Director, Assessment Administration (404) 656-0478; 5

6 2012 - 2013 Assessments ACCESS for ELLs (K-12) (and new Alternate ACCESS) Criterion Referenced Competency Tests (CRCT) (3-8) Criterion Referenced Competency Tests - Modified (CRCT-M) (3- 8) End-of-Course Tests (EOCT) (Middle/High School) Georgia Alternate Assessment (GAA) (K, 3-8, 11) Georgia High School Graduation Tests (GHSGT) (Gr. 11/12) Georgia Kindergarten Inventory of Developing Skills (GKIDS) (K) National Assessment of Educational Progress (NAEP) (4, 8, 12) Writing Assessments (3, 5, 8, and 11) 6

7 2012 – 2013 Assessments Due to budgetary constraints, the following will not be administered during the 2012-2013 school year: – CRCT – grades 1 and 2 – GAA – grades 1 and 2 7

8 The new Alternate ACCESS for ELLs Alternate ACCESS is a newly developed, individually administered test. It is intended only for English learners with significant cognitive disabilities that are severe enough to prevent meaningful participation in the ACCESS for ELLs assessment. Alternate ACCESS is not intended for ELs who can be served with special education accommodations on ACCESS for ELLs. Decisions regarding a student's participation must be made by an IEP team. The test is available for the 1-2, 3-5, 6-8, and 9-12 grade clusters. Participation Criteria: 1. The student has been classified as an EL. 2. The student has been classified as a special education student and is receiving services. 3. The student has a significant cognitive disability. 4. The student participates in the Georgia Alternate Assessment (GAA). Importantly, students shall not be administered both the Alternate ACCESS for ELLs and the ACCESS for ELLs. 8

9 General Announcements/Reminders Do not include GTID (or FTE #’s) numbers in emails. If secure information such as this needs to be shared via email, you may do so via the MyGaDOE Portal 9

10 General Announcements/Reminders Please do not over-order materials – the containment of costs continues to be critically important. – Overages are provided at both system and school levels. – More than ever before, accuracy of supply orders is critical. Be reminded that assessment data must report to the “FTE-reporting” location (the school that reports the student for FTE purposes). 10

11 Reasons for non-participation in the CRCT, CRCT-M, and EOCT must be provided during Accountability Assessment Processing in the MyGaDOE Portal (Summer 2013): − Illness − Medical Emergency − Other − Unknown Principal Certification Form – required after each administration. Assessment/Assessment/Pages/Information-For-Educators.aspx Assessment/Assessment/Pages/Information-For-Educators.aspx Must be kept on file by System Test Coordinator for 5years. Form is posted in the ‘For Educators’ portal. Webinar schedule: Assessment/Assessment/Pages/Memoranda--Announcements.aspx Assessment/Assessment/Pages/Memoranda--Announcements.aspx 11 General Announcements/Reminders

12 Note Regarding English Language Learners (ELLs) vs. English Learners (EL) The U. S. Department of Education (USED) has changed the term for this special population of students from English Language Learners (ELLs) to English Learners (ELs). This change will be seen on documentation, answer documents, etc. in the 2012 – 2013 school year. This will not impact scoring, coding, etc. This is simply a change in wording. 12

13 State Assessments and the CCGPS in English Language Arts & Mathematics The implementation of the CCGPS begins in fall 2012 in ELA (K – 12) and Math (K – 9). Given that our assessments should correspond to the taught curriculum, work has been taking place to transition many of our program accordingly. This work has involved and will continue to involve GaDOE and contractor staff along with Georgia educators. 13

14 State Assessments and the CCGPS in English Language Arts & Mathematics Georgia Kindergarten Inventory of Developing Skills (GKIDS) The existing web-based application has been updated and will reflect the CCGPS in ELA and Mathematics beginning fall 2012. Revisions have been made to the administration manual and guide. The assessed domains of Science, Social Studies, Approaches to Learning, Personal/Social Development, and Motor Skills will not be changed. The structure and functionality of the web- based application will not change. Georgia Criterion-Referenced Competency Tests in Reading, English Language Arts and Mathematics The CRCT will reflect the CCGPS in the spring 2013. Current item banks have been reviewed to determine which items align to the CCGPS. In addition, during the 2011-12 year items were written specifically for the CCGPS, were reviewed by educators, and were field-tested in spring 2012. Revised Test Content Descriptions, Test Content Weights, and Study Guides will be made available for 2012-2013. There will be some slight shifts in domain weights over the two years (2013 and 2014) until the test fully reflects the emphases of the CCGPS for the 2013-2014 school year. 14

15 State Assessments and the CCGPS in English Language Arts & Mathematics Criterion-Referenced Competency Tests-Modified (CRCT-M) in Reading, English Language Arts, and Mathematics The CRCT-M will transition to the CCGPS in a slightly different manner than the CRCT. The current bank of CRCT-M items is undergoing a review for alignment to CCGPS, and the spring 2013 test will use the items that align to the CCGPS. The CRCT-M continues to be a sibling of the CRCT and will reflect similar content weights. The spring 2013 forms will not have items written specifically for the CCGPS because the CRCT-M program uses CRCT items that are modified to make them more accessible for the student population eligible to take the CRCT-M. During summer 2012, these CRCT CCGPS-based items were reviewed for inclusion into the CRCT-M. They will undergo the appropriate modifications and then be field-tested in spring 2013. Following this field testing, the items approved at data review will appear on the spring 2014 CRCT-M as operational items. Remember that the CRCT Test Content Descriptions and Study Guides are also applicable to the CRCT-M. 15

16 State Assessments and the CCGPS in English Language Arts & Mathematics End of Course Tests (EOCT) in the areas of English Language Arts and for the newly implemented Coordinate Algebra course in Mathematics The EOCT will transition to the CCGPS beginning with the Winter 2012 administration. These courses/tests include: 9 th Grade Literature & Composition, American Literature & Composition, and Coordinate Algebra (a new EOCT). In 2012-2013, these tests will be comprised of items that are dually-aligned to the GPS and the CCGPS as well as items developed specifically for the CCGPS. Revised Test Content Descriptions and Study Guides will be made available for 2012- 2013. The EOCT in Mathematics I, Mathematics II, GPS Algebra, GPS Geometry, Physical Science, Biology, U.S. History, and Economics will continue to be GPS-based. Once this year’s entering ninth graders advance next year (2013-2014) into Analytic Geometry, a new EOCT will become available for that course (beginning Winter 2013). 16

17 State Assessments and the CCGPS in English Language Arts & Mathematics Georgia Alternate Assessment (GAA) in the areas of English Language Arts (K, 3-8, and HS) & Mathematics (3-8) The GAA will reflect the CCGPS beginning in fall of 2012. The GAA blueprint has been revised for 2012-2013 to include the CCGPS that aligned with the previous GPS-based blueprint. The CCGPS- based blueprint is posted on the GaDOE website and will also appear in the 2012-2013 Examiner’s Manual. As with the other assessments, Science and Social Studies remain unchanged by the CCGPS transition. Special note about high school students that need to retest: the blueprint remains based upon the GPS given that these students were first assessed in grade 11 in 2012 under the GPS in ELA and Mathematics... Therefore, a HS Retest blueprint is posted as a separate document. 17

18 Writing 3, 5, 8, and 11 (GHSWT) Georgia’s writing assessment program assesses writing standards that are universal and are reflected in both the GPS and the CCGPS. The current format (students respond to an “on- demand” prompt/topic) will not change. Both sets of standards require students to produce writing in the different genres and that writing reflects quality content development and organization, style, sentence formation, usage, and mechanics. These characteristics are the foundation of the rubrics for the Georgia Writing Assessments in grades 3, 5, 8, and 11. A new set of resources “CCGPS Connections Resource Guides” will be posted for each of the four grade levels. These guides are designed to illustrate the connections between the CCGPS and the writing assessments in their current format. Current plans for the common assessment being developed by PARCC include the assessment of writing in a fashion that will integrate reading and writing (beginning in 2014-2015). 18 State Assessments and the CCGPS in English Language Arts & Mathematics

19 Highlights of Changes to the Student Assessment Handbook Annual edits (dates, updated glossary, new weblinks, etc.) References to the GPS... Now includes the Common Core Georgia Performance Standards (CCGPS) where applicable and/or the term “state-adopted curriculum”. Additions/Changes/Areas of Emphasis in the Test Security section and Roles & Responsibilities section. Assessment Program updates... Alternate ACCESS for ELLs, CCGPS where applicable, New Coordinate Algebra EOCT, Updated EOCT “Grading” section relative to student participation, updated Lexile section. Some new/updated forms at end of Handbook. 19

20 Reminders: Secondary Assessment Transition 20

21 Secondary Assessment Transition The Secondary Assessment Transition Plan was approved by the State Board of Education on April 13, 2011 This plan provides for the phasing out of the Georgia High School Graduation Test (GHSGT) and an increased “weight” of the End of Course Tests (EOCT) All students will continue to be required to take and pass the Georgia High School Writing Test (GHSWT) 21

22 Secondary Assessment Transition In April 2011, the State Board of Education voted to adopt amendments to two rules: – Rule 160-3-1-.07: Testing Programs – Student Assessment ( – Rule 160-4-2-.13: Statewide Passing Score ( ) 22

23 Secondary Assessment Transition Plan Cohort 1: Students entering grade nine for the first time during the 2011-2012 school year and beyond Testing Rule Amendments for this cohort include: – Removing the Georgia High School Graduation Tests as a requirement for graduation – Retaining the requirement to pass the Georgia High School Writing Test Statewide Passing Score Rule amendments include: – Increasing the contribution of EOCT to the course grade to 20% NOTE: Students would not be required to pass the EOCT to graduate but must pass the course to earn credit 23

24 Secondary Assessment Transition Plan Cohort 2: Students currently in high school (entered grade nine for the first time between July 1, 2008 and June 30, 2011) Testing Rule Amendments for this cohort include: – Flexibility – allowing a passing score on one of the two EOCTs in each content area to serve as an alternate demonstration of proficiency and stand in lieu of the requirement to pass the corresponding content area GHSGT – Retaining the requirement to pass the Georgia High School Writing Test Statewide Passing Score Rule amendments include: Retaining the contribution of the EOCT to the course grade at 15% 24

25 Ninth GradersTenth GradersEleventh GradersTwelfth Graders 2011 / 2012 EOCT = 20% of course grade Pass the GHSWT EOCT = 15% of course grade [Pass one EOCT in each of the four content areas or pass the corresponding subject test of GHSGT] Pass GHSWT EOCT = 15% of course grade [Pass one EOCT in each of the four content areas or pass the corresponding subject test of GHSGT] Pass GHSWT EOCT = 15% of course grade [Pass one EOCT in each of the four content areas or pass the corresponding subject test of GHSGT] Pass GHSWT 2012 / 2013 EOCT = 20% of course grade Pass the GHSWT EOCT = 20% of course grade Pass the GHSWT EOCT = 15% of course grade [Pass one EOCT in each of the four content areas or pass the corresponding subject test of GHSGT] Pass GHSWT EOCT = 15% of course grade [Pass one EOCT in each of the four content areas or pass the corresponding subject test of GHSGT] Pass GHSWT 2013 / 2014 EOCT = 20% of course grade Pass the GHSWT EOCT = 20% of course grade Pass the GHSWT EOCT = 20% of course grade Pass the GHSWT EOCT = 15% of course grade [Pass one EOCT in each of the four content areas or pass the corresponding subject test of GHSGT] Pass GHSWT 2014 / 2015 Common Core Assessment Implementation (Language Arts & Mathematics) EOCT = 20% (Science & Social Studies) Common Core Assessment Implementation (Language Arts & Mathematics) EOCT = 20% (Science & Social Studies) Common Core Assessment Implementation (Language Arts & Mathematics) EOCT = 20% (Science & Social Studies) EOCT = 20% of course grade Pass the GHSWT Secondary Assessment Transition Plan 25


27 Roles and Responsibilities The successful implementation of the statewide student assessment program requires a concerted effort by many individuals at the local level. The failure of any personnel to assume the responsibilities described in the Student Assessment Handbook (SAH) may result in testing irregularities and/or invalidation of scores. Failure to assume responsibilities can have many far-reaching implications and may effect professional certification status. 27

28 Roles and Responsibilities Detailed descriptions of roles and responsibilities are provided in the SAH, 2012-2013. Superintendent System Test Coordinator (STC) System Special Education Coordinator System Title III Coordinator Principal School Test Coordinator Examiner Proctor Note: The School Test Coordinator and all Examiners must hold a PSC-issued certificate. 28

29 Scheduling Considerations Mandated tests must be scheduled in accordance with published GaDOE testing dates. This is a provision that Superintendents document via the Supt’s. Certification Form. – The Statewide Assessment Calendar can be found on the GaDOE Testing web page in the ‘For Educators’ portlet. – Assessment/Assessment/Pages/Information-For-Educators.aspx Assessment/Assessment/Pages/Information-For-Educators.aspx – In scheduling each assessment, schools must adhere to the testing times prescribed in the Examiner’s Manuals. Allowing too much or too little time may result in an invalidation. When scheduling tests, consider the optimum time to administer the tests. – Consider logistics, including time and staff availability. 29

30 Scheduling Considerations Each system/school has the option of deciding whether students will be tested in their classrooms or in a large-group setting. Mandated tests must be scheduled in accordance with published GaDOE testing dates. If breaks are allowed, they should be scheduled so that an unhurried pace is maintained. The monitoring of students during an allowed/scheduled break is required. It is strongly recommended that students are tested in a classroom setting, especially for elementary school students. If the large-group testing option is selected, all students must be able to hear the test instructions and have sufficient workspace for writing or marking answer documents. Instructions should be delivered by the students’ examiner who is present with them in the test setting. A sufficient number of proctors must be available to assist with test administration and monitor test security. Plans for the effective, documented, and secure distribution and collection of test materials must be in place regardless of the type of setting used. 30

31 Materials Management Make certain that Pre-ID label files are created accurately and uploaded in a timely manner. All testing materials must be stored – under lock and key and with strict “key control” – in a secure central location. Each STC must implement an accounting system for the materials that are required for each test administration. This applies at both the system and school levels. The STC should plan for the distribution of test booklets, answer documents, Examiner’s Manuals and Test Coordinator’s Manuals in a timely manner. Secure materials should be distributed to schools as close to the beginning of the testing window as possible. Once an answer document has a student pre-id label on it, student information bubbled on it, and/or student responses on it... It is considered secure. 31

32 Training Plan The STC should develop and implement a district plan for training for each specific assessment program. Maintain detailed attendance records with the name of each participant, responsibility, date of training, and name of assessment. Develop a specific plan for implementing accommodations including: – ensuring students receive the right accommodations – ensuring the examiner administers the accommodation appropriately – ensuring the logistics are considered and planned for 32

33 Managing Test Security Lock tests up! Require students put their names on the test booklets. Teachers should sign tests out and in – note dates, times, number checked out/checking in. All system personnel are prohibited from reviewing contents of test booklets.* Do not copy any secure test materials. Monitor students. *Interpreters for the hearing impaired may review, with supervision, to plan for administration. 33

34 Materials Security Staff members who are not involved in testing should also be aware of the school’s responsibility for test security. Paraprofessionals, custodial staff, and others in the school who may be in classes during testing or may be near the area where tests are stored, even though they do not have direct access to tests, should be aware of security rules. 34

35 Materials Security All personnel involved in the administration must be trained in a manner appropriate to their role; this includes all staff who are involved in the handling of secure test materials (receipt, distribution, pre/post administration activities, etc.). Volunteers who assist in the school (non-employees) should not handle test materials or manage testing logistics but may assist in the administration in other ways (front office support, hall monitors, etc.). 35

36 Planning for a Conducive Environment Ensure that seating spaces and writing surfaces are large enough. Seating arranged to prevent cheating. No cell phones or other electronic devices in the test setting. No. 2 Pencils - Each student should have two No. 2 pencils with erasers on test days. However, there should be a supply of extra pencils and erasers available. Keep a timing device visible - you should have a clock or watch to keep track of time during test administration. Prior to testing, make a plan for students who finish early, arrive late, appear to be (or become) ill, etc. 36

37 Planning for Testing Administration EXAMINERS Deliver the Examiner’s Manual with fidelity. Verify that students’ answer documents are prepared correctly before testing begins. Verify that students respond in the appropriate sections of the answer document (e.g., that social studies items are answered in the section marked SOCIAL STUDIES). Verify that form numbers/letters are coded correctly on student answer documents. Refer to the detailed listing of roles and responsibilities in the Student Assessment Handbook. 37

38 Planning for Testing Administration PROCTORS Proctors are always recommended. When more than 30 students are to be tested in one room, the assistance of a proctor is required. At least one proctor is required for each additional 30 students. If students are tested in groups of 30 or fewer, a proctor is highly recommended. Proctors must be trained in appropriate test procedures before testing begins. Tasks which they must perform should be clearly specified. Refer to the detailed listing of roles and responsibilities in the Student Assessment Handbook. 38

39 Planning for Testing Administration RESOURCES AND AIDS NO dictionaries(*), textbooks, or other aids and/or resources that would provide assistance. (*EL Word to Word Dictionaries would be an exception to this if prescribed in an EL-TPC plan) Any instructional materials that are displayed in the room, such as posters, must be covered or removed during testing. Review the calculator policies for each program as they differ. Calculators that store text or that have graphing capabilities are not allowed on any state assessment. 39

40 Accommodations and Special Populations 40

41 Accommodations Considerations Approved accommodations appear in the Student Assessment Handbook and in the Accommodations Manual (published 2008) Accommodations not specified in SAH need to be pre- approved... Requests must be received 4 – 6 weeks in advance of the state testing window for the applicable assessment. Advanced Reading Aids – Plan ahead for ordering electronic formats for read-alouds (such as Kurzweil) (Requests should be submitted 8 – 12 weeks in advance at minimum) 41

42 Eligible Students Students eligible for accommodations include: – Students with Disabilities students with individualized educational plans students served under Section 504* – English Learners Students qualifying for language assistance services EL students who are also SWD Students who have exited language assistance services in the last two years (EL-Monitored)** * Only in the rarest of circumstances would a 504 student qualify for a conditional accommodation. ** EL-M students are not eligible for conditional accommodations.

43 Accommodations Accommodations allow access… – they are practices and procedures in the areas of presentation, response, setting, and scheduling that provide equitable instructional and assessment access for students with disabilities and English language learners. Accommodations reduce or eliminate the effects of a student’s disability or limited English proficiency Accommodations do not provide an unfair advantage Accommodations do not reduce or change learning expectations

44 Test Administration Accommodations Accommodations provide access for demonstration of achievement – Allow participation – Do not guarantee proficiency and therefore should not be selected solely as mean to help ensure proficiency Must be required by the student in order to participate in the assessment Must be provided during routine instruction and assessment in the classroom (both before and after the state tests are administered)

45 Test Administration Accommodations Some accommodations appropriate for instruction are not appropriate for assessments It may be appropriate to use some instructional accommodations to provide access to grade level content, but these should be faded over time The ultimate goal is always meaningful measurement of what the student has learned as a result of instruction

46 Accommodations In Georgia accommodations MAY NOT alter, explain, simplify, paraphrase, or eliminate any test item, reading passage, writing prompt, or choice option provide verbal or other clues or suggestions that hint at or give away the correct response to the student Only state-approved accommodations may be used on state-mandated assessments, following the guidance issued.

47 Key Considerations For students with disabilities IEP teams should consider – – the characteristics of the disability or the combination of disabilities for the individual student – how the disability affects/impacts the learning of specific content – how the disability affects/impacts the demonstration of learning 47

48 Key Considerations For English learners EL-TPC teams should consider – – the student’s level of English proficiency – the student’s level of literacy in English – the student’s level of native language proficiency – the student’s level of literacy in native language 48

49 Plan for Accommodations Know who your SWD, EL, and 504 students are who require accommodations... And plan well in advance for their needs. Plan for small groups and the need for the same form number/letter. Know who your visually impaired students are and ensure you have adequate materials. Make provisions for Extended Time students. Plan in advance for any Word to Word (EL) Dictionary needs. Ensure that examiners are familiar with the proper way to deliver the necessary accommodations. Collaborate with others as needed to ensure that “paperwork” (IEP’s, EL-TPC’s, 504 Plans, etc.) is in order. The transfer of student responses to a student answer document (in cases such as Large Print and Braille administrations) should be completed with a witness present... The witness should hold a PSC-issued certificate. It is critical that staff confirm that this process is completed where required. A form to document this process is now provided in the Student Assessment Handbook under Required Forms. 49

50 Accommodations Any accommodation(s) given to a student during the administration must be specified in the student’s IEP, 504/IAP, EL/TPC. All accommodation(s) during state mandated testing should reflect instructional practices. Students should not experience an accommodation for the first time on a state assessment. School Test Coordinators must ensure that students are given their appropriate accommodations, before a student begins to test. 50

51 Accommodations Additional information and guidance on the appropriate use of accommodations: – Accommodations Manual: A Guide to Selecting, Administering, and Evaluating the Use of Test Administration Accommodations for Students with Disabilities (published 2008) – Found on the GaDOE web site ( and-Assessment/Assessment/Pages/default.aspx; in the portlet labeled ‘For Educators’) and-Assessment/Assessment/Pages/default.aspx 51

52 Assessment Administration 52

53 Materials Upon receipt, STC should: – Inventory all materials to ensure sufficient quantities of materials have been provided for each school. – Locate pickup/return instructions/memo, return labels, and airbills/bills of lading. – If there are any errors in shipping materials, contact the vendor and/or Assessment Specialist associated with the testing program immediately. 53

54 Materials Distribute materials to schools in a timely manner. However, materials should not be in schools for lengthy periods of time either prior to or after the assessment window. Use appropriate “security checklists” to assign books to schools. School Test Coordinator should count and sign for all materials received. Materials should be in a locked, secure location at all times both at the system and school levels. – Restricted access must be confirmed 54

55 Materials The School Test Coordinator must count all materials before disseminating to examiners. Examiners must verify count upon receipt. At the end of testing each day, the examiner must account for all materials before dismissing students. The School Test Coordinator must count and secure all materials as examiners check in the materials at the end of testing each day. 55

56 Materials Each school should have a test administration plan which outlines how, when, where tests are to be distributed and collected each testing day. – Schools should distribute materials to examiners immediately before testing. – Schools should collect materials immediately at the conclusion of testing each day (or after each “period” if applicable). No one should have access to secure materials for lengthy periods of time. 56

57 Materials Pre-ID labels (where provided) must be used to provide accurate student information for state tests. – Refer to the Test Coordinator’s and Examiner’s manuals for current information on use of labels specific to each test. – Labels with incorrect information should not be used (and should be securely destroyed). – Labels should be applied to answer documents prior to administration. Once applied, the answer document is considered secure. 57

58 Roles and Responsibilities – Refer to Student Assessment Handbook for detailed information. – Superintendent has ultimate responsibility for all testing activities within the local school system. The System Test Coordinator shares this responsibility as the Superintendent’s designee. – Principal has ultimate responsibility for all testing activities within the school. Emphasis: The Principal must complete the Principal Certification Form after each administration. 58

59 Roles and Responsibilities System Test Coordinator – Liaison between system and GaDOE – Conduct local system trainings of School Coordinators – Coordinate ALL administration activity – Know and enforce responsibilities of all other roles – Adhere to the state testing calendar and local calendars/schedules – Implement plans for ordering and receipt of materials, distribution, test security, administration, collection and return shipments, receipt and dissemination of reports and data – Detailed list of responsibilities in SAH 59

60 Roles and Responsibilities School Test Coordinator – Must hold a PSC-issued certificate – Count and secure all test materials – Materials distribution/return, signing out and signing in materials – Attend and then redeliver training – Plan for all aspects of the school’s test administration, monitor test administration environment – Receive/verify test material counts after testing each day – Detailed list of responsibilities in SAH 60

61 Roles and Responsibilities Examiner – Must hold a Georgia PSC-issued certificate (teachers, counselors, administrators, paraprofessionals) – Security/verification of test materials – Control of testing environment and active monitoring – Accuracy of demographic/student information on answer documents – Correct delivery of assigned accommodations – Follows procedures for testing as given in Examiner’s Manual, including reading all directions to students – Detailed list of responsibilities in SAH 61

62 Roles and Responsibilities Proctor – Must be trained – With examiner supervision, ensures that students are managing test materials appropriately – Active monitoring – Detailed list of responsibilities in SAH 62

63 63 Student Assessment Handbook: “Must Do/Must Not Do” List

64 Irregularities All personnel in the local system must follow protocol as they become aware of testing irregularities Signs of any testing irregularity must be dealt with immediately – Test Examiner > School Test Coordinator > System Test Coordinator > GaDOE 64

65 Irregularities All irregularities must be coded, documentation completed and submitted to the GaDOE Assessment Administration Division Only the GaDOE may invalidate assessments 65

66 Irregularities The Assessment Administration Division will review all reports of irregularities – Issue irregularity/invalidation codes – Advise the local system as to whether a report of possible unethical conduct should be made to the Professional Standards Commission (PSC) 66

67 Examples of Irregularities in Security Procedures: – Examinee was given access to test questions or prompts prior to testing – Test Examiner or other personnel copied or reproduced and distributed secure test materials – Test Examiner or other personnel provided answers to the examinee – For more examples, please refer to the SAH 67

68 Examples of Irregularities during Testing Administration: – Test Examiner or other personnel failed to follow administration directions for the test – Examinee’s test booklet, answer sheets, or portfolio entries (GAA) are lost – Test Examiner fails to provide an examinee with a documented accommodation or provides examinee with an accommodation that is not documented – For more examples, please refer to the SAH 68

69 Steps for Reporting an Irregularity School Test Coordinator: – Communicate with the Principal and System Test Coordinator about a possible testing irregularity – System Test Coordinator will provide guidance regarding investigation if necessary – Statements should be provided by all parties involved in the irregularity – Return all documentation to the System Test Coordinator 69

70 Steps for Reporting an Irregularity System Test Coordinator: – Collect Testing Irregularity Forms and documentation, if needed, from School Test Coordinators – Documentation may include statements from parties with knowledge of event, list of students involved, copies of training logs, etc. – Compile documentation and submit portal entry for each incident – Notify the Assessment Specialist in the Assessment Administration Division to determine appropriate coding for student answer documents – Know your system’s protocol for cases that may constitute a breach of the Code of Ethics... Systems typically have defined investigation protocols for such instances 70

71 Characteristics of a Quality Investigation Examiner must notify Principal and School Test Coordinator of incident School Test Coordinator must notify System Test Coordinator Request detailed written statements from all parties involved if necessary – Follow up on details (“connect the dots”) Follow district procedures regarding alleged misconduct 71

72 Characteristics of a Quality Investigation Provide a written summary of incident and investigation findings – Consult with GaDOE as needed. System Test Coordinator is responsible for reporting to GaDOE Note: – Report to GaDOE immediately, before investigation – Final documentation should be entered into portal 72

73 When entering irregularities into the MyGaDOE Portal... Provide comments in the “Comment” section to help elaborate on the irregularity (or in the “Reason for Invalidation” section if applicable) Please include in the comments the Form # in question (if applicable) If it has been determined that the irregularity will result in invalidation – make sure to indicate “Yes” in that drop-down box Names of students and their GTIDs must be provided Upload statements and other documents that provide necessary details on the event. Make sure you indicate the correct “Assessment Cycle” (Date) in that field In an event that involves multiple students – some of whom may be IR and some who may be IV, please enter them as two separate records 73

74 Importance of Training Materials Throughout the testing administration, please refer to the following resources: – Student Assessment Handbook – Examiner’s Manuals – Test Coordinator’s Manuals – Accommodations Manual Read again, even though you may have read before. Directions do change and these are standardized tests. 74

75 Post Administration 75

76 Irregularities – Post Testing Make certain that all irregularities and invalidations are documented correctly before sending scorable documents Make certain that online test irregularity forms have been finalized Communicate to school personnel the GaDOE responses to irregularity forms and consequences of irregularities, invalidations, and participation invalidations If appropriate, refer to PSC for investigation 76

77 Collecting Materials In a supervised setting, at the conclusion of testing: – The School Test Coordinator... Conducts, coordinates, and supervises inspection of all completed answer documents for the following purposes only: to ensure that student demographic and identification information is accurate, that necessary coding/labeling is complete, and that documents are in good condition for scanning. (If there is concern about some form of damage, stain, tear, etc., please contact GaDOE Assessment to discuss.) – Count the answer documents and test booklets to account for the appropriate number – Check to make certain there are no answer documents left in the test booklets – Unnecessary handling of answer documents must be avoided – The timely return of answer documents ensures a timely return of scores 77

78 Returning Scorables and Nonscorable Materials Arrange for pickup of test materials. Refer to Test Coordinator Manual regarding pickup protocols Make certain that there are no documents left in the schools or district offices and that all documents are accounted for All materials should be in the proper order as explained in the Test Coordinator Manuals 78

79 Transferring Student Test Scores It is the responsibility of local school systems to ensure that test scores become a part of students' records as soon as possible after testing, and that such records follow students to their new schools 79

80 Dissemination of Test Scores Results for individual students are critical for certain grades and subjects Initial test results are released on the department’s secure portal, MyGaDOE, or through Pearson Access – To have access to these downloadable roster reports and data files, it is imperative that System Test Coordinators acquire a login and password Requests for data from other personnel in the system (e.g. principals, teachers, parents, etc.) will be directed to the System Test Coordinator Individual student reports, rosters, school level summary reports, and system level reports are made available to districts via printed copy 80

81 Interpretation of Scores Score Interpretation Guides are available for each program – Found on each program website. Over interpretation should be avoided – Remember, each program is built to serve a specific purpose; interpretation must be made in light of those purposes 81

82 State Board Rules The most current rules below can be found on the GaDOE web site at the following link: Education/Pages/PEABoardRules.aspx Education/Pages/PEABoardRules.aspx State Board Rules relating to assessment include: 160-3-1-.07 Testing Programs – Student Assessment 160-4-2-.11 Promotion, Placement, and Retention 160-4-2-.13 Statewide Passing Score 160-1-3-.09 Waivers and Variances of High School Graduation Assessments 160-4-2-.31 Hospital/Homebound (HHB) Services 160-4-2-.34 Dual Enrollment 160-4-2-.46 High School Graduation Requirements (1997-1998) 160-4-2-.47 High School Graduation Requirements (2002-2003) 160-4-2-.48 High School Graduation Requirements (2008-2009) 160-4-5-.02 Language Assistance: Program for English Learners 160-4-8-.12 Alternative/Non-Traditional Education Programs 160-5-1-.07 Student Data Collection 160-5-1-.14 Transfer of Student Records 160‐7‐1‐.01 Single Statewide Accountability System 82

83 Assessment Online Forms Superintendent’s Certification Form January – June: Submit no later than July 31 July – December: Submit no later than January 31 Testing Irregularity Form Rescore Request Form (Please email/call appropriate Assessment Specialist as well) Special Administration Request Form – In addition, these requests require a letter from the System Superintendent outlining rationale for the request. – Remember that special administration requests for the GHSGT and GHSWT should be rare and only requested for extraordinary circumstances as defined in the Student Assessment Handbook. 83

84 Assessment Online Forms Special Administration Request – STC > Superintendent > GaDOE Assessment Rescore Request – STC > GaDOE Testing Irregularity – STC > GaDOE Superintendent’s Test Certification – STC > Superintendent > GaDOE 84

85 Assessment Online Forms See the Online Forms QuickStart Guide on the Assessment and Accountability home page. 85

86 Ethics and Assessment 86

87 Ethics and Assessment The highest form of ethics is doing the ethical thing when no one is watching. 87

88 Ethics and Assessment Ethical conduct on the part of educators and students is one component of assessment that assures that a test is valid for the purpose for which it is used. 88

89 A good testing program provides critical information to: ¤ Students¤ Parents ¤ Teachers¤ School and System ¤ Community Members ¤ Administrators The integrity of the assessment process is critical to all we do as educators. 89

90 CODE OF ETHICS FOR GEORGIA EDUCATORS Revised 2009 The Professional Standards Commission (PSC) adopted a revised Code of Ethics for Georgia Educators in July 2009. The PSC also adopted a hierarchy of consequences, recommended by System Test Coordinators, that is published on their web site at 90

91 Code of Ethics Guidelines for Student Assessment on Georgia Professional Standards Commission website: _Assessment_in_Georgia_Schools.pdf 91

92 Standard 11: Testing - An educator shall administer state-mandated assessments fairly and ethically. Unethical conduct includes but is not limited to: 1.committing any act that breaches Test Security; and 2.compromising the integrity of the assessment. 92

93 Test Security Reminders Be thoroughly familiar with the Student Assessment Handbook and test administration manuals Thoroughly train everyone involved in testing Make everyone in the school/system aware of the importance of security and the consequences of violating security, including students, parents, community, custodians, cafeteria personnel, bus drivers Follow all protocols Report problems in a timely manner – Including referrals to PSC – Principal’s Certification Form is required after each administration and must be maintained by the System Test Coordinator for 5 years 93

94 Test Security Reminders Advanced planning is necessary Solid logistical procedures must be in place Secure storage before, during, and after must be present Clear and concise communication about roles and responsibilities Documented training Loss of test booklets, answer documents, and/or any other secure materials constitute a breach of test security that can result in a referral to PSC 94


96 CRCT: Top Topics The CRCT will assess student knowledge in the CCGPS in reading, English/language arts, and mathematics and the GPS in science and social studies. Revised Test Content Descriptions, Test Content Weights, and Study Guides for Reading, ELA, and mathematics will be available on the CRCT website in fall 2012. Science and Social Studies Test Content Descriptions, Test Content Weights, and Study Guides will remain unchanged. Grades 1 and 2 will not be assessed. The CRCT Enrollment System will be available Dec. 13- Jan. 14. Timely and accurate information is critical for shipping, scoring, and reporting. 96

97 CRCT-M: Top Topics IEP Teams must evaluate all students who achieved “Basic Proficiency” on the CRCT-M in 2012 to determine whether or not the student should remain on the CRCT-M. All IEPs must contain evidence to support assessment placement. If the student has participated in the CRCT-M for one year and achieved “Basic Proficiency”, the IEP team should review other evidence such as national and local tests that the district administers, class tests, and other student work. After consideration of all evidence, the IEP team determines the appropriate assessment for the student (CRCT or CRCT-M) and documents the decision in the IEP. If the student has participated in the CRCT-M for two (2) consecutive years and earned a Basic Proficiency score on a content area CRCT-M in each of those years, they are ineligible to participate in the CRCT-M in that content area in 2012-2013. The performance of these students indicates that they are ready to take the general assessment (CRCT). The CRCT-M Enrollment System will be available Dec. 13- Jan. 18. Timely and accurate information is critical for shipping, scoring, and reporting. Make certain that your schools administer the proper assessment to students! Participation Guidelines to assist IEP teams appears at: 97

98 EOCT: Top Topics CCRPI Index – The EOCT is now Georgia’s high school accountability assessment, and will be included in the department’s new CCPRI Index New EOCT test - CCGPS Coordinate Algebra available Winter 2012 Field Test Items – Math II and Coordinate Algebra EOCTs will contain field test items that are aligned to the CCGPS Lexile Scores – Lexiles scores will be reported on the back of ISR’s for 9 th Grade Literature and American Literature On Demand Rosters – Available for online testing only; a preliminary report for online testing that can be requested at any time by a test administrator during the testing administration once a student/class completes testing Staggered delivery of testing materials – Three test delivery dates scheduled to coincide with the opening of district testing windows Storing of local scanning documents – Answer Documents should be returned during a defined window at the conclusion of the state testing window 98

99 Student Participation in the EOCT As noted in the 2012 – 2013 Student Assessment Handbook: “ If a student is not present for an EOCT administration (main or mid-month), the system may issue an Incomplete and allow the student to test during a future testing window (main or mid-month). This Incomplete may remain as the student’s course grade until their testing requirement is fulfilled. If, after attempts have been made to have the student test in a future window, the student does not take the EOCT, the course grade shall reflect that the student did not participate in the test. The system may issue a zero as 15% or 20% (dependent upon date first enrolled in grade nine) of their final grade. There should be sufficient documentation to indicate the student was notified of testing opportunities and did not participate. The EOCT is Georgia's assessment utilized for federal high school accountability. As a result, systems must provide for the participation of all students in conclusion of an EOCT course (with the exception of retest administrations in which participation is not required).” Review the EOCT section of the 2012 – 2013 Student Assessment Handbook for further details on this topic. 99

100 EOCT Scheduling Parameters The following are some examples of scheduling options for the EOCT: One-day administration: All students take Biology/Section I in a morning session and Biology/Section II in an afternoon session or All students take both Biology/Sections I and II in one session that is divided by the break (5 minutes) as prescribed in the Examiner’s Manual. Two-day administration: All students test Biology/Section I on Monday and Biology/Section II on Tuesday during scheduled class periods. Block scheduling: All students take Biology/Section I on Monday and take Biology/Section II on Tuesday using a two-day administration or “Group A” takes Biology/Sections I and II on Monday and “Group B” takes Biology/Sections I and II on Tuesday, using a one-day administration. Systems may elect to test by subject or by period following a typical exam schedule that conforms to the guidance above. Allowing flexibility in the scheduling of the EOCT, to meet the variety of school schedules that exist, is dependent upon everyone involved in the administration protecting the integrity of the program. Review the EOCT section of the 2012 – 2013 Student Assessment Handbook for further details on this topic. 100

101 ACCESS for ELLs: Top Topics Maintain a file of examiners who have earned scores of 80% or higher on the domains of ACCESS for ELLs that they will be responsible for administering in 2013 – Remember, examiners must re-certify on an annual basis. Monitoring Training of Examiners – No changes to usernames and passwords – The online course becomes available October 15 (including the Test Administrator’s Manual) Closely monitor the number of English learners (ELs) in your systems to ensure an accurate order of materials in December Be prepared to provide the number of ELs who can not participate in one or more domains due to a severe cognitive disability designation (Alternate ACCESS) Return shipping labels and instructions for returning materials are included with shipment of materials, in January The state testing window for ACCESS is six-weeks in length – and systems may utilize the entire window as needed. 101

102 GAA : Top Topics The GAA will reflect the CCGPS beginning in fall of 2012. The high school GAA will assess standards that derive from the Access courses taken by students with significant cognitive disabilities. Revised blueprints, resulting from the CCGPS transition in 2012-2013, are posted to the GaDOE GAA Resources webpage. This includes a blueprint specific to high school retesters. For high school mathematics, students may be assessed on standards from an integrated course or discrete courses. This will be dependent upon the courses taught by the local system. Retest opportunities began during the 2011–2012 school year for high school students who did not earn a proficient score in one or more content areas. Student work becomes secure test material once it has been placed in the assessment binder as a piece of evidence. Only original evidence scored. The required Validation Form must be completed and signed by both the person submitting the portfolio and the building administrator. Return shipping labels and instructions for returning materials are included with shipment of materials, in February. 102

103 GHSGT: Top Topics The process of phasing-out the GHSGT continues: Students who entered grade 9 for the first time between July 2008 and June 2011 may apply a passing score on one of their two subject-area EOCT in lieu of a passing scores on the corresponding subject-area GHSGT. Students who entered grade 9 for the first time prior to July 2008 must still pass each subject-area GHSGT to be eligible for a Georgia diploma. Summary reports are not provided following the spring administration. 103 ELAMathScienceSocial Studies GPS—20,138GPS—31,318GPS—23,088GPS—85,014 GPS/QCC—32QCC—933GPS/QCC—654GPS/QCC—573 Number of GHSGT Spring 2012 Tests Scored Statistics and careful analysis of individual test records should be made prior to ordering materials

104 Writing: Top Topics All students still must pass the Georgia High School Writing Test (GHSWT) to be eligible for a Georgia diploma. GHSWT main administration is on Wednesday, October 3, 2012 with the make-up administration on Thursday, October 4, 2012. SchoolHouse will again be available for ordering materials for the Grade 8 Writing Assessment (beginning October 1, 2012) and Grade 5 Writing Assessment (beginning November 19, 2012). The spring GHSWT will be ordered beginning Nov. 19, 2012 through SchoolHouse. New in 2012 – 2013: the Grade 3 Writing Assessment will no longer assess Response to Literature in keeping with the expectations of the CCGPS. Student performance data for the Grade 3 Writing Assessment will continue to be collected using the online web-based application. Training on the web-based application will be provided via webinar in late January 2013. 104

105 OAS: Top Topics The Georgia OAS will be available for districts to use on August 13, 2012. Details, including reporting features, will be discussed in upcoming webinars. ELA and Mathematics items have been cross-referenced and “tagged” to the corresponding CCGPS standard. New resources, such as replacement assessments for the previously existing benchmarks/frameworks in Reading/ELA & Math and the new Formative Item Bank, will be deployed over the course of 2012 – 2013 and beyond. 105

106 NAEP: Top Topics The National Assessment of Educational Progress (NAEP) collects data about what students know and can do in a variety of subjects. Participation in NAEP is required by federal and state law. Schools and students are sampled by NCES to represent national and state demographics. Assessment is administered by contracted team. Scores are calculated and reported for states and selected districts only. 106

107 GKIDS: Top Topics Teachers should contact the school coordinator first and then the system test coordinator for assistance with GKIDS. Teachers should enter student information into the website in a timely manner. Students who transfer from a school/classroom should be released through the GKIDS website so they can be acquired by the new teacher. GTID issues should be addressed with the school student database contact and/or the GaDOE Technology Services Division. There is not a required baseline or end of year summary of required elements. Teachers are responsible for students’ end of year reports prior to the end of the administration window in May. A mid-year data file will be available in January 2013. 107

108 Evaluation Link 108

109 Questions? 109

Download ppt "System Test Coordinators’ Fall 2012 Conference General Session Assessment Division Recording Link (8/3/12):"

Similar presentations

Ads by Google