Presentation is loading. Please wait.

Presentation is loading. Please wait.

ACCESS for ELLs ® Tier Placement, Test Security, and Score Reports Emily Evans, Center for Applied Linguistics January 2007 New Jersey Department of Education.

Similar presentations


Presentation on theme: "ACCESS for ELLs ® Tier Placement, Test Security, and Score Reports Emily Evans, Center for Applied Linguistics January 2007 New Jersey Department of Education."— Presentation transcript:

1 ACCESS for ELLs ® Tier Placement, Test Security, and Score Reports Emily Evans, Center for Applied Linguistics January 2007 New Jersey Department of Education Developed by the Center for Applied Linguistics

2 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 2 Workshop Goals To review appropriate tier placement for students taking the ACCESS for ELLs ® test To be equipped to handle test operations, such as test security To understand and begin to interpret ACCESS score reports

3 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 3 Workshop Objectives (1) To review roles of staff in administering the ACCESS for ELLs ® test To learn the guidance for placing students in tiers (A, B, C) of the ACCESS for ELLs ® test To understand test security procedures How to draft district and school security checklists

4 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 4 Workshop Objectives (2) To understand and interpret ACCESS for ELLs ® score reports Domain, Raw, Scaled, Oral Language, Literacy, Comprehension, and Overall (Composite) Scores Parent/Guardian Report Teacher Report Student Roster Report School Frequency Report District Frequency Report To explore the WIDA Can Do Descriptors To discuss programmatic implications of ACCESS results

5 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 5 Roles & Responsibilities

6 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 6 Roles and Responsibilities (1) District Assessment Coordinator Serves as main contact with MetriTech, Inc. Takes Inventory of materials immediately upon arrival and places them in locked storage. Prepares list of grades to be tested in each school, list of testing materials required by each school, and testing schedule of each school Coordinates ordering and distribution of test materials to the schools and returning of test materials to MetriTech Takes inventory of materials distributed and returned Responsible for training School Assessment Coordinators & Test Administrators on test administration and security Anticipates and answers questions from school assessment coordinators at your schools

7 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 7 Roles and Responsibilities (2) Test Coordinator (at school-level) Takes inventory of boxes immediately upon their arrival from the District Assessment Coordinator Verifies that there are enough testing materials Requests additional needed testing materials from MetriTech if necessary Coordinates and distributes test materials in your school; Takes inventory of materials that are returned to District Test Coordinators Reminds Test Administrators that all test materials are to be kept secure and confidential

8 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 8 Roles and Responsibilities (3) Test Administrators Complete online training course and certification through Desire2Learn system (www.uwosh.edu/d2l)www.uwosh.edu/d2l Become familiar with procedures in Test Administration Manual for test accommodations for ELLs with disabilities Fill out the demographic student information on each test booklet (if pre-ID labels were not ordered) Administer the components of ACCESS for ELLs® for which you are certified (Kindergarten/Group Components/Speaking)

9 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 9 Tier Placement

10 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 10 Importance of Tier Placement Appropriate tier placement maximizes the accuracy and validity of the ACCESS for ELLS ® test results.

11 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 11 Grade Level and Tier K 1-2 3-5 6-8 9-12 A (adaptive – no tiers) A B C 100 (roll-out Spring 2005) 101 (roll-out Spring 2006) 102 (roll-out Spring 2007) Listening group admin, machine scored Reading group admin, machine scored Speaking individual admin, adaptive, TA scored Writing group admin, rater scored Domains Series Structure of ACCESS for ELLs ® Test 1 Kindergarten form + (4 grade level clusters x 3 tiers) = 13 test forms Each letter represents one tiered test form

12 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 12 Tier Alignment with Proficiency Levels ENTERINGBEGINNINGDEVELOPINGEXPANDINGBRIDGING 12345 ACCESS for ELLs ® Annual ACCESS for ELLs ® Tier A Tier B Tier C

13 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 13 Tier Placement Guidelines Use previous test scores, if available Use teacher judgment, if available Keep in mind that 70-80% of students will take Tier B Use reading/writing levels over oral skills When in doubt, place the student in the higher tier At intake use W-APT or equivalent English language proficiency test

14 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 14 Tier Placement Rule of Thumb Assign an ELL the Tier B test unless you have compelling evidence that items in this tier, given their intended proficiency level, would be way too hard or way too easy for the student. TIER B is appropriate for most ELLs - those who: have social language proficiency and some, but not extensive, academic language proficiency in English OR have acquired some literacy in English, though have not yet reached grade level literacy.

15 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 15 Profile 1: Fatima Fatima shows developing language skills in most classroom subjects. Despite her academic interests, she is not yet approaching grade-level literacy in the core content areas. Which tier is most appropriate for Fatima? Tier B

16 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 16 Profile 2: Mohammed Mohammed is in his first year of instruction in English. He is comfortable with basic conversations outside the classroom, but struggles with even low-level reading tasks. Which tier is most appropriate for Mohammed? Tier A

17 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 17 Profile 3: Esther Esther is approaching grade level literacy in the core academic content areas. Her teacher feels she will likely meet the states exit criteria for ELL support services by the end of the academic year. Which tier is most appropriate for Esther? Tier C

18 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 18 Profile 4: Lily Lily shows developing proficiency in academic English, but does not yet reach grade level. She seems comfortable interacting with her monolingual English-speaking peers. Lilys teacher characterizes her as a beginner. Which tier is most appropriate for Lily? A/B line Tier B

19 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 19 Profile 5: Byung Byungs intake tests reveal expanding oral skills in English, as well as grade- level literacy in his native language. His English reading and writing skills are lower. A portfolio of his work provides evidence that his literacy skills are not yet on grade level. Which tier is most appropriate for Byung? B/C line Tier B

20 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 20 Ordering Test Materials

21 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 21 New Jerseys Testing Window Task Start DateEnd Date Duration (Days) Test Ordering02/01/0702/28/0728 Pre-ID Ordering02/01/0703/07/0735 State Receives Test Materials03/26/07 1 Test Window04/16/0706/01/0747 Additional Materials Deadline 05/18/07 Districts Ship Completed Material to MT06/11/07 1 Reports Shipped to State08/10/07 1

22 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 22 Ordering Test Booklets Test booklets are ordered from MetriTech online at www.metritech.com/wida. www.metritech.com/wida You will be asked to log on. Use the ID wida and the password access. Carry out the following step-wise procedure: Select your state Select your district Verify the contact information for the district facilitator who will receive the booklets Enter the number of test booklets by grade level and tier for each of the schools within the district Submit the order

23 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 23 Booklet Ordering Screens (1) Select your state Select your district Verify your contact information and shipping address

24 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 24 Booklet Ordering Screens (2) For each school, indicate the number of booklets for each grade level cluster and tier.

25 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 25 Booklet Ordering Screens (3) When your order is completely specified, click on the ORDER button, verify your order, and then submit it. When you verify your order, click on the SUBMIT ORDER button to send your order to MetriTech.

26 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 26 Pre-ID Labels for Test Booklets Pre-printed ID labels for test booklets are available from Metritech. Call 1-800-747-4868 or email wida@metritech.com to get ordering procedures. wida@metritech.com Only designated district facilitators can order labels. ID labels are not automatically included with a booklet order. Prepare a text or Excel file with pertinent demographic information for each student. Format the file appropriately so it can be computer read. (MetriTech will supply instructions.) If you do not order pre-id labels, the test administrator must bubble-in the front and back covers of each test booklet with relevant student data.

27 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 27 Maintaining Test Security

28 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 28 Materials Received by the District District Packing List Each schools Packing List Your states schedule Test Administration Manuals (1 per set of 20 test booklets) Test Administration Scripts and Speaking Test Picture Cue Booklet/Script (1 per set of 8 booklets ordered per grade-level cluster) 10% overage of Listening, Reading and Writing test booklets Pre-ID labels and return instructions

29 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 29 District Procedures Upon Receipt of Test Materials Locate and verify district and school packing lists (in Box 1). Divide materials by school. Note discrepancies between the Packing List and material received; record on the Documentation of Materials Not Returned form; fax this form to MetriTech (217-398-5798). Deliver the test assessment materials to the School Assessment Coordinator. Create sign-in and sign-out forms for test materials (see sample on next slide). Order additional materials if necessary using the Additional Materials form; fax this form to MetriTech (217-398-5798).

30 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 30 Sample District Security Checklist (Part 1) DIRECTIONS: The District Test Coordinator must be sure that the School Test Coordinator has signed the Agreement to Maintain Confidentiality before issuing secure test materials. The School Test Coordinator must sign the District Security Checklist form when secure test materials are issued. The School Test Coordinators signature confirms that he/she has received the materials listed below and that he/she will require test administrators to sign the school security checklist and the Agreement to Maintain Confidentiality before issuing secure test materials. School Test Coordinator Signature: ___________________ Date: ___________________________________________ NOTE: The District Test Coordinator should keep a copy of all signed forms, including the agreements to maintain security, the District Security checklist, and the School Security checklist. The School Test Coordinator should keep one copy of all completed forms and return the original to the District Test Coordinator with the secure test materials.

31 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 31 General Security Guidelines Only test facilitators, coordinators, and test administrators (or other authorized staff) may handle secure test materials. Place all secure materials in locked storage. Do not leave materials unattended before or after testing. Do not share any specific test information with students prior to or after testing. Do not copy any test booklets or other secure materials.

32 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 32 State/District Security Provisions

33 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 33 Sample District Security Checklist (Part 2) GradeMaterials# of copies KindergartenTest Booklets Administrators scripts 1-2 Tier ATest Booklets Administrators scripts 1-2 Tier BTest Booklets Administrators scripts 1-2 Tier CTest Booklets Administrators scripts 1 -2Speaking Tests

34 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 34 Materials for Each School School Packing List Grade/Tier Header Sheets Documentation of Materials Not Returned form District and School Test Administration Manuals (1 per set of 20 test booklets) Speaking Tests for each grade-level cluster; Listening, Reading and Writing test booklets and scripts for each grade cluster & tier tested

35 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 35 School Procedures Upon Receipt of Test Materials Divide test booklets into groups for each scheduled testing session. Test booklets may not be distributed prior to testing session Students must use Number 2 pencils; the scanning equipment used to score answer documents will not read anything but Number 2 pencil marks. Place pre-ID labels containing the student demographic information in the box on the front cover of the test booklet. If pre-ID labels were not ordered or if any label contains incorrect information, the student demographic information must be filled in by hand; school test coordinator will give District Code number and School Code number to test administrators.

36 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 36 Sample School Security Checklist (Part 1) School Security Checklist ACCESS for ELLs ® Check List Spring 2007 District:________________ School:___________________ DIRECTIONS: The School Test Coordinator must make sure that the test administrator has signed the Agreement to Maintain Confidentiality before issuing secure test materials. The test administrator must date and sign this form when secure test materials are issued. The School Test Coordinator must sign this form when secure test materials are returned. NOTE: The School Test Coordinator should keep one copy of all completed forms and return the original to the District Test Coordinator with the secure test materials.

37 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 37 School Security Checklist (Part 2) GradeMaterials# of copies Receiving Test Administrators Signature Date & Time Received School Test Coordinators Signature Date and Time Returned KindergartenTest Booklets Administrator scripts 1-2 Tier ATest Booklets Administrator scripts 1-2 Tier BTest Booklets Administrator scripts

38 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 38 Score Reports

39 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 39 ACCESS for ELLs® Interpretive Guide The ACCESS for ELLs ® Interpretive Guide for Score Reports (M. Gottlieb, April 2006) contains detailed information on the use of scores from this assessment. Recommendation: Download the full document (34 pages) from www.wida.us.

40 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 40 ACCESS Component Test Weights as Percentage of Overall Composite Score

41 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 41 Scores Received: Student Level Each student receives a scale score and a proficiency level for: Listening Speaking Reading Writing Scale scores are out of a possible 100 – 600 Scale scores are converted to proficiency scores using the cuts established during standard setting Proficiency level scores range from 1.0 – 6.0

42 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 42 Scores Received: Student Level (contd.) Each student also receives a scale score and a proficiency level for Oral Language, Literacy, Comprehension, and Overall Composite.

43 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 43 ACCESS for ELLs ® Score Reports There are 5 ACCESS Score Reports: Teacher Report Parent/Guardian Report Student Roster Report School Frequency Report District Frequency Report

44 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 44 What does the Teacher Report tell us? The Teacher Report contains individual data for one student.

45 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 45 Teacher Report Report for one individual student

46 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 46 Teacher Report (contd.)

47 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 47 Teacher Report (contd.) Raw Scores by Standard

48 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 48 What does the Parent Report tell us? The Parent Report, like the Teacher Report, contains individual student data.

49 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 49 Interpretive Guide and Parent/Guardian Report Translations available on the WIDA website (www.wida.us)www.wida.us Special thanks to Milwaukee and Wausau Public Schools for several of the translations! Parent Report

50 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 50 Parent Report (contd.) The Parent Report is currently available in: Amharic Bosnian-Croatian Creole French Gujarati Hmong Korean Lao Polish Portuguese Russian Serbian (Cyrillic) Somali Spanish Swahili Traditional Chinese Urdu More translations coming soon!

51 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 51 Parent Report (contd.) May 2006 Dear Parent or Guardian, This past winter, ELL students in grades kindergarten through twelfth grade participated in the administration of the ACCESS for ELLs ® language proficiency test. ACCESS now provides a standardized measurement of academic language proficiency for English Language learners (ELL) students throughout the state of Wisconsin. With this information, we will also be able to monitor individual ELL student progress on an annual basis. Enclosed you will find your childs results on ACCESS. The Parent/Guardian Reports provides information about your childs English Language Proficiency Level. This information is for you to review and keep. If you have any questions regarding these tests or the information that is being sent to you about how your child did on these tests, please contact your childs ELL teacher, building principal, or me. Sincerely, __________________________________ (School ELL coordinator, principal, or teacher) Parent letter template in English, Spanish, and Hmong that the school can customize - available at www.wida.us

52 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 52 What does the Student Roster Report tell us? The Student Roster Report lists the scale scores and proficiency levels for a group (or class) of students.

53 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 53 Student Roster Report

54 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 54 What does the School Frequency Report tell us? The School Frequency Report lists the numbers of students tested in each domain of ACCESS by grade level within a school.

55 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 55 School Frequency Report

56 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 56 What does the District Frequency Report tell us? The District Frequency Report lists the numbers of students tested in each domain of ACCESS by grade level within a district.

57 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 57 District Frequency Report

58 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 58 Kindergarten Scores The maximum Overall (Composite) English language proficiency level that a student taking the Kindergarten form of ACCESS for ELLs® can receive is 3.4.

59 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 59 Performance Definitions At this level, English language learners process, understand, produce or use:

60 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 60 Can Do Descriptors Listening For the given level of English language proficiency level, English language learners can:

61 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 61 Can Do Descriptors Speaking For the given level of English language proficiency level, English language learners can:

62 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 62 Can Do Descriptors Reading For the given level of English language proficiency level, English language learners can:

63 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 63 Can Do Descriptors Writing For the given level of English language proficiency level, English language learners can:

64 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 64 How do we use this information? Standards-based results help inform curriculum, instruction and assessment of ELLs The Overall Composite Score summarizes students global language proficiency Domain subscale scores allow for examination of strengths and weakness by domain Raw scores by standards allow for examination of strengths and weakness by content area language Individual report components offer a starting point for differentiating instruction and assessment Writing and Speaking Rubrics in Interpretative Guide - criteria within rubrics scaffold across the levels of language proficiency and may be used in assessing classroom tasks and projects throughout the year

65 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 65 Programmatic Implications (1) If its appropriate to exit the student from ELL services? Does this student have the language skills necessary to access the content in the mainstream classroom without additional language support services? What additional evidence is needed to make a determination? If the students English proficiency is weak in a particular language domain (e.g., Writing)? If the students English proficiency is weak in a particular standard area (e.g., the language of Social Studies)? If so, consider additional content language support. High scores (Levels 5-6) may indicate a need for Monitoring or Targeted Support. School teams should consider:

66 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 66 A balanced, long-term approach that focuses on grade-level academic standards and English proficiency standards, and utilizes strategies that increase comprehension and communication in English (e.g., sheltered instruction) Enhancement of both oral language and literacy development Providing L1 instruction (bilingual education) and/or support where feasible Programmatic Implications (2) Mid-level scores (Levels 3-4) may indicate a need for 1-3 more years of ELL support services. School teams should consider:

67 ACCESS for ELLs ® Tiers, Ordering, Security, and Score Reports 67 Providing targeted communicative / social & instructional English briefly Enrolling student in newcomer program if available and appropriate Using content-based strategies (e.g., sheltered instruction) and L1 instruction, if possible Scaffolding within programs and school Graphic support Peer support Supplemental and modified materials Programmatic Implications (3) Beginner level scores (Levels 1-2) may need 5 or 6 more years of ELL support services. School teams should consider:

68 For more information, please contact the WIDA Hotline: 1-866-276-7735 or www.wida.us/helpformwww.wida.us/helpform World Class Instructional Design and Assessment, www.wida.us Center for Applied Linguistics, www.cal.org Metritech, Inc., www.metritech.com Questions or Comments?


Download ppt "ACCESS for ELLs ® Tier Placement, Test Security, and Score Reports Emily Evans, Center for Applied Linguistics January 2007 New Jersey Department of Education."

Similar presentations


Ads by Google