Presentation is loading. Please wait.

Presentation is loading. Please wait.

District Test Coordinator Training PED Assessment Bureau January 2019

Similar presentations


Presentation on theme: "District Test Coordinator Training PED Assessment Bureau January 2019"— Presentation transcript:

1 District Test Coordinator Training PED Assessment Bureau January 2019

2 New Mexico Statewide Assessment Program
SBA Transition Math & ELA NMAPA Early Child. Obs. Tool (ECOT) EOCs & Precision Exams NAEP WIDA Istation SBA Science & Spanish Reading New Mexico’s Statewide Assessment Model Aligns to state adopted academic standards Produces results used to inform college and career readiness Undergirds the belief that all students can learn and achieve at high levels Holds schools and the PED accountable to create equity and opportunities for students

3 PED Presenters Lynn Vasquez Dr. Brigette Russell Kimber Sanchez
Director of Assessment Deputy Director of Assessment Kimber Sanchez Kirsi Laine Assessment Coordinator English Learner Specialist Karen Greer Dr. Steve DeLeon Adam Rios Project Coordinator

4 Spring 2019 Assessment Calendar
Istation ISIP Middle of Year (MOY): January 1 – 31 End of Year (EOY): May 1 – May 31 ACCESS January 14 – March 8 NAEP January 28 – March 8 (sampled schools only) SBA Science March 4 – 29 NMAPA March 11 – April 5 NMASR Field Test April 8 – April 26 (sampled schools only) Spanish Reading April 22 – May 10 Math & ELA Transition SBA EoCs & Precision Exams Last 3 weeks of the semester

5 Required Assessments & Student Participation
Federal and State Law require all students to participate Federal: ESEA; HR1, Title1, Part A, Subpart 1, Section 1111, (b), 3, C State of New Mexico: Section 22-2C-4 NMSA 1978 content/uploads/2017/12/CCRB_graduation_NMSA.22-2C- 4.Statewide.Assessment.and_.Accountabiity.System.pdf M (1) NMAC One exception: A student with a rare and unique condition that prevents him/her from receiving instruction may receive a medical exemption with PED approval. coordinator/

6 References for Training
DTCs are responsible for reading and understanding all appropriate rules, manuals, and other test administration materials. NMAC, Standardized Testing Procedures & Requirements (Filed December 7, 2018) The following manuals also apply: Test Coordinator Manuals (TCMs) Test Administration Manuals/ Directions for Administration (TAMs/DFAs) Accommodations Manuals

7 Student Right to Privacy
Family Educational Rights and Privacy Act (FERPA) Health Insurance Portability & Accountability Act (HIPAA) LEA staff should only use SSID numbers for transmitting communication. If a large volume of student information needs to be communicated, it needs to be sent by a secure mechanism: Accellion

8 Assessment Roles and Training Model
PED Assessment Bureau District Test Coordinator(s) School A STC, Principal Test Administrators, Proctors School B District Charter School Test Coordinator State Charter & State-Supported Institution Test Coordinator BIE Test Coordinator Superintendent Charter Admin. BIE Admin.

9 Special Thanks to Sarah Draughon, AAAC Member, Las Cruces

10 Superintendents, BIE Administrators, & State Charter Administrators
Sign to Designate District Test Coordinator Form Verify that procedures are followed correctly Sign Superintendent Verification form and send to PED twice per year

11 Public and Charter School Principals
Attend local trainings by DTC Verify that procedures are followed correctly Sign Principal Verification form and maintain at school/district for five years

12 DTC Leadership Responsibilities
Attends PED assessment trainings and provides local trainings Serves as primary liaison with PED and testing vendors Must be completely knowledgeable of NMAC Communicates assessment information to district, schools, parents, and community Develops District Test Security Policy or Checklist

13 DTC Test Administration Responsibilities
Inspects schools’ accommodations documents Ensures TAs and Proctors are certified, trained, and have signed Confidentiality Agreements Inspects schools to ensure secure storage of assessment materials and tracking procedures are followed Reports irregularities to PED and conducts investigations

14 DTC Post-Test Responsibilities
Works with STCs to ensure that: all students were tested all student data are complete and accurate all secure materials returned to vendors according to directions

15 PED Liaison Responsibilities
Works with PED to ensure: All required forms are submitted to PED LEA is responsive to Troubled Child Alerts Teachers have access to available resources for content area assessments LEA is kept up to date on assessment policy and guidance changes

16 Licensing Requirements for DTCs, STCs, and TAs
DTCs, STCs, and TAs must hold one of the following valid PED licenses: School Instructor Administrator School Counselor, Student Success Advisor, Educational Diagnostician, Interpreter for the Deaf, Rehabilitation Counselor, School Psychologist, School Social Worker, or Speech Language Pathologist

17 Substitutes as Test Administrators
Long-term substitutes holding a current PED license may serve as TAs. Short-term substitutes, educational assistants (EAs), school nurses, and coaches may not serve as TAs, unless they also have another valid license listed on the previous slide.

18 Test Mode All districts and charter schools are expected to test online for SBA Science and ACCESS. LEAs will flexibility in the Spring 2019 transition assessment for ELA and math. PED monitors paper orders and revokes orders not supported by a CBT waiver. Point of Interest: Math & ELA online trend across years: 2015: 92% tested online 2016: 97.3% tested online 2017: 97.8% tested online 2018: 98.8% tested online

19 CBT Scheduling Schools may create their own schedules
Within content areas, units must be administered in sequential order No specific order for content areas – may administer ELA or Mathematics first Students may alternate between content areas Schedule each unit/session within a grade/course as close together as possible.

20 PBT Scheduling Test sessions must follow order in the test booklet. (Make-ups may have exceptions.) All schools in district must follow same schedule. No testing on materials-packaging day. All materials must be returned on/by designated shipping day.

21 PBT Allowance A student may test PBT without a waiver if he or she:
has a disability that requires this accommodation is a transfer to the school within 3 months prior to testing and lacks adequate computer skills

22 TEST SECURITY

23 Why is Security Important?
Assessment data used for accountability and security maintains validity and accuracy Assessment items can be used to allow for year-to-year comparability Investments of public resources and time are protected Ensures that students receive no unfair advantages or disadvantages during testing

24 What is a Testing Irregularity?
Any incident in the handling or administration of a test that results in questioning the accuracy of the data or security of the test that leads to one of the following outcomes: Test remains valid Test or test attempt is invalidated and student may or may not retest

25 Examples of Common Test Irregularities
Actively monitor before, during and after testing to avoid irregularities Cell phones or other nonallowed electronic devices Student is sick and needs to leave during the test Starting a test without accommodations in place Students move past the current test session TAs deviate from administration directions or script

26 Security Reminders By Mode
Paper-Based Materials Security Computer-Based Test Security Must be locked and secured by STC/DTC Do not share user names or passwords. Daily chain of custody & accountability on test booklets and materials Ensure no student writing appears if reference materials are shared among sessions TAs sign out and check in materials before and after testing Sign out and check in secure testing tickets Saving or reproduction of test materials is prohibited Reviewing or taking images of monitor is prohibited Collect prohibited devices for students Monitor during the test

27 Computer-Based Test (CBT) Security
Prepare the room so that no student can view another student’s computer screen. Supervise students at all times. No cell phones or other unapproved electronic devices. No talking during testing. Do not share user names or passwords. Destroy used scratch paper at the end of the test. Follow all security policies and test administration protocols.

28 If a Testing Irregularity Occurs…
TA immediately reports test irregularity to STC. STC reports the irregularity to the Principal and DTC. Notify PED by telephone/ within 3 days. DTC conducts an investigation to determine whether incident is impactful or non-impactful. Does a student test need to be invalidated? Complete a PED Test Irregularity Reporting Form. the form within 10 days to

29 Irregularity Process START END
TA reports to STC STC Reports to DTC or Principal DTC Notifies PED within 3 days DTC conducts investigation; PED determines state action DTC submits Irregularity Form to PED within 10 days PED makes determination END

30 Corrective Measures Student: Student reprimands are handled at the local level. TA: TA reprimands may be handled at the local level. Depending on the severity, PED may refer the irregularity for investigation and possible action by the Licensure Bureau. Note: Unintentional testing irregularities that affect the validity of the assessment may also be investigated by PED.

31 Irregularity Reporting Form

32 Document Retention Keep Secure:
Paper forms and tickets should be locked and secured while in LEA/BIE possession. Keep for 5 years: Forms related to DTC training (e.g., Confidentiality, Superintendent Verification, Training verification sheets/sign in documents, Medical Exemptions, Testing Irregularity Forms, waivers) Destroy After Testing: Scratch paper, test tickets, formula sheets if they have writing. Return on Time: PED will be auditing schools/district with history of missing materials. Proper packaging of paper test materials and scorable forms is the responsibility of the district.

33 Missing Materials Loss of state test materials is a security breach.
TA must report missing materials to STC. DTC must also notify the vendor’s help desk and PED. Missing Test Materials Reporting Form:

34 PED Site Monitoring PED may visit a campus while testing to ensure proper test administration and procedures. Proper chain of custody documents are in place Identified secure storage area(s) Correct assignments of accommodations per IEP, 504, and EL plans

35 Participants are welcome to type questions into the chat box or email: ped.assessment@state.nm.us

36 ISTATION’S INDICATORS OF STUDENT PROGRESS

37 Istation’s Indicators of Progress (ISIP)
Assessment Program: Istation’s Indicators of Progress (ISIP) Required Grades: K-2 statewide At grade 3, Istation tests are required for Reads to Lead, RDA, and K3 Plus sites.

38 Istation Quick Links Istation Help Desk New Mexico Istation Website
READ (7323) New Mexico Istation Website (Locate state memorandums on Istation changes). (Locate PED memorandums on Istation changes; Levels 4 and 5 for profciency). Getting Started with Istation Istation Accommodations Istation Reporting and Management Website (Watch video on changes to from Tiers to Levels). Questions on PED Early Literacy initiatives Questions on PED Istation policies or

39 Istation’s Indicators of Progress (ISIP)
K–3 formative assessments available for measuring reading and are available in English and Spanish. Istation is required for students in K-2 for all New Mexico districts and charter schools. Schools participating in K-3 Plus conduct ISIP assessments at the beginning, middle, and end of the 25 or 20 day program.

40 Istation Use Above Grade 2
Grade Level Number of LEAs Percentage of LEAs 3rd 85 64.4% 4th 52 39.4% 5th 51 38.6% 6th 28 21.2% 7th 14 10.6% 8th 9th 4 3.0% 10th 11th 3 2.3% 12th 2 1.5% Overall, 63.6% of LEAs administer Istation outside of grades K-2.

41 ISIP* Reading | PreK - 3 Grade Subtest Kindergarten
Listening/Language Comprehension Phonological & Phonemic Awareness Letter Knowledge Vocabulary 1st Grade Phonological & Phonemic Awareness Letter Knowledge Vocabulary Alphabetic Decoding Reading Comprehension Spelling 2nd -3rd Grade Vocabulary Reading Comprehension Spelling Text Fluency

42 ISIP* Español | PreK - 3 Grade Subtest Kindergarten
Listening Comprehension Phonemic & Phonological Awareness Vocabulary Reading Comprehension 1st Grade Phonemic & Phonological Awareness Vocabulary Reading Comprehension Writing Component 2nd -3rd Grade Vocabulary Reading Comprehension Writing Component Receptive Fluency

43 Formative Assessments ISIP™ Teacher-Led Lessons & Tools
Istation Features Formative Assessments ISIP™ Professional Development Real-Time, Personalized Student Data Teacher-Led Lessons & Tools

44 ISIP Assessment Accommodations for Special Populations
Only administrators with manager accounts can assign accommodations to students in the Istation Report and Management Portal. 1. Special Devices Compatibility: Touch Screen Overlay: This USB touch screen can be applied to monitors. It acts like a standard pointing device. Istation is known to work well with touch screen overlays. Even a student using a head stylus can use this device. ZoomText Software: This software allows the user to zoom in to a very low screen resolution (so things look bigger) with automatic scrolling of the screen when the mouse is moved. 2. Other accommodations available for students on an IEP or 504 plan. Scribe color overlays sign language

45 ISIP Testing Features (non accommodations)
Computer-Adaptive Testing: ISIP is a computer-adaptive assessment that quickly adapts to each individual student response. A student will be given test questions within his or her ability range, regardless of age or grade. Review of Directions: ISIP assessments have an embedded review of test directions within the assessment and between subtests. Directions can also be narrated to the student in Spanish. Verbal and Visual Cues: ISIP assessments have embedded verbal and visual cues to aid students in staying on task. On-Demand Assessments: ISIP assessments can be given in addition to the automatic monthly assessment for more frequent progress monitoring or to validate results.

46 PED Changes to Tiers to Levels
What do I do? Recommend intensive intervention (targeted small-group interventions or one-to-one) Level 1 Recommend supplemental intervention such as targeted small-group interventions Level 2 Level 3 Recommend intervention for all students by differentiating instruction Delineation of top 3 levels serves as communication tool and can be used by teachers to differentiate core instruction Level 4 Level 5 Core classroom instruction for all

47 Istation Testing Window 2018-19 School Year
BOY August or September 2018 (Initial Attempt in the System) MOY January 2019 EOY May 2019 *The Literacy Bureau provided a list of K-3 Plus programs statewide so that Istation would know when to reconfigure the system so that K-3 Plus end of program results were not convoluted with BOY for school year results.  The reconfiguration date was August 10th.

48 ISIP Results Ability Score 90th % tile 240 220 200 180
Ability scores communicate how students performed on the monthly ISIP Assessment. Students who have the same ability score, regardless of grade, have similar ability levels. 240 220 200 180 160 140 120 1st Grade Student 225 3rd Grade Student 225 After students take the ISIP formative assessment, they receive an Overall Ability Score, as well as and Ability Score for each subtest. Istation’s Reading Ability Scores are used to measure a student’s skill level over time. Since ISIP is adaptive and the test questions are displayed based on student performance, not age or grade, identical ability indices across grades mean the same thing. For example, a first grader who receives a score of 215 and a third grader who receives a score of 215 are performing at the same level. National norms for ISIP Early Reading are provided for students in Pre-Kindergarten through Grade 3. These norms enable teachers and parents to know how their students' scores compare with a nationally representative sample of children in their particular grade. Much like a doctor uses a nationally normed height and weight chart at the doctor’s office, these percentiles give practitioners insight into the varying needs of students. For example, what would a doctor tell a mother if the child’s percentile rank in weight was very low compared to other babies the same age, and in fact the percentile was dropping over time? The doctor would tell the mother to add in some extra feeding times and also supplement with formula or other supplements. That is exactly what happens when a child is struggling in reading, we must add in extra time and different types of instruction to meet their needs and help them grow. Then, we must track that percentile rank change/growth over time to measure the effectiveness of the the extra support being given. 90th % tile 22nd % tile

49 Why are percentiles so important?
Percentiles can be used to: Plan for different levels of instructional support Set goals and track growth over time Monitor effectiveness of instruction Communicate with parents

50 ISIP Executive Summary Report Changes
  

51 Student Summary Handout Changes

52 Priority Report Changes
ISIP groups indicate difficulty on the test Other groups indicate difficulty in their personal learning path Ability to document interventions

53 Intervention Groups Documenting Priority Report to track progress
Now with the knowledge of Teacher Resources, and lessons to deliver, let’s go back to Priority Report to document interventions and make anecdotal notes.

54 Summary Report Changes
Classroom Summary Report Changes Provides data for assessment and instruction Helpful to form small groups Review as needed to group students

55

56 Science Standards Based Assessment (SBA) Spanish Reading SBA
New Mexico Assessment of Science Readiness (NMASR) Field Test

57 Agenda Measured Progress Spring 2019 Test Overview Science SBA
Spring Spanish Reading SBA NMASR FT Online Ordering SBA Paper-Based Testing Administration SBA PBT Packing, Returning, and UPS Pickup SBA Online Reporting SBA Help & Support Page Help Desk Contact Information Science Computer-Based Testing

58 Science SBA Spanish Reading SBA

59 Measured Progress Test Overview
Spring 2019 Science SBA: Grades 4, 7, HS Paper- and Computer-Based English Spanish Special PBT forms: Large Print, Braille Spring 2019 Spanish Reading SBA: Grades 3 – 8 & HS Paper-Based Only

60 Measured Progress Test Overview
Science SBA Practice Tests: Grades 4, 7, HS Computer-Based Practice Testing The practice tests will be available via desktop/laptop kiosk, mobile app, and browser. Paper-Based Practice Testing (downloadable files) English (one form per grade) Spanish (one form per grade) Print-Ready PDF file for regular booklets Print-Ready BRF file for Braille Print-Ready PDF file for Large Print Available at Help & Support Page:

61 Spring 2019 Science SBA Pricing and Key Dates
Science SBA Spring 2019 PBT: $18.93 | CBT: $13.74 Initial Ordering Window (Science PBT & CBT*) December 10 – January 18, 2019 (5pm MT) Science Spring 2019 SBA CBT Practice Test (non-kiosk based/single sign-on web-based) January 22 – March 29, 2019 (kiosk-based) January 22– February 8, 2019 Initial PBT Orders Arrive (TB, AD, Manuals (PBT and CBT), Pre-ID labels (PBT), Rosters) By February 15, 2019 Additional Ordering Window February 18 – March 28 (5pm MT) (Order materials no later than March 22!) Testing Window March 4– March 29, 2019 Pick-up Window All PBT Materials March 11 – April 5, 2019 Online Reports Available TBD Printed Paper Reports Arrive *Contact the PED with any CBT waiver requests prior to finalizing your online ordering!

62 Spanish Reading SBA Spring 2019
Spring 2019 Spanish Reading SBA Pricing and Key Dates Spanish Reading SBA Spring 2019 PBT $18.93 Initial Ordering Window January 28 – March 8, 2019 (5pm MT) Initial PBT Orders Arrive (TB, AD, Manuals, Pre-ID labels, Rosters) By April 8, 2019 Additional Ordering Window April 2 – May 9, 2019 (5pm MT) (Order materials no later than May 3!) Testing Window April 22 – May 10, 2019 Pick-up Window All PBT Materials April 29 – May 15, 2019 Online Reports Available TBD Printed Paper Reports Arrive

63 ONLINE OrDERING

64 Measured Progress Online Ordering http://iservices. measuredprogress
Contact the New Mexico Help Desk if you need your username or password! Click on Select “New Mexico” from the drop-down menu. Remember to have a Purchase Order number ready. Select “Order Test Materials” to begin order. Select “NM Spring 2019” Enter username and password. You have two different passwords: *Online Ordering *Online Reporting

65 Measured Progress Online Ordering SBA Purchase Orders and Invoicing
As in past years, districts are responsible for a portion of the cost for SBA testing. The districts’ per student cost for the school year administrations are: CBT: $13.74 per test scored PBT: $18.93 per answer booklet returned for scoring Under the new contract, PED continues with the policy that districts will only be invoiced for SBA tests scored (whether CBT or PBT). Schools/districts shall not be invoiced for partial or aborted tests The cost of each accommodated PBT form (e.g., large print or Braille) is the same as the cost for a non-accommodated test

66 PACKING OF PBT MATERIALS FOR RETURN, Ups pickup

67 Preparing PBT materials for return
Make sure to refer to the Test Coordinator Manual (TCM) pages for detailed directions on how to prepare and pack PBT materials for return A few reminders: If you tested online only, then there is nothing to return—you may shred/recycle your printed Test Administration Manuals (TAMs). Use the same shipping boxes to return the PBT materials. Do not return test materials that are contaminated with biohazardous materials such as blood or vomit. Do not return manuals or unused pre-ID labels—you may securely destroy unused ‘pre-ID’ labels. ALL paper test booklets and answer documents, even unused, must be returned. The total number of PBT materials received by the districts or schools should match the total number of PBT materials returned.

68 Spring SBA Administrations PBT Materials UPS Pickup Scheduling
Schedule UPS Pickup of the SBA PBT materials NM Online Services Page, choose UPS Pickup Request Select Administration Enter Return Service Label Tracking # Click Login You can schedule your pickup or hand off materials to your local UPS driver.

69 SBA Spring Administration PBT Materials UPS Pickup Scheduling
The address associated with the return service label will be pre-populated. If you need a pickup at a different location than what the label says, enter new information. Requests placed before 2:00 p.m. MT will be scheduled for the next business day. Requests placed after 2:00 p.m. MT will be scheduled for the second business day.

70 Online reporting

71 Online Reporting http://iservices.measuredprogress.org
Online reports are available for all SBA Administrations. Report Mode Student Report to Parents 2 printed copies and online Student Results Labels Printed copy only Student Roster Report Online Student Report to Teachers-by Subject Performance by Subgroup Category Report Item Plot Report District Summary Roster Student Results Data File Benchmark Data File

72 Student Reports to Parents available for fall 2018 retests
NEW! Student Reports to Parents available for fall 2018 retests Online Reporting Reports offered online for Science SBA, Spanish Reading SBA, Legacy Reading/Mathematics Fall Retest Administrations (HSCE & HSGA) HSCE Reports Counselor's Report Pass/Fail File Layout School Pass/Fail File Winter 2016 was last HSCE administration! SBA fall retests cover Science and Spanish Reading. HSGA reading and mathematics cover the Legacy Graduation Tests. Reports Student Results Data File Student Results Data File Layout Student Roster Report Student Reports to Parents

73 Online Reporting Reports are only available online except for Student Report Labels and Student Reports to Parents, which are printed and shipped to districts. All online reports can be accessed anytime and printed locally. Your user name is your District Code, or District & School Code. DTCs can call Measured Progress for a password, if needed. Your Online Reporting password is different than your online ordering password!

74 Online Reporting Select the Reporting Tab Select your Year
Summary Reports & Parent Reports are located at grade level. Select the Reporting Tab Select your Year Select your administration

75 Online Reporting Select the report you need
Then download! Select Choose to open or save your reports Static reports open as PDFs Data files open in Excel

76 Online Reporting http://iservices.measuredprogress.org
Supporting documents located on tab 3. Interpretive Guide to SBA for Schools and Districts SBA Assessment Standards and Frameworks SBA Performance Level Descriptors New Mexico Analysis and Reporting System User and Training Guide

77 New Mexico Assessment of Science Readiness (NMASR) Field Test

78 NMASR FT Overview Spring 2019 NMASR Field Test: Grades 5, 8, HS – Standalone FT Computer Based ONLY English Spanish Practice Test NM-ASR Practice Test: Grades 5, 8, HS Computer-Based Practice Testing Single user login credentials (same as SBA practice test) Link available at H&S Page:

79 NMASR FT Test Overview Schools were randomly selected for the NMASR Field Test. PED sent a communication to selected schools on Friday, November 30. Participation is required if your school was selected. Because this spring 2019 the NMASR is a stand-alone field test, selected schools will not need to order the materials. PED will provide a student pre-ID file for student demographic information that Measured Progress will upload to the iTester platform prior to the operational testing window.

80 Spring 2019 NMASR Field Test Key Dates
NMASR FT Dates Practice test available (browser single user logon) March 11 – April 26, 2019 Field Test Administration (online only) April 8 – April 26, 2019

81 SBA, NMASR FT Help and Support Page www. measuredprogress
SBA, NMASR FT Help and Support Page What’s New, Important Dates Guides, Manuals Test Administration Manuals Science SBA Practice Test PDF files Links to CBT Practice Tests for Science SBA & NMASR FT SBA reports samples, interpretive guides

82 Measured Progress New Mexico Helpdesk Contact Information Phone: for general questions for technical questions

83 Online TESTIng

84 2019 Spring Science Assessment CBT Training
Science SBA and Assessment of Science Readiness Field Test iTester™ William Kinnison, eMetric

85 Key Dates Spring 2019 SBA Science Test Milestones
SBA Practice Test Begins Portal Opens (manage users, download kiosks) 22 Jan 2019 New Mexico Science Assessment Portal closes to load spring operational Pre-ID 8 Feb 2019 New Mexico Science Assessment Portal opens for student data editing 19 Feb 2019 SBA test available to schedule 25 Feb 2019 SBA test administration window opens  4 Mar 2019 SBA test administration window closes SBA practice test closes 29 Mar 2019 New Mexico Science Assessment Portal closes (unless you are participating in the ASR SAFT)  3 Apr 2019 Spring 2019 Assessment of Science Readiness (ASR) Stand-Alone Field Test (SAFT) Milestones ASR SAFT practice test begins 11 Mar 2019 ASR SAFT available to schedule  1 Apr 2019 ASR SAFT test administration window opens   8 Apr 2019 ASR SAFT test administration window closes ASR SAFT practice test closes New Mexico Science Assessment Portal closes   26 Apr 2019

86 iTester™ New Mexico Science Assessment Kiosk:
Student Test Delivery System New Mexico Science Assessment Portal: Online Test Administration System This system will support the Spring SBA Science Assessment and the Assessment of Science Readiness Field Test

87 Test Preparation Process
1. New DTC accounts made, previous administration’s DTC accounts opened 2. DTCs create subordinate accounts for new users 3. New/current users confirm log-in Tech Coordinators Review Kiosk Installation Guide Download & install kiosk on test devices Conduct integrated Site Readiness Test Certify site is ready to test DTC/STC Add/Edit/Transfer Students Assign Accessibility Features and Accommodations Create classes Assign classes to tests (Test Sessions) DTC/STC/TA Review test session (Classes & Accommodations) Print Student Log-in tickets Students Launch kiosk Log-in and test At end of test… DTC/STC/TA If needed, add test report codes and invalidate tests

88 Orientation and New Features
New Mexico Science Assessment Portal: Online Test Administration System Orientation and New Features

89 User Accounts Portal Opens Jan 22, 2019
Not a DTC, don’t have an account? District Test Coordinators must create all other portal users within the Portal Users will receive automated with username and temporary password from Deactivate unused accounts immediately after portal opens! STC’s can view dashboard NEW! See on line video tutorials for demonstrations!

90 Yes for assigned test sessions
User Accounts DTC STC (for orgs assigned) ITC TA Manage Users Yes View TA Access Site Readiness Links No Access Proctor Password Access Students Access Classes Access Test Sessions Yes for assigned test sessions Download Test Completion Status Access Dashboard Invalidate Test

91 User Accounts Landing Page Proctor Password (DTCs Only) Admin Page

92 Students Students Loaded from State Pre-ID
2/1/2019 Students Students Loaded from State Pre-ID Available in Portal on Feb 19, 2019 Check student rosters Download roster by selecting “Download List” under the “More” drop down Add, un-enroll, or transfer students as needed Can’t add student? They may be enrolled in different school – contact help desk DTCs can transfer students between schools in their district Call help desk to transfer students between districts Assign accommodations You must assign all accommodations to students You can use the Export Accommodations button to download list of all students and their currently assigned accommodations You can use the Upload Accommodations button to upload accommodations to multiple students at one time Upload Accommodations button will not be available after test window opens! See on line video tutorials for demonstrations!

93 Students Changes on Student tab:
2/1/2019 Students Changes on Student tab: Added grades 5 and 8 to student information tab grade selector Student accessibility features and accommodations options have changed Line reader and answer masking are now universal tools (accessibility features available to all) – all students will automatically have access to this Allow Accessibility Mode – allows third party accessibility software to operate concurrently with the student testing kiosk Examples of devices: screen readers and speech-to-text software Test specific software to be used with iTester practice test and kiosk prior to student testing! Must enter proctor password to activate New layout on student accommodations tab NEW!

94 2/1/2019 Students

95 2/1/2019 Students Delivered within iTester Student Kiosk Must also schedule student for the Spanish version of the test

96 Classes Groups of one or more students who will take a test
2/1/2019 Classes Groups of one or more students who will take a test Separate class needed for English and Spanish Testers Classes cannot be deleted once they have been saved Students can be assigned to more than one class! When class grade is selected, only students in that grade will be available in the list of students NEW! Use this check box to prevent students from being assigned to more than one class

97 Test Sessions Preparing for and monitoring testing
2/1/2019 Test Sessions Preparing for and monitoring testing Schedule a test session (assign class to test) Check test name for language, grade (and SBA vs ASR if you participating the ASR field test) Go to the scheduled test session to: Retrieve Session Access Codes Review students in the test session Check student forms (TTS) Print test tickets with students’ usernames and passwords Ensure student has platform-delivered accessibility and accommodations on test ticket Monitor test sessions, download test session information Also the download test sessions summary feature. See online video tutorials for demonstrations!

98 Test Sessions Completing testing
2/1/2019 Test Sessions Completing testing Check student test status for tests “not started” or “in progress” For students who cannot complete the test: Invalidate each of the test sessions and Enter a test completion code When the test is both invalidated and a test completion code is entered, the test will not be reported If a test is inadvertently invalidated or a test report code is entered, the test can be reactivated and the test report code can be removed Note: Students can still log into a test regardless of the test invalidation or test report code Complete the above activities prior to the advertised portal closing date (April 3 for Spring 2019 SBA Science) No other action is needed to complete the test administration! NEW! Not real time – previous days data going back to day 1

99 See on line video tutorials for demonstrations!
2/1/2019 Session Access Code Test Tickets Test Report Code Test Status Form Name Test Invalidate Not real time – previous days data going back to day 1 See on line video tutorials for demonstrations!

100 Administration: Other Features
2/1/2019 Administration: Other Features District and School-level dashboard for monitoring testing Not to be used for accountability purposes! Download list of students with their test completion status by school/test STCs can access the dashboard to view test statistics for their school(s) NEW! Not real time – previous days data going back to day 1 See on line video tutorials for demonstrations!

101 New Mexico Science Assessment Kiosk: Student Test Delivery System
Orientation and New Features

102 2/1/2019 Logging in to a Test If the kiosk is out-of-date, an alert will be displayed

103 2/1/2019 Logging in to a Test

104 Logging in to a Test NEW!

105 Logging in to a Test NEW!

106 Test Navigation NEW!

107 Test Navigation NEW! NEW!

108 Test Navigation NEW!

109 Accessibility Features (all students)
2/1/2019 Accessibility Features (all students) Name Tool Icon Sketch Tool (Not available on constructed response items) Highlighter Note Pad Line Reader Answer Masking Reference Sheet (Spanish Only) Pop-up Glossary (ASR Field Test) NEW! NEW! NEW! If they pause test, these will not be saved! NEW!

110 Accessibility Features Identified In Advance
2/1/2019 Accessibility Features Identified In Advance Name Tool Icon Zoom View (magnifier) Reverse Contrast Custom Masking Color Contrast Accommodations (for students with disabilities and/or ELs) Name Tool Icon Text-to-Speech English (SWD, 504, EL) Text-to-Speech Spanish (SWD, 504, EL) Allow Accessibility Mode Testing No icon (See slide 23) NEW!

111 Special Situations (TTS)
2/1/2019 Special Situations (TTS) The Science SBA Kiosk uses the default voice set on the student’s workstation. See Kiosk Installation Guide for specific steps on how to change the default voice. Assign all student text-to-speech accommodations PRIOR to student logging into tests. If you need to add an accommodation after scheduling a student, but before they log in, click on Generate Missing Student Test Logins button after TTS has been added: If student logs in and realizes they do not have TTS, you must assign accommodation and then place them in new/different class.

112 Special Situations (Spanish Tests)
Create separate class for Spanish test Schedule Spanish class for Spanish test Ensure Student changes Kiosk to Spanish version before they log-in Spanish TTS Accommodation Ensure Spanish TTS is selected Use Cepstral Software Switch between English and Spanish Kiosk

113 Test Turn-In Steps Button to Click
2/1/2019 Test Turn-In Steps Button to Click On the last item, students click Finish. On the test review screen, students click Turn In. Below the confirmation question, students click Turn In. Student returns to test section selection page and may select the next section or click Exit to exit the kiosk.

114 Finishing Testing Ensure no students are still “in progress”
2/1/2019 Finishing Testing Ensure no students are still “in progress” Use “Download Test Session Details” in Portal main test session tab for complete list! Ensure any workstation that had stored responses was relaunched after the network connection has been restored (see slides 41-44) For students who did not complete test, add test report codes and invalidate tests in accordance with PED policy

115 Special Situations (Proctor Password)
2/1/2019 Special Situations (Proctor Password) Type of Password Utilization Entered By Student Password Used to log the student into the appropriate test Student Session Access Code Used to log the student into the appropriate session of the test Proctor Password** Required if: Student has been paused test for more than 20 minutes Student has been inactive for more than hour Student has the Allow Accessibility Mode accommodation If the student has saved responses on their device (see slide 43: “What if a student finishes a test but has no network connection?”) Proctor Proctor password must be kept confidential.

116 Site Technology Preparation
iTester™ Site Technology Preparation

117 Kiosk Requirements Windows and Mac Applications
2/1/2019 Kiosk Requirements Windows and Mac Applications Available to download in Portal (22 Jan 2019) iPad and Chromebook Applications Available to download in iTunes/Google Play Browser (practice test only) Available on Chrome, Safari, Internet Explorer, Firefox, and Microsoft Edge New kiosks are ARE required for Spring 2019!

118 System Requirements – All Hardware
2/1/2019 Kiosk Requirements Updated! System Requirements – All Hardware Connectivity Must be able to connect to the internet via wired or wireless networks Screen Size 9.7” screen size or larger/ “10-inch class” tablets or larger Screen Resolution 1024 X 768 Browsers (Practice Test ONLY) Chrome™ 71 or newer Firefox® 64 or newer Safari® 12 or newer Internet Explorer® 11 Microsoft Edge™ or newer Headphone/Earphone/Ear Buds Headphones/earphones/ear buds are required for students who have a text-to-speech accommodation Updated 21 Dec Check the Measured Progress help and support site for more recent updates.

119 Desktop and Laptop Specific Requirements
2/1/2019 Desktop and Laptop Specific Requirements CPU 1.3 GHz Memory 2 GB (4GB strongly recommended) Input Device Keyboard – wired or wireless/Bluetooth® mouse or touchpad Windows® operating system Windows 7, 8.1, 10 (32-bit and 64-bit) Mac OS® operating system 10.12* – (64-bit only) Tablet/Netbook/2-in-1 Specific Requirements iPad® 11.4 – 12.1 Chromebook™ notebook computer Chrome OSTM 69 – 71 Windows-based tablets/netbooks/2-in-1 Windows 10 (32-bit and 64-bit) (Windows 10S is not supported) Updated 21 Dec Check the Measured Progress help and support site for more recent updates.

120 Kiosk Requirements (devices)
2/1/2019 Kiosk Requirements (devices) iPad users: use Automatic Assessment Configuration iPad users: external keyboard is optional *Mac 10.12: known bug (disappearing cursor), recommend updating Mac OS 10.14: new setting must be enabled to allow kiosk to launch – see kiosk installation guide Chrome users: ensure user’s local data is not erased Windows users: MSI for distribution using GPOs Best Practice for all OS’s: turn off auto updates during testing Students testing on devices that do not meet the Student Workstation Specifications are likely to encounter performance-related issues during testing. Technology Guidelines may be updated throughout the test administration window as new operating systems are released and tested. Do not update your test device OS until the Technology Guidelines have been updated. Guided Access was used previously Disables spell check, predictive text, etc…

121 1. Submit responses for scoring
2/1/2019 Kiosk Requirements (network) Beginning of Test: Authenticate login Download test content End of Test: 1. Submit responses for scoring What happens if a student loses network connection in the middle of a test?

122 Kiosk Test Integrity A B 45-90sec A B A B C D C Stored Response Folder
2/1/2019 Kiosk Test Integrity 45-90sec A D B C Stored Response Folder A D B C Pause, log out is OK, A D B C

123 What if a student finishes a test but has no network connection?
2/1/2019 What if a student finishes a test but has no network connection? A D B C A D B C Turn In Pause, log out is OK,

124 Kiosk Test Integrity Loss of Network Connectivity Procedure Summary
If a student loses network connectivity in the middle of a test: Keep testing on that device Test content and responses are stored securely on the test device Responses will be sent when network is restored If student finishes and is ready to turn in test prior to network being restored: Allow student to turn in test Record the exact device the student is testing on Ensure no network management tools or system maintenance will alter that devices files or configuration When network connectivity is restored, return to that exact device and relaunch the kiosk If you are unsure of the status of the student responses, call the help desk

125 Kiosk Requirements Firewalls Allow traffic through ports 80 and 443 Proxy and Content Filter Servers List of URLs to whitelist on ports 80 and 443 available in Kiosk Installation Guide Sandboxing Applications (e.g. Deep Freeze) Choose network folder or local folder that is not touched by the sandboxing applications Applicable for both stored response and kiosk installation folders Thin Clients Ensure there is enough memory, CPU, and bandwidth on the server to accommodate multiple student test sessions. Client requires a minimum of 80 MB per Client session. Review Kiosk Installation Guide for further information

126 Practice Test Options Use demo students in the portal. Between 22 Jan – 8 Feb, demo students and a practice test will be available in the portal for each school. Assign accommodations to demo students, create classes, schedule test sessions and print log-in tickets for your students. Have student launch the test kiosk and log in to the practice test with the test ticket log in information. Best option for: Practice end-to-end process of editing students, creating classes and scheduling test in the portal Assigning specific accommodations to specific students for practice testing Note: not available for ASR Field test Use single username/password practice test with web browser Practice testing on devices that do not have a testing kiosk installed Note: kiosk is not secure, all accommodations except allow accessibility mode and screen zoom are available Use single username/password practice test with student Kiosk Realistic practice testing in secure kiosk without setting-up tests with demo students in portal and practice after demo students have been removed Note: all accommodations are available except allow accessibility mode

127 Practice Test Options (SBA)
To access the practice test in web browser: Launch Browser go to Enter the credentials below to log-in and begin test To access the practice test in student testing kiosk: Launch Kiosk Click on the “Access the Practice Test” link SBA Practice Test Username Password Grade 4 English G4english practice Grade 4 Spanish G4spanish Grade 7 English G7english Grade 7 Spanish G7spanish High School English HSenglish High School Spanish HSspanish

128 Practice Test Options (ASR)
To access the practice test in web browser: Launch Browser go to Enter the credentials below to log-in and begin test To access the practice test in student testing kiosk: Launch Kiosk Click on the “Access the Practice Test” link ASR Practice Test Username Password Grade 5 English Grade5english practice Grade 5 Spanish Grade5spanish Grade 8 English Grade8english Grade 8 Spanish Grade8spanish High School English Grade11english High School Spanish Grade11spanish

129 Practice Test

130 Additional Training Resources
Help Guides Kiosk Installation Guide Portal User Guide Kiosk User’s Guide (formerly Test Administrators Technology Guide) Technical Guide for Spanish Language Support Training videos ( Support Desk Call-in Information Sheet NEW! NEW!

131 Remember! DTCs/STCs: Deactivate unused accounts
Dashboard is not used for official accountability Test report codes/ test invalidation will not prevent student from logging in to test but will prevent test from being scored Download student test status 1-3 April 2019 to keep record of test status TAs: Ensure Students have TTS form BEFORE they log into test (see TTS slide) Watch out for stored responses (see What happens if student finishes test and network connection has not been restored? slide) ITCs: New Kiosks DO need to be downloaded Turn-off operating system auto updates Both parts of site readiness test must be completed to log site readiness test results Make sure network management tools don’t delete stored response folder Spanish Testers: Spanish version of test must be scheduled – accommodation setting is for record-keeping only (see Spanish Test slide & Spanish Testing Guide)

132

133 Questions?

134 New Mexico Alternate Performance Assessment (NMAPA)

135 Spring 2019 Window: March 11 – April 5
Assessment Program: New Mexico Alternative Performance Assessment (NMAPA) Required Grades/Subjects: Grade Subject Grade 3 & 5 ELA, Math Grade 4 ELA, Math, Science Grade 6 & 8 Grade 7 Grade 10 Grade 11 ELA, Math, Science, Social Studies Spring 2019 Window: March 11 – April 5

136 NMAPA Banking Student scores proficient in ELA or Math in Grade 10.
Student may bank score for graduation. Student must take Science and Social Studies in Grade 11. Student may not attempt Science or Social Studies in Grade 10. Student scores proficient in ELA or Math in Grade 10. Student retakes ELA or Math in Spring of Grade 11. Student may not use Fall retake window. Grade 10 score may be used as baseline for IEP team to identify cut score when assessment is administered in Grade 11. Student does not score proficient in ELA or Math in Grade 10.

137 NMAPA Quick Links Sample Test Items
Test Coordinator Manuals Teacher Resources Parent Resources Ordering Test Information Distribution Engine (TIDE) NMAPA Help Desk

138 Students and parents may not refuse accountability testing.
Federal and State Law: Students and parents may not refuse accountability testing. All students must participate in state accountability assessments. Federal Statute: Elementary and Secondary Education Act (ESEA) Title I, Part A, Subpart 1, Section 1111, (b), 3, C New Mexico Statute: 22-2C-4 NMSA 1978

139 Eligibility criteria Impairments must affect students in multiple settings. IEP team, as a group of individuals with a clear understanding of a student’s needs, must determine whether that student is eligible to take the NMAPA per (E)(3) NMAC

140 Guiding Questions Does the student’s past and present performance in multiple settings (home, school, community) indicate that a significant cognitive disability is present? Does the student need intensive, pervasive, or extensive levels of support in school, home, and community settings? Do the student’s current cognitive and adaptive skills and performance levels require direct instruction to accomplish the acquisition, maintenance, and generalization of skills in multiple settings (home, school, and community)?

141 Guiding Questions The information gathered through questions 1-3 demonstrates to the team that this student “cannot participate in the regular assessment; and the particular [alternate] assessment selected is appropriate for the child.” Parents have been informed of the potential consequences of having their student assessed against alternate achievement standards (such as potential limitations to postsecondary opportunities).

142 Online ordering Log into the Test Information Distribution Engine (TIDE). ALL students must be in TIDE. ALL answer documents must have a label. Log into TIDE and order: Student Score Forms TA Kits for all tested grades

143 NMAPA Online Training Test Administrator online training is at
Online training opened January 7. Click on Teacher/TA tab, then click

144 NMAPA Online Training The five training modules can be completed in multiple sessions. Manipulatives available to print prior to watching the modules to use during training. Print certificate at the end of training. TAs must be re-certified every two years.

145 Online Training Modules

146 Assessment-Specific Manuals
TCM: Test Coordinator Manual TAM: Test Administration Manual New information for Spring PLEASE READ!

147 Online Reporting System (ORS)
Access at Click on either tab Then click on Online Reporting System (ORS) to see data/reports.

148 Online Reporting System (ORS)
If your students are not in TIDE, they will not be in the ORS. Online access to score reports and score data Users access the ORS through TIDE DTCs or STCs must add Test Administrators as users in TIDE

149 Online Reporting System (ORS)
Download Excel spreadsheets with student scores View school or district overall scores. View individual scores by subtests.

150 Resources

151 PED Policy: ped.assessment@state.nm.us
NMAPA Help Desk Tel Fax

152 Summative Assessment Transition Information for District Test Coordinators

153 Spring 2019 Summative Math & ELA Transition Assessment Memorandum
As stated in the January 10, 2019, memorandum, the transition assessment is: 1 to 1.5 hours shorter per subject area, reducing overall testing time up to 30%; comparable to prior year’s results, with five reporting categories; delivered on the same platform and during the April 22-May 10 scheduled window. A new test will be developed for SY, which will have a new name, TBD.

154 Spring 2019 Summative Math & ELA Transition Assessment Key Messages for Educators
Teachers should continue to do what they do best: teach content with high rigor that is aligned to our adopted New Mexico Common Core Standards (NMCCSS). The test is called the Spring 2019 New Mexico Standards-Based Transition Assessment of Mathematics and English Language Arts.  This test is fully aligned to NMCCSS. This is not the same assessment as the old New Mexico SBA for Math and Reading from years past. The prior test was aligned to the former New Mexico Standards and Benchmarks.    New Mexico is no longer using the PARCC test blueprint or PARCC test design. A new test blueprint has been developed and there are similarities in test design and structure in order to maintain comparability.

155 Spring 2019 Summative Math & ELA Transition Assessment Comparability Message
This is a transition assessment created with linking items that have undergone educator reviews for content, bias and sensitivity, and field testing. Linking items are items that have been utilized on prior operational forms or were field tested on the spring 2018 forms to allow for comparability, rather than starting from a new baseline. This results in parents, educators, and public officials being able to compare spring 2018 and prior scores to spring 2019 scores. All publicly available resources (e.g., online practice sites) for prior administrations are still appropriate for use as preparation and practice for the Spring 2019 transition assessment. The Spring test will be administered in TestNav and managed through PearsonAccessNext.

156 Comparability Grade 4 ELA 24.9% 25.2% 29.1% Grade 8 ELA 24.4% 27.9%
Subject 2017 NAEP % Proficient 2017 PARCC % Proficient 2018 PARCC % Spring 2019 Transition Summative Assessment % Proficient Grade 4 ELA 24.9% 25.2% 29.1% ? Grade 8 ELA 24.4% 27.9% 29.0% Grade 4 Math 27.2% 23.1% 25.6% Grade 8 Math 20.2% 20.8%

157 Spring 2019 Assessment Transition Quick Links
Support Resource Link PED Spring 2019 Assessment Transition Memo PED Assessment Transition Page Pearson Support Page PearsonAccessNext nm.pearsonaccessnext.com

158 Spring 2019 English Language Arts Design & Unit Times
Students are assigned either Form A or Form B

159 Spring 2019 Mathematics Design & Unit Times
3 Hours for all grades

160 Publicly Available New Mexico Assessment Resources Support Page
Resources Audience Tutorials for Students to use TestNav and tools to be used during the test. Students Parents Teachers Spring 2019 Transition Assessment New Mexico Test Administration Manuals & Spring 2019 Transition Assessment New Mexico Accessibility Features and Accommodations (AF&A) Manual Test Coordinators Test Administrators IEP, 504, and EL Teams NM Support page accessible 2/1/2019

161 Publicly Available New Mexico Assessment Resources Support Page
nm.digitalitemlibrary.com Released 2/1/2019 Access to high quality math and ELA items Ability to search test items by grade, content area, evidence statement, and task type Coming Soon: Teachers will have the ability to create formative “testlettes” and administer formatives in TestNav Professional development will be provided

162 Spring 2019 Transition Assessment Performance Levels Remain the Same for Comparability
Exceeded expectations Level 4 Met expectations Level 3 Approached expectations Level 2 Partially met expectations Level 1 Did not yet meet expectations The Spring 2019 results still inform a level of career and post secondary readiness

163 Important Dates Deliverable Date
Release of Feb. 1 Spring 2019 SR/PNP import window Feb. 4 – March 8 Fall Block 2018 reports in PAN March 11 Fall Block 2018 ISRs shipped March 31 Spring 2019 materials arrive at LEAs April 8* Spring 2019 Testing Window April 22 – May 10 Spring Results Available in PAN for DTCs 2 weeks after test submission for online tests* *Subject to change

164 Reports and Data Transition Assessment Individual Student Report (ISR)
Transition Assessment School Roster Report Transition Assessment District Summary Report Transition Assessment District and School Summative Files Transition Assessment Performance Level Summary Report Transition Assessment Evidence Statement Analysis Report Transition Assessment Content Standards Roster Report

165 Publicly Available Accessibility Features and Accommodations
The Spring 2019 New Mexico AF&A Manual will be available at on 2/1/2019 Quick Reference Version at PED Website: content/uploads/2019/01/FINAL_Accessibility- Accommodations-Features.pdf Accessibility Features for all Students Administrative Considerations Accommodations for Students with Disabilities Accommodations for English Learners

166 Accessibility Features for All Students
Blank Scratch Paper – Must supply at least 1 sheet for each student. Additional pages may be provided as needed. Graph paper may be used. Bookmark – Allows students to flag items. Highlight Tool – Highlighter color option will change depending on the color contrast option selected. Spell Check – Embedded spell check is an accessibility feature. Spelling is NOT assessed.

167 Administrative Considerations
Frequent Breaks Separate/Alternate Location Small Group Testing Specialized Equipment or Furniture Specified Area or Setting Time of Day

168 Accommodations Must Enable students to participate with equal access.
Be based on individual needs identified in the instructional/assessment setting. Be documented in either the IEP, 504 Plan, or EL Plan. For English learners, be described and documented in the student’s file. Be utilized during daily instruction. Parents receive notification.

169 Text-To-Speech Accessibility vs Accommodations on Assessments
English Language Arts Mathematics Always an accommodation, documented in a legal plan, parent/guardian involved A student need not have an legal plan to receive Text-To-Speech feature assignment for mathematics. This must be a Pre-identified Accessibility Feature in testing system Rare cases/seldom Needs to be thoughtfully assigned, not a blanket assignment for all students in a given grade, class, or school PED Monitored Examples when suitable to assign: A disability that severely limits or prevents them from accessing printed text after varied and repeated attempts to teach accessibility have been exhausted. Student qualifies as documented and receives accommodation during instruction. Student may be in SAT process and deficit skills may be appearing. A discussion between parent, student, and teacher results in assigning text-to-speech for math. Student has utilized this feature during 50% or more of classroom instruction.

170 Accommodation for Students with Disabilities: ELA/Literacy Assessments
Text-to-Speech ASL Video Human Reader/Human Signer

171 Accommodation for Students with Disabilities: Calculators Allowed on Non-Calculator Sections
Grades 3-7: Four-function calculators with square root and percentage functions Grades 8: Scientific calculators High School: Graphing calculators with functions consistent with TI-84 or similar models Reference sheets will be posted at PED Assessment Bureau Webiste: pring2019mathela/

172 Use Accommodations with Caution
Calculators allowed on NON-Calculator Sections and ELA/L Text-To-Speech, ASL video, Human Reader/Human Signer must only be provided to students who meet eligibility criteria listed in the New Mexico 2019 Spring Transition Assessment AF&A Manual. PED will audit schools/districts based on high usage of these accommodations. See ELA text to speech, ASL video, Human Reader/Signer eligibility criteria in the New Mexico 2019 Spring Transition Assessment AF&A Manual.

173 Accommodations for English Language Learners
Content Area Accommodations Mathematics only Spanish Translation of Math Test, Spanish Translation of Math Test in Text-to-Speech, Mathematics Responses Both Content Areas Translation of General Test Directions*, Administration Directions Clarified in Student’s Native Language, Word to Word Dictionary (English/Native Language) *General Test Administration directions available in Spanish and Navajo.

174 PearsonAccessnext (PAN)
Live Site: Training Site: Training site will be available 2/1/2019

175 Technology Specifications
Technology Coordinators must review guidelines on the TestNav support site: For devices supported, see: Browser-based TestNav is no longer supported, please use the TestNav app instead.

176 Technology To-Do List Install new proctor cache software in each school. Install latest version of TestNav app. Configure TestNav in PAN. Conduct local infrastructure trials in March 2019 to address any potential issues arising from technology changes, previous challenges, or new staff.

177 TestNav http://download.testnav.com/
Installation of TestNav app on every testing device. TestNav 8.12 will be availale prior to spring testing. If you have already upgraded to 8.11, no further action is needed; TestNav will auto-update to 8.12. Use of app is required for all online testing situations beginning Spring 2019. Proctor cache software is available at the above website, however is no longer necessary or recommended.

178 PearsonAccessnext PED Responsibilities
Steps PED performs to prepare for summative assessments: Imports initial Organization and Org Participation files. Creates the initial User Accounts for PED-approved test coordinators. Imports Student Registration/PNP File using this year’s 80 day STARS snapshot and accommodations from the Spring 2018 administration.

179 User Accounts in PearsonAccessnext

180 DTC Permissions* * some permissions may change as needed
Request Additional Order- Allows user to place additional orders. Delete Student Role–Allows user to delete students from PAN. Sensitive Data Role–Allows user who will be able to view and edit Student Sensitive Data. Student Test Update Role–Allows user to update student Not Tested Code/Reason and Void Score Code/Reason after testing. Rejected Student Test–Allows user to view resolve rejected paper tests. Published Reports Role–Allows user to access published reports. * some permissions may change as needed

181 Support for PAN User Accounts
Pearson Customer Support: Can reset passwords Can unlock accounts for DTC Test Coordinator accounts Cannot create accounts Cannot lock/unlock accounts other than DTC accounts Cannot update addresses Cannot delete/undelete accounts PED: Only PED staff can create new DTC Test Coordinator accounts LEAs: Can contact if you are a PED-approved DTC/STC and need a PAN user account.

182 Student Registration/Personal Needs Profile
SR/PNP Contains: Student demographic data Test-specific information Assessment accommodations Review/Edit: SR/PNP data PAN user interface File (spreadsheet) import

183 LEAs are able to: Review students pre-registered by PED in the PAN user interface. Change test assignment(s) or PNP information on Manage Student Test screen. Switch student from one school to another (within district transfer). Switch student from one district to another (between districts).

184 Test Session Management
Test Coordinators (DTCs or STCs) must prepare sessions the day before testing. Test Administrator is responsible for unlocking test units. Test Administrator is responsible for locking each test unit BEFORE leaving the testing room. NO TEST SESSIONS ARE TO BE LEFT UNLOCKED WHEN THE UNIT IS COMPLETE.

185 Future Summative Assessment 2019-20 SY
Comparability of results over time still a primary driver for assessment design. This matters to stakeholders. Item & Bias Review meetings will be held in Albuquerque May/June: TBA. Stakeholder engagement meetings on future assessment designs are being planned.

186 PED Policy: ped.assessment@state.nm.us

187 ASSESSMENT OF ENGLISH LEARNERS

188 IDENTIFICATION PROCESS
PART 1 ENGLISH LEARNER IDENTIFICATION PROCESS

189 This Session English Learner (EL) Identification Process
English Language Proficiency Screening Assessments

190 “Every exit is an entry somewhere else.”
—Tom Stoppard

191 ELs Are Protected Federal law through:
Title VI of the 1964 Civil Rights Act Equal Educational Opportunities Act of 1974 requires that all ELs have equal access to a high-quality education opportunity to achieve their full academic potential.

192 Federal Definition of EL
(A) Age 3 – 21; (B) In elementary or secondary school; (C) (i) not born in the US or whose native language is a language other than English; (ii) (I) who is a Native American or Alaskan Native or native resident of the outlying areas and (II) language other than English has had a significant impact on English language proficiency level; or (iii) migratory and where a language other than English is dominant; AND ESSA Section 8101(20)

193 EL Identification Step One
Parents complete the New Mexico language usage survey (LUS)—only for students new to public education If one or more ‘yes’ responses in question 1-6 and/or a language other than English indicated in question 7 student is a potential EL

194 Federal Definition of EL (cont.)
D. whose difficulties in speaking, reading, writing, or understanding the English language denies them the ability to: (i) meet the State’s academic proficiency levels on required assessments; (ii) successfully achieve in classrooms where English is the language of instruction; or (iii) opportunity to participate fully in society. ESSA Section 8101(20)

195 EL Identification Step Two
Potential ELs are administered the department-approved English language proficiency screening assessment W-APT in Kindergarten WIDA Screener Online in grades 1-12

196 EL Identification Step Three
Within two weeks of initial enrollment if not enrolled at the beginning of the school year Parent Notification to parents of identified ELs for a sample letter, please visit

197 LUS Process Map

198 ENGLISH LANGUAGE PROFICIENCY SCREENING ASSESSMENTS
PART 2 ENGLISH LANGUAGE PROFICIENCY SCREENING ASSESSMENTS

199 W-APT Kindergarten WIDA has begun the development of a new Screener for Kindergarten students.

200 Test Administrator—W-APT
Please follow state regulation C(2) NMAC for staff qualified to administer the W-APT. Review all training materials.

201 W-APT Materials Find all materials in the Quick Start Guide (follow links) Review all training materials in section 4 of the Quick Start Guide including the Kindergarten W-APT Webinar.

202 WIDA Screener Online Grades 1-12

203 Where Are the Training Materials?

204 Speaking and Writing WIDA Screener Online calculates Listening and Reading scores automatically. Speaking and Writing scored locally. Speaking and keyboarded Writing responses are electronically recorded in WIDA AMS. Use the WIDA Screener scoring scales For writing, use the Sentence Complexity Guidelines Grades 1-3 and Grades 4-12 under the Materials and Resources tab.

205 Does the Student Have an IEP?
WIDA Screener accessibility and accommodations are the same as for ACCESSS for ELLs 2.0 Exception: WIDA Screener is not available in braille.

206 When Do You Order a Paper Kit?
Students whose IEP or 504 Plan requires a paper-based assessment Newcomers with no previous computer experience

207 Score Reports Score reports available on-demand.
Keep a copy in the student’s cumulative file. Score Reports provide the student’s Proficiency Level (PL) score for each domain, and three different composite scores: 1. Overall 2. Oral Language 3. Literacy All domains must have been completed and scored or the overall score cannot be calculated.

208 Test Administrator —WIDA Screener
Please follow state regulation C.(2) NMAC for staff qualified to administer the WIDA Screener. The TA has to re-certify each school year to administer the test. To be certified, a TA must pass the speaking and writing scoring quizzes with passing score of 80% or higher. Certifications must be kept on file.

209 Testing Irregularities
Submit any testing irregularities that occur with W-APT and WIDA Screener through the Testing Irregularity Reporting Portal.

210 PART 3 WIDA ACCESS for ELLs 2.0

211 This Session General Information and Ordering Test Administration
Accommodations

212 General information and ordering

213 Test Administrator—ACCESS for ELLs
Please follow state regulation C. NMAC for staff qualified to administer the ACCESS for ELLs 2.0 and Kindergarten ACCESS assessments. The TA has to re-certify each school year to administer the tests. To be certified, TAs must complete the required quizzes with passing score of 80% or higher. Certifications must be kept on file.

214 Test Administrator—Alternate ACCESS
Administered by a licensed special education teacher who is familiar with the student, the student’s need, responses, and communication style, or An instructional support provider as defined in B. NMAC who is familiar with the student, student’s needs, responses and communication style The TA has to re-certify each school year to administer the tests. To be certified, TAs must complete the required quizzes with passing score of 80% or higher. Certifications must be kept on file.

215 ACCESS for ELLs 2.0 Annual English language proficiency assessment for all current EL students Testing Window: January 14, 2019 –March 8, 2019 Student growth to proficiency affects the school’s points in the ELP Indicator in school grades.

216 Alternate ACCESS ELs with significant cognitive disabilities are annually administered the Alternate ACCESS for ELLs (Alternate ACCESS) assessment if the students also take the NMAPA. This must be written in the student’s IEP. Alternate ACCESS starts in grade 1.

217 Students with Impairments
The ESEA requires that a State provide appropriate accommodations for ELs with disabilities and, if an EL has a disability that precludes assessment in one or more domains of the ELP assessment such that there are no appropriate accommodations for the affected domain, assess the student’s ELP based on the remaining domains in which it is possible to assess the student.

218 Students with Impairments cont…
Students with impairments that cannot be accommodated: Indicate in the State Defined Optional Data field under Demographics 1 = hearing impairment (HI) 2 = visual impairment (VI) 3 = speaking domain for students taking the braille version (VIBR) 4 = non-verbal (NV)

219 Students with Impairments cont…
Ensure that the student’s IEP or 504 Plan states that the student is unable due to the impairment to take one or more domains on ACCESS for ELLs and that there is no accommodation for the affected domain(s). Non-examples: 1. A student unable to produce functional speech but who uses an Augmentative/Alternative Communication (AAC) device would not be included in the State Defined Optional Data field. 2. A student with visual impairment who can be accommodated with large print (LP) would not be included in the State Defined Optional Data field.

220 Ordering Materials Initial order for test materials was placed by PED through a pre-id file upload to DRC on November 21, 2018. Pre-id file was based on 40D data reporting. WIDA AMS Test Setup has been available for Test Sessions since November 29, 2018. Test materials arrived at districts on January 7, 2019.

221 Initial Orders Material overage sent out with initial order is 15%, which is distributed 7.5% to district, 7.5% to schools No overage for districts with less than 10 initial orders Alternate ACCESS materials are packaged with ACCESS test materials. State Specific Directions are no longer sent in the initial shipment. They can be accessed on the NM State page at wida.wisc.edu.

222 Additional Orders Additional ordering window: January 7, 2019 – March 1, 2019 Use overage before placing an additional order. Consolidate the need for additional materials into one district additional order or a few (if absolutely necessary) placed by the DTC in WIDA AMS In NM had over 600 additional orders In NM had 278 additional orders 

223 How to Place an Additional Order
In WIDA AMS Materials > Additional Materials > Add Order button activates once a school is selected Complete Administration, District, School fields, then click “Add Order”

224 How to Place an Additional Order cont…
List of materials Select amounts for each grade and tier Once the order is complete, click Submit. No expedited shipment, except for a very rare emergency

225 Test administration

226 WIDA Secure Portal

227 My Account and Secure Portal
Trainings and quizzes can be found under each tile.

228 Are All TAs Certified? Test Coordinators can also view Test Administrators’ completion of the training courses within the WIDA Secure Portal by clicking on the tile. Certificate listing completed training components Records of training

229 Prior to Testing Use test demos with students
Students get familiar with the platform and the universal tools

230 Universal Tools Audio Aid Color Contrast Color Overlay Highlighter
Line Guide Magnification Sticky Notes Scratch Paper online only

231 Test Administration ACCESS for ELLs is not a timed test.
In the Speaking domain each individual response to each question is timed once the student clicks the Record button. Each domain is a separate test session. A thoughtful test schedule will ensure that students are able to show their English language proficiency (ELP) level

232 Test Administration cont…
Complete a domain in one session. Schedule enough time for students to finish each domain. Do not combine multiple test domains into one test session. For example, the Listening test should be administered in a different test session than the Reading, Writing, or Speaking test. Do not combine online and paper modes for a student Please note: Writing booklets for grades 1-3 are part of online testing.

233 Test Sequence (Order of Test Administration)
Listening – Reading – Speaking – Writing Listening and Reading tier students for the remaining tests, based on performance.

234 ACCOMMODATIONS

235 Accessibility and Accommodations
Scoring and Reporting Accessibility and Accommodations Accommodations for students with disabilities Flexible administrative considerations and universal tools for all students Linguistic scaffolding and Universal Design principals to the development of test items

236 Accommodations Specified in student’s IEP or 504 Plan
Ensure meaningful and appropriate participation Only use allowable accommodations. Accommodations used in daily instruction over a period of time

237 Accommodations (cont.)
Scoring and Reporting Accommodations (cont.) Some accommodations must be preselected in WIDA AMS: Repeat item audio (repeat button) Manual control of item audio Extended speaking test response time For further guidelines please read the Accessibility and Accommodations Supplement, starting page 13.

238 Accessibility and Accommodations Resources
For further guidelines please read the Accessibility and Accommodations Supplement, starting page 13.

239 Post Testing Deadline for shipping completed test materials to DRC: March 15, 2019 Do not wait until the deadline to return materials. No pre-reporting data validation

240 WIDA NM State Page

241 Exit Criteria for ACCESS
ACCESS for ELLs 2.0: overall composite score of 5.0 or higher Alternate ACCESS: overall composite score of P1 or higher

242 WIDA Client Services Center PED Language and Culture Bureau
Quick Links Who… Help lines… Can help with…. WIDA Client Services Center (WIDA.US)    7 a.m.-6 p.m. CT Mon-Fri Test preparation - Test practice - User guides Certification training - Testing manuals NM Checklist - Accommodations DRC Help Desk (WIDA-AMS) WIDA AMS Login issues - Ordering materials Adding students and test sessions Printing test tickets - Technology issues Unlocking and invalidating tests PED Assessment Bureau Karen Greer Assessment Coordinator (505) New DTCs enrollment WIDA AMS website help Issues with WIDA/DRC help desks PED Language and Culture Bureau Kirsi Laine Deputy Director (505) EL identification EL programs Testing in English Waivers

243 TESTING ACCOMMODATIONS FOR ELs INCLUDING TESTING IN ENGLISH WAIVER

244 ELs and Statewide Assessment Programs
Per M.(2)(a)(i) NMAC: Students who have been in U.S. schools for less than three consecutive years shall participate in the statewide assessment program in one of three ways: 1. the student may participate in the standard administration of the English-language version of the assessment without accommodations;

245 ELs and Statewide Assessment Programs cont…
Scoring and Reporting ELs and Statewide Assessment Programs cont… 2. the student may participate in the English-language version of the assessment with appropriate accommodations; 3. the student may participate in the standard administration of the Spanish-language version of the assessment, where available and appropriate.

246 Testing Accommodations
Scoring and Reporting Testing Accommodations Assessment accommodations enable students to overcome a language barrier or a disability. An allowable assessment accommodation does not alter the concept being measured. Only ELs with disabilities can have accommodations on the English language proficiency assessment (ACCESS for ELLs 2.0).

247 ELs and Accommodations
Scoring and Reporting ELs and Accommodations School-based team must include at least three school staff who are familiar with the student’s abilities, student’s data including English language proficiency level, and language needs. The district shall ensure that students do not receive accommodations without current justification supported by data. Only use allowable accommodations. Written documentation of accommodations kept in student’s cumulative file For further details, see M.(2)(a)(iii) NMAC.

248 Spanish –Language Version of State Assessments
M.(2)(a)(ii) NMAC: Students who have been in U.S. schools for three or more consecutive years shall participate in the English-language version of the assessment with or without allowable accommodations, unless a waiver request to continue the testing of the student in the home language of Spanish is approved by the secretary.

249 Spanish –Language Version of State Assessments cont…
Scoring and Reporting Spanish –Language Version of State Assessments cont… M.(2)(a)(ii) NMAC: If, after three consecutive years in U.S. schools, the district or charter school determines (on a case-by-case basis) that academic assessments in the student's home language of Spanish would yield more accurate and reliable information about the student's knowledge of a subject, the district or charter school may request a waiver from the secretary to continue to assess the student in the home language of Spanish.

250 Testing in English Waivers
Scoring and Reporting Testing in English Waivers M.(2)(a)(ii) NMAC: Approved waivers are effective for the current year only; Annual waiver requests may be approved for a maximum of two years.

251 Questions Assessment Bureau ped.assessment@state.nm.us
Language and Culture Bureau Kirsi Laine Deputy Director (505)

252 END OF COURSE EXAMS (EOCs)

253 Assessment Program: End of Course Exams (EOCs)
Assessments created by New Mexico educators for New Mexico students Assessment Program: End of Course Exams (EOCs) Required Grades: Varies by subject and course

254 Overview Purpose of EoCs
Updates to New Mexico’s Exam Platform for Informing Curriculum (EPIC) NMEPIC Demonstration Data Submission for Paper-Based Testing Resources for EoCs Frequently asked questions

255 EOC Quick Links EoC Website at NMPED:
DTC Secured Log-in to EPIC: EOC Practice Test on EPIC: EOC Course Linkage Chart: EOC Frequently Asked Questions EOC Policy Questions Issues related to NMEPIC, Rostering

256 Purpose of EoCs: Theory of Action
New Mexico educators will use EoC results to make curricular decisions that improve achievement outcomes for students. New Mexico EoC results are used to establish a measure of teacher effectiveness create common measures for course content determine if a student has met the requirements for graduation

257 What is EPIC? Repository for Secured EoC Documents:
Paper test forms and keys Testing Platform for students to take EoCs online: DTCs/STCs to set up test sessions Automated scoring Reporting engine Item Bank Author test questions

258 NMEPIC Setup Overview Rostering – STARS Coordinators submit roster data to the 7/15 Snapshot to populate NMEPIC. Bulk Upload (Assigning login credentials) Exam Sessions – linking tests with classes Starting the test – teacher side/student side Retakes

259 EPIC EoC Practice Test Available

260 NMEPIC Usage Numbers 2017-18 372,000+ exams administered
116,000+ students took exams 74 districts used EPIC (83%) 74 different exams given

261 Digital Delivery-EPIC
Testing Paper-Based Testing Digital Delivery-EPIC Blueprints are available at DTCs have login access to EPIC to download paper test forms and scoring keys. DTCs /STCs can start setting up testing sessions. Fall/Spring Testing Window: Last three weeks of the semester Senior retakes can be administered as needed Scored locally Automated scoring; except for essay – blind scoring on EPIC Use EoC Naming Conventions found on the EoC website to submit EoC data to PED. Teacher reports available immediately except for EoCs containing Essays. DTC reports available on EPIC Submit data to STARS Raw data provided to PED

262 Testing Announcements
Science EOC test forms have been revised to align to the NM STEM-ready! science standards. Testing Irregularities can now be submitted via online form. 6 New EOCs this year (5 science, 1 PE) NMEPIC Training Webinar April 15th at 3:00 pm Safe Exam Browser recommended.

263 Precision Exams Statewide Adoption of Exams for CTE Courses
Expanded opportunities for industry certification and demonstrating competency 31 Exams now available at no cost to districts Assessment is required if you have course that is linked Student performance data will not be used for teacher evaluation calculations for SY1819 Discounted pricing for site licenses giving access to more tests

264 Precision Exams About the platform Resources
Students can download certificate widely recognized by industry Immediate results Reports available to students, teachers, administrators Resources Virtual Technical Trainings for administration to be provided from January – March. Stay tuned to Assessment Newsletter for dates Memo announcing adoption – general information List of adopted exams

265 Precision Introductory Webinars
Precision Exams will be offering 4 sessions of their introductory training to their testing platform. Please register with the following link: January 15 – 12:30pm January 16 – 8:00am January 16 – 3:30pm January 17 – 12:30pm

266 Questions

267 GRADUATION REQUIREMENTS

268 Graduation Quick Links
Graduation Manuals By Year NEW: Graduation Policy for Class of 2022 Alternate Demonstration of Competency (ADC) Manual Class of Graduation Waivers and Forms *must be ed to State 2018 Graduation Requirements NMAC Demonstration of Competency for High School Graduation Questions on Class of 2022 and all cohort Course Requirements

269 Primary Demonstration of Competency Cohort 2019 Standard Option
Mathematics PARCC Algebra II, Geometry, Integrated Mathematics II or III* Reading** PARCC ELA Grade 11 Writing** PARCC ELA Grade 11 Science SBA Grade 11 Science Social Studies One state Social Studies EoC * There are no Fall retests for Integrated Mathematics II or III; seniors on this path may proceed directly to an ADC after one attempt on PARCC. * * Refer to the ADC Manual for other requirements on Reading and Writing subscores.

270 Primary Demonstration of Competency Cohort 2019 Career Option
Mathematics PARCC Algebra I or II, Geometry, Integrated Mathematics I, II, or III Reading PARCC ELA Grade 11 Writing PARCC ELA Grade 11 Science SBA Grade 11 Science Social Studies One state Social Studies EoC An ADC may be used after completing the same attempt requirements as students on the standard graduation option.

271 Primary Demonstration of Competency
Ability Option Mathematics NMAPA Mathematics with 506+ or IEP individualized scores ELA NMAPA Reading with 479+ or IEP individualized scores Science NMAPA Science with 501+ or IEP individualized scores Social Studies NMAPA Social Studies with 500+ or IEP individualized scores

272 Primary Demonstration of Competency Career and Ability Option
Cut Scores Cut scores are not retroactive. IEP Teams set individual passing cut scores after the student’s initial attempt. Students must be identified as career pathway no later than 20th day of senior year.

273 Reminder 2019 Class of 2019, the passing score for the ELA and Math primary demonstrations of competency (PARCC) is Level 3. Scaled Score = 725

274 Test Attempt Requirements
2019 Cohort State EoC minimum of 1 time SBA minimum of 2 times PARCC Math ELA Social Studies Science

275 ADC Implementation and Graduation Waiver ADC Implementation Waivers
To apply for using an ADC without minimum attempts at primary demonstration of competency (e.g., for transfer students) To apply for graduation status for students using scores from other states’ graduation tests to meet the New Mexico graduation assessment requirements ADC Implementation Waivers Graduation Waivers All waivers can be found at

276 ADC Waiver Needed? Fewer than 2 attempts at ELA or Math summative assessment Fewer than 2 attempts at SBA/NMASR An ADC implementation request must only be submitted when the attempt requirement is not met. OR

277 Remember A passing score on an approved ADC exam must be noted on the waiver before it will be reviewed.

278 Alternate Demonstration of
Competency (ADC) Manual The ADC Manual can be found on the PED Assessment website: Options If students do not pass the primary demonstration of competency for graduation, the ADC includes EoCs, CCR indicators, and local ADCs according to NMAC Waivers Districts may use an ADC Waiver if applicable. All waivers must be sent to state.nm.us

279 Transfer In Final Year of High School
Cohort 2019 Must demonstrate competency in ELA (reading and writing) and Mathematics only. Does not require a waiver for Science and Social Studies. Passing a high school graduation exam in another state may apply to assessment requirements by subject. Requires a Graduation Waiver.

280 Wondering about the new graduation
policy for the Class of 2022? Check out the following links and resources: Available on the College and Career Readiness website: Class of 2022 High School Graduation Manual Class of 2022 Graduation Checklist Class of 2022 Graduation FAQ Recorded webinars providing a comprehensive overview of the new policy Available on the Policy, Innovation, and Measurement website: Proposed and final versions of NMAC All public comment received during the comment period for NMAC Available on the New Mexico Sunshine Portal website: Complete rule record for NMAC

281 QUESTIONS For questions related to ADCs and graduation waivers:
To send waivers: For questions related to new graduation policy for class of 2022: Education Administrator College & Career Readiness Bureau


Download ppt "District Test Coordinator Training PED Assessment Bureau January 2019"

Similar presentations


Ads by Google