Download presentation
Presentation is loading. Please wait.
1
District Test Coordinator Training PED Assessment Bureau January 2019
2
New Mexico Statewide Assessment Program
SBA Transition Math & ELA NMAPA Early Child. Obs. Tool (ECOT) EOCs & Precision Exams NAEP WIDA Istation SBA Science & Spanish Reading New Mexico’s Statewide Assessment Model Aligns to state adopted academic standards Produces results used to inform college and career readiness Undergirds the belief that all students can learn and achieve at high levels Holds schools and the PED accountable to create equity and opportunities for students
3
PED Presenters Lynn Vasquez Dr. Brigette Russell Kimber Sanchez
Director of Assessment Deputy Director of Assessment Kimber Sanchez Kirsi Laine Assessment Coordinator English Learner Specialist Karen Greer Dr. Steve DeLeon Adam Rios Project Coordinator
4
Spring 2019 Assessment Calendar
Istation ISIP Middle of Year (MOY): January 1 – 31 End of Year (EOY): May 1 – May 31 ACCESS January 14 – March 8 NAEP January 28 – March 8 (sampled schools only) SBA Science March 4 – 29 NMAPA March 11 – April 5 NMASR Field Test April 8 – April 26 (sampled schools only) Spanish Reading April 22 – May 10 Math & ELA Transition SBA EoCs & Precision Exams Last 3 weeks of the semester
5
Required Assessments & Student Participation
Federal and State Law require all students to participate Federal: ESEA; HR1, Title1, Part A, Subpart 1, Section 1111, (b), 3, C State of New Mexico: Section 22-2C-4 NMSA 1978 content/uploads/2017/12/CCRB_graduation_NMSA.22-2C- 4.Statewide.Assessment.and_.Accountabiity.System.pdf M (1) NMAC One exception: A student with a rare and unique condition that prevents him/her from receiving instruction may receive a medical exemption with PED approval. coordinator/
6
References for Training
DTCs are responsible for reading and understanding all appropriate rules, manuals, and other test administration materials. NMAC, Standardized Testing Procedures & Requirements (Filed December 7, 2018) The following manuals also apply: Test Coordinator Manuals (TCMs) Test Administration Manuals/ Directions for Administration (TAMs/DFAs) Accommodations Manuals
7
Student Right to Privacy
Family Educational Rights and Privacy Act (FERPA) Health Insurance Portability & Accountability Act (HIPAA) LEA staff should only use SSID numbers for transmitting communication. If a large volume of student information needs to be communicated, it needs to be sent by a secure mechanism: Accellion
8
Assessment Roles and Training Model
PED Assessment Bureau District Test Coordinator(s) School A STC, Principal Test Administrators, Proctors School B District Charter School Test Coordinator State Charter & State-Supported Institution Test Coordinator BIE Test Coordinator Superintendent Charter Admin. BIE Admin.
9
Special Thanks to Sarah Draughon, AAAC Member, Las Cruces
10
Superintendents, BIE Administrators, & State Charter Administrators
Sign to Designate District Test Coordinator Form Verify that procedures are followed correctly Sign Superintendent Verification form and send to PED twice per year
11
Public and Charter School Principals
Attend local trainings by DTC Verify that procedures are followed correctly Sign Principal Verification form and maintain at school/district for five years
12
DTC Leadership Responsibilities
Attends PED assessment trainings and provides local trainings Serves as primary liaison with PED and testing vendors Must be completely knowledgeable of NMAC Communicates assessment information to district, schools, parents, and community Develops District Test Security Policy or Checklist
13
DTC Test Administration Responsibilities
Inspects schools’ accommodations documents Ensures TAs and Proctors are certified, trained, and have signed Confidentiality Agreements Inspects schools to ensure secure storage of assessment materials and tracking procedures are followed Reports irregularities to PED and conducts investigations
14
DTC Post-Test Responsibilities
Works with STCs to ensure that: all students were tested all student data are complete and accurate all secure materials returned to vendors according to directions
15
PED Liaison Responsibilities
Works with PED to ensure: All required forms are submitted to PED LEA is responsive to Troubled Child Alerts Teachers have access to available resources for content area assessments LEA is kept up to date on assessment policy and guidance changes
16
Licensing Requirements for DTCs, STCs, and TAs
DTCs, STCs, and TAs must hold one of the following valid PED licenses: School Instructor Administrator School Counselor, Student Success Advisor, Educational Diagnostician, Interpreter for the Deaf, Rehabilitation Counselor, School Psychologist, School Social Worker, or Speech Language Pathologist
17
Substitutes as Test Administrators
Long-term substitutes holding a current PED license may serve as TAs. Short-term substitutes, educational assistants (EAs), school nurses, and coaches may not serve as TAs, unless they also have another valid license listed on the previous slide.
18
Test Mode All districts and charter schools are expected to test online for SBA Science and ACCESS. LEAs will flexibility in the Spring 2019 transition assessment for ELA and math. PED monitors paper orders and revokes orders not supported by a CBT waiver. Point of Interest: Math & ELA online trend across years: 2015: 92% tested online 2016: 97.3% tested online 2017: 97.8% tested online 2018: 98.8% tested online
19
CBT Scheduling Schools may create their own schedules
Within content areas, units must be administered in sequential order No specific order for content areas – may administer ELA or Mathematics first Students may alternate between content areas Schedule each unit/session within a grade/course as close together as possible.
20
PBT Scheduling Test sessions must follow order in the test booklet. (Make-ups may have exceptions.) All schools in district must follow same schedule. No testing on materials-packaging day. All materials must be returned on/by designated shipping day.
21
PBT Allowance A student may test PBT without a waiver if he or she:
has a disability that requires this accommodation is a transfer to the school within 3 months prior to testing and lacks adequate computer skills
22
TEST SECURITY
23
Why is Security Important?
Assessment data used for accountability and security maintains validity and accuracy Assessment items can be used to allow for year-to-year comparability Investments of public resources and time are protected Ensures that students receive no unfair advantages or disadvantages during testing
24
What is a Testing Irregularity?
Any incident in the handling or administration of a test that results in questioning the accuracy of the data or security of the test that leads to one of the following outcomes: Test remains valid Test or test attempt is invalidated and student may or may not retest
25
Examples of Common Test Irregularities
Actively monitor before, during and after testing to avoid irregularities Cell phones or other nonallowed electronic devices Student is sick and needs to leave during the test Starting a test without accommodations in place Students move past the current test session TAs deviate from administration directions or script
26
Security Reminders By Mode
Paper-Based Materials Security Computer-Based Test Security Must be locked and secured by STC/DTC Do not share user names or passwords. Daily chain of custody & accountability on test booklets and materials Ensure no student writing appears if reference materials are shared among sessions TAs sign out and check in materials before and after testing Sign out and check in secure testing tickets Saving or reproduction of test materials is prohibited Reviewing or taking images of monitor is prohibited Collect prohibited devices for students Monitor during the test
27
Computer-Based Test (CBT) Security
Prepare the room so that no student can view another student’s computer screen. Supervise students at all times. No cell phones or other unapproved electronic devices. No talking during testing. Do not share user names or passwords. Destroy used scratch paper at the end of the test. Follow all security policies and test administration protocols.
28
If a Testing Irregularity Occurs…
TA immediately reports test irregularity to STC. STC reports the irregularity to the Principal and DTC. Notify PED by telephone/ within 3 days. DTC conducts an investigation to determine whether incident is impactful or non-impactful. Does a student test need to be invalidated? Complete a PED Test Irregularity Reporting Form. the form within 10 days to
29
Irregularity Process START END
TA reports to STC STC Reports to DTC or Principal DTC Notifies PED within 3 days DTC conducts investigation; PED determines state action DTC submits Irregularity Form to PED within 10 days PED makes determination END
30
Corrective Measures Student: Student reprimands are handled at the local level. TA: TA reprimands may be handled at the local level. Depending on the severity, PED may refer the irregularity for investigation and possible action by the Licensure Bureau. Note: Unintentional testing irregularities that affect the validity of the assessment may also be investigated by PED.
31
Irregularity Reporting Form
32
Document Retention Keep Secure:
Paper forms and tickets should be locked and secured while in LEA/BIE possession. Keep for 5 years: Forms related to DTC training (e.g., Confidentiality, Superintendent Verification, Training verification sheets/sign in documents, Medical Exemptions, Testing Irregularity Forms, waivers) Destroy After Testing: Scratch paper, test tickets, formula sheets if they have writing. Return on Time: PED will be auditing schools/district with history of missing materials. Proper packaging of paper test materials and scorable forms is the responsibility of the district.
33
Missing Materials Loss of state test materials is a security breach.
TA must report missing materials to STC. DTC must also notify the vendor’s help desk and PED. Missing Test Materials Reporting Form:
34
PED Site Monitoring PED may visit a campus while testing to ensure proper test administration and procedures. Proper chain of custody documents are in place Identified secure storage area(s) Correct assignments of accommodations per IEP, 504, and EL plans
35
Participants are welcome to type questions into the chat box or email: ped.assessment@state.nm.us
36
ISTATION’S INDICATORS OF STUDENT PROGRESS
37
Istation’s Indicators of Progress (ISIP)
Assessment Program: Istation’s Indicators of Progress (ISIP) Required Grades: K-2 statewide At grade 3, Istation tests are required for Reads to Lead, RDA, and K3 Plus sites.
38
Istation Quick Links Istation Help Desk New Mexico Istation Website
READ (7323) New Mexico Istation Website (Locate state memorandums on Istation changes). (Locate PED memorandums on Istation changes; Levels 4 and 5 for profciency). Getting Started with Istation Istation Accommodations Istation Reporting and Management Website (Watch video on changes to from Tiers to Levels). Questions on PED Early Literacy initiatives Questions on PED Istation policies or
39
Istation’s Indicators of Progress (ISIP)
K–3 formative assessments available for measuring reading and are available in English and Spanish. Istation is required for students in K-2 for all New Mexico districts and charter schools. Schools participating in K-3 Plus conduct ISIP assessments at the beginning, middle, and end of the 25 or 20 day program.
40
Istation Use Above Grade 2
Grade Level Number of LEAs Percentage of LEAs 3rd 85 64.4% 4th 52 39.4% 5th 51 38.6% 6th 28 21.2% 7th 14 10.6% 8th 9th 4 3.0% 10th 11th 3 2.3% 12th 2 1.5% Overall, 63.6% of LEAs administer Istation outside of grades K-2.
41
ISIP* Reading | PreK - 3 Grade Subtest Kindergarten
Listening/Language Comprehension Phonological & Phonemic Awareness Letter Knowledge Vocabulary 1st Grade Phonological & Phonemic Awareness Letter Knowledge Vocabulary Alphabetic Decoding Reading Comprehension Spelling 2nd -3rd Grade Vocabulary Reading Comprehension Spelling Text Fluency
42
ISIP* Español | PreK - 3 Grade Subtest Kindergarten
Listening Comprehension Phonemic & Phonological Awareness Vocabulary Reading Comprehension 1st Grade Phonemic & Phonological Awareness Vocabulary Reading Comprehension Writing Component 2nd -3rd Grade Vocabulary Reading Comprehension Writing Component Receptive Fluency
43
Formative Assessments ISIP™ Teacher-Led Lessons & Tools
Istation Features Formative Assessments ISIP™ Professional Development Real-Time, Personalized Student Data Teacher-Led Lessons & Tools
44
ISIP Assessment Accommodations for Special Populations
Only administrators with manager accounts can assign accommodations to students in the Istation Report and Management Portal. 1. Special Devices Compatibility: Touch Screen Overlay: This USB touch screen can be applied to monitors. It acts like a standard pointing device. Istation is known to work well with touch screen overlays. Even a student using a head stylus can use this device. ZoomText Software: This software allows the user to zoom in to a very low screen resolution (so things look bigger) with automatic scrolling of the screen when the mouse is moved. 2. Other accommodations available for students on an IEP or 504 plan. Scribe color overlays sign language
45
ISIP Testing Features (non accommodations)
Computer-Adaptive Testing: ISIP is a computer-adaptive assessment that quickly adapts to each individual student response. A student will be given test questions within his or her ability range, regardless of age or grade. Review of Directions: ISIP assessments have an embedded review of test directions within the assessment and between subtests. Directions can also be narrated to the student in Spanish. Verbal and Visual Cues: ISIP assessments have embedded verbal and visual cues to aid students in staying on task. On-Demand Assessments: ISIP assessments can be given in addition to the automatic monthly assessment for more frequent progress monitoring or to validate results.
46
PED Changes to Tiers to Levels
What do I do? Recommend intensive intervention (targeted small-group interventions or one-to-one) Level 1 Recommend supplemental intervention such as targeted small-group interventions Level 2 Level 3 Recommend intervention for all students by differentiating instruction Delineation of top 3 levels serves as communication tool and can be used by teachers to differentiate core instruction Level 4 Level 5 Core classroom instruction for all
47
Istation Testing Window 2018-19 School Year
BOY August or September 2018 (Initial Attempt in the System) MOY January 2019 EOY May 2019 *The Literacy Bureau provided a list of K-3 Plus programs statewide so that Istation would know when to reconfigure the system so that K-3 Plus end of program results were not convoluted with BOY for school year results. The reconfiguration date was August 10th.
48
ISIP Results Ability Score 90th % tile 240 220 200 180
Ability scores communicate how students performed on the monthly ISIP Assessment. Students who have the same ability score, regardless of grade, have similar ability levels. 240 220 200 180 160 140 120 1st Grade Student 225 3rd Grade Student 225 After students take the ISIP formative assessment, they receive an Overall Ability Score, as well as and Ability Score for each subtest. Istation’s Reading Ability Scores are used to measure a student’s skill level over time. Since ISIP is adaptive and the test questions are displayed based on student performance, not age or grade, identical ability indices across grades mean the same thing. For example, a first grader who receives a score of 215 and a third grader who receives a score of 215 are performing at the same level. National norms for ISIP Early Reading are provided for students in Pre-Kindergarten through Grade 3. These norms enable teachers and parents to know how their students' scores compare with a nationally representative sample of children in their particular grade. Much like a doctor uses a nationally normed height and weight chart at the doctor’s office, these percentiles give practitioners insight into the varying needs of students. For example, what would a doctor tell a mother if the child’s percentile rank in weight was very low compared to other babies the same age, and in fact the percentile was dropping over time? The doctor would tell the mother to add in some extra feeding times and also supplement with formula or other supplements. That is exactly what happens when a child is struggling in reading, we must add in extra time and different types of instruction to meet their needs and help them grow. Then, we must track that percentile rank change/growth over time to measure the effectiveness of the the extra support being given. 90th % tile 22nd % tile
49
Why are percentiles so important?
Percentiles can be used to: Plan for different levels of instructional support Set goals and track growth over time Monitor effectiveness of instruction Communicate with parents
50
ISIP Executive Summary Report Changes
51
Student Summary Handout Changes
52
Priority Report Changes
ISIP groups indicate difficulty on the test Other groups indicate difficulty in their personal learning path Ability to document interventions
53
Intervention Groups Documenting Priority Report to track progress
Now with the knowledge of Teacher Resources, and lessons to deliver, let’s go back to Priority Report to document interventions and make anecdotal notes.
54
Summary Report Changes
Classroom Summary Report Changes Provides data for assessment and instruction Helpful to form small groups Review as needed to group students
56
Science Standards Based Assessment (SBA) Spanish Reading SBA
New Mexico Assessment of Science Readiness (NMASR) Field Test
57
Agenda Measured Progress Spring 2019 Test Overview Science SBA
Spring Spanish Reading SBA NMASR FT Online Ordering SBA Paper-Based Testing Administration SBA PBT Packing, Returning, and UPS Pickup SBA Online Reporting SBA Help & Support Page Help Desk Contact Information Science Computer-Based Testing
58
Science SBA Spanish Reading SBA
59
Measured Progress Test Overview
Spring 2019 Science SBA: Grades 4, 7, HS Paper- and Computer-Based English Spanish Special PBT forms: Large Print, Braille Spring 2019 Spanish Reading SBA: Grades 3 – 8 & HS Paper-Based Only
60
Measured Progress Test Overview
Science SBA Practice Tests: Grades 4, 7, HS Computer-Based Practice Testing The practice tests will be available via desktop/laptop kiosk, mobile app, and browser. Paper-Based Practice Testing (downloadable files) English (one form per grade) Spanish (one form per grade) Print-Ready PDF file for regular booklets Print-Ready BRF file for Braille Print-Ready PDF file for Large Print Available at Help & Support Page:
61
Spring 2019 Science SBA Pricing and Key Dates
Science SBA Spring 2019 PBT: $18.93 | CBT: $13.74 Initial Ordering Window (Science PBT & CBT*) December 10 – January 18, 2019 (5pm MT) Science Spring 2019 SBA CBT Practice Test (non-kiosk based/single sign-on web-based) January 22 – March 29, 2019 (kiosk-based) January 22– February 8, 2019 Initial PBT Orders Arrive (TB, AD, Manuals (PBT and CBT), Pre-ID labels (PBT), Rosters) By February 15, 2019 Additional Ordering Window February 18 – March 28 (5pm MT) (Order materials no later than March 22!) Testing Window March 4– March 29, 2019 Pick-up Window All PBT Materials March 11 – April 5, 2019 Online Reports Available TBD Printed Paper Reports Arrive *Contact the PED with any CBT waiver requests prior to finalizing your online ordering!
62
Spanish Reading SBA Spring 2019
Spring 2019 Spanish Reading SBA Pricing and Key Dates Spanish Reading SBA Spring 2019 PBT $18.93 Initial Ordering Window January 28 – March 8, 2019 (5pm MT) Initial PBT Orders Arrive (TB, AD, Manuals, Pre-ID labels, Rosters) By April 8, 2019 Additional Ordering Window April 2 – May 9, 2019 (5pm MT) (Order materials no later than May 3!) Testing Window April 22 – May 10, 2019 Pick-up Window All PBT Materials April 29 – May 15, 2019 Online Reports Available TBD Printed Paper Reports Arrive
63
ONLINE OrDERING
64
Measured Progress Online Ordering http://iservices. measuredprogress
Contact the New Mexico Help Desk if you need your username or password! Click on Select “New Mexico” from the drop-down menu. Remember to have a Purchase Order number ready. Select “Order Test Materials” to begin order. Select “NM Spring 2019” Enter username and password. You have two different passwords: *Online Ordering *Online Reporting
65
Measured Progress Online Ordering SBA Purchase Orders and Invoicing
As in past years, districts are responsible for a portion of the cost for SBA testing. The districts’ per student cost for the school year administrations are: CBT: $13.74 per test scored PBT: $18.93 per answer booklet returned for scoring Under the new contract, PED continues with the policy that districts will only be invoiced for SBA tests scored (whether CBT or PBT). Schools/districts shall not be invoiced for partial or aborted tests The cost of each accommodated PBT form (e.g., large print or Braille) is the same as the cost for a non-accommodated test
66
PACKING OF PBT MATERIALS FOR RETURN, Ups pickup
67
Preparing PBT materials for return
Make sure to refer to the Test Coordinator Manual (TCM) pages for detailed directions on how to prepare and pack PBT materials for return A few reminders: If you tested online only, then there is nothing to return—you may shred/recycle your printed Test Administration Manuals (TAMs). Use the same shipping boxes to return the PBT materials. Do not return test materials that are contaminated with biohazardous materials such as blood or vomit. Do not return manuals or unused pre-ID labels—you may securely destroy unused ‘pre-ID’ labels. ALL paper test booklets and answer documents, even unused, must be returned. The total number of PBT materials received by the districts or schools should match the total number of PBT materials returned.
68
Spring SBA Administrations PBT Materials UPS Pickup Scheduling
Schedule UPS Pickup of the SBA PBT materials NM Online Services Page, choose UPS Pickup Request Select Administration Enter Return Service Label Tracking # Click Login You can schedule your pickup or hand off materials to your local UPS driver.
69
SBA Spring Administration PBT Materials UPS Pickup Scheduling
The address associated with the return service label will be pre-populated. If you need a pickup at a different location than what the label says, enter new information. Requests placed before 2:00 p.m. MT will be scheduled for the next business day. Requests placed after 2:00 p.m. MT will be scheduled for the second business day.
70
Online reporting
71
Online Reporting http://iservices.measuredprogress.org
Online reports are available for all SBA Administrations. Report Mode Student Report to Parents 2 printed copies and online Student Results Labels Printed copy only Student Roster Report Online Student Report to Teachers-by Subject Performance by Subgroup Category Report Item Plot Report District Summary Roster Student Results Data File Benchmark Data File
72
Student Reports to Parents available for fall 2018 retests
NEW! Student Reports to Parents available for fall 2018 retests Online Reporting Reports offered online for Science SBA, Spanish Reading SBA, Legacy Reading/Mathematics Fall Retest Administrations (HSCE & HSGA) HSCE Reports Counselor's Report Pass/Fail File Layout School Pass/Fail File Winter 2016 was last HSCE administration! SBA fall retests cover Science and Spanish Reading. HSGA reading and mathematics cover the Legacy Graduation Tests. Reports Student Results Data File Student Results Data File Layout Student Roster Report Student Reports to Parents
73
Online Reporting Reports are only available online except for Student Report Labels and Student Reports to Parents, which are printed and shipped to districts. All online reports can be accessed anytime and printed locally. Your user name is your District Code, or District & School Code. DTCs can call Measured Progress for a password, if needed. Your Online Reporting password is different than your online ordering password!
74
Online Reporting Select the Reporting Tab Select your Year
Summary Reports & Parent Reports are located at grade level. Select the Reporting Tab Select your Year Select your administration
75
Online Reporting Select the report you need
Then download! Select Choose to open or save your reports Static reports open as PDFs Data files open in Excel
76
Online Reporting http://iservices.measuredprogress.org
Supporting documents located on tab 3. Interpretive Guide to SBA for Schools and Districts SBA Assessment Standards and Frameworks SBA Performance Level Descriptors New Mexico Analysis and Reporting System User and Training Guide
77
New Mexico Assessment of Science Readiness (NMASR) Field Test
78
NMASR FT Overview Spring 2019 NMASR Field Test: Grades 5, 8, HS – Standalone FT Computer Based ONLY English Spanish Practice Test NM-ASR Practice Test: Grades 5, 8, HS Computer-Based Practice Testing Single user login credentials (same as SBA practice test) Link available at H&S Page:
79
NMASR FT Test Overview Schools were randomly selected for the NMASR Field Test. PED sent a communication to selected schools on Friday, November 30. Participation is required if your school was selected. Because this spring 2019 the NMASR is a stand-alone field test, selected schools will not need to order the materials. PED will provide a student pre-ID file for student demographic information that Measured Progress will upload to the iTester platform prior to the operational testing window.
80
Spring 2019 NMASR Field Test Key Dates
NMASR FT Dates Practice test available (browser single user logon) March 11 – April 26, 2019 Field Test Administration (online only) April 8 – April 26, 2019
81
SBA, NMASR FT Help and Support Page www. measuredprogress
SBA, NMASR FT Help and Support Page What’s New, Important Dates Guides, Manuals Test Administration Manuals Science SBA Practice Test PDF files Links to CBT Practice Tests for Science SBA & NMASR FT SBA reports samples, interpretive guides
82
Measured Progress New Mexico Helpdesk Contact Information Phone: for general questions for technical questions
83
Online TESTIng
84
2019 Spring Science Assessment CBT Training
Science SBA and Assessment of Science Readiness Field Test iTester™ William Kinnison, eMetric
85
Key Dates Spring 2019 SBA Science Test Milestones
SBA Practice Test Begins Portal Opens (manage users, download kiosks) 22 Jan 2019 New Mexico Science Assessment Portal closes to load spring operational Pre-ID 8 Feb 2019 New Mexico Science Assessment Portal opens for student data editing 19 Feb 2019 SBA test available to schedule 25 Feb 2019 SBA test administration window opens 4 Mar 2019 SBA test administration window closes SBA practice test closes 29 Mar 2019 New Mexico Science Assessment Portal closes (unless you are participating in the ASR SAFT) 3 Apr 2019 Spring 2019 Assessment of Science Readiness (ASR) Stand-Alone Field Test (SAFT) Milestones ASR SAFT practice test begins 11 Mar 2019 ASR SAFT available to schedule 1 Apr 2019 ASR SAFT test administration window opens 8 Apr 2019 ASR SAFT test administration window closes ASR SAFT practice test closes New Mexico Science Assessment Portal closes 26 Apr 2019
86
iTester™ New Mexico Science Assessment Kiosk:
Student Test Delivery System New Mexico Science Assessment Portal: Online Test Administration System This system will support the Spring SBA Science Assessment and the Assessment of Science Readiness Field Test
87
Test Preparation Process
1. New DTC accounts made, previous administration’s DTC accounts opened 2. DTCs create subordinate accounts for new users 3. New/current users confirm log-in Tech Coordinators Review Kiosk Installation Guide Download & install kiosk on test devices Conduct integrated Site Readiness Test Certify site is ready to test DTC/STC Add/Edit/Transfer Students Assign Accessibility Features and Accommodations Create classes Assign classes to tests (Test Sessions) DTC/STC/TA Review test session (Classes & Accommodations) Print Student Log-in tickets Students Launch kiosk Log-in and test At end of test… DTC/STC/TA If needed, add test report codes and invalidate tests
88
Orientation and New Features
New Mexico Science Assessment Portal: Online Test Administration System Orientation and New Features
89
User Accounts Portal Opens Jan 22, 2019
Not a DTC, don’t have an account? District Test Coordinators must create all other portal users within the Portal Users will receive automated with username and temporary password from Deactivate unused accounts immediately after portal opens! STC’s can view dashboard NEW! See on line video tutorials for demonstrations!
90
Yes for assigned test sessions
User Accounts DTC STC (for orgs assigned) ITC TA Manage Users Yes View TA Access Site Readiness Links No Access Proctor Password Access Students Access Classes Access Test Sessions Yes for assigned test sessions Download Test Completion Status Access Dashboard Invalidate Test
91
User Accounts Landing Page Proctor Password (DTCs Only) Admin Page
92
Students Students Loaded from State Pre-ID
2/1/2019 Students Students Loaded from State Pre-ID Available in Portal on Feb 19, 2019 Check student rosters Download roster by selecting “Download List” under the “More” drop down Add, un-enroll, or transfer students as needed Can’t add student? They may be enrolled in different school – contact help desk DTCs can transfer students between schools in their district Call help desk to transfer students between districts Assign accommodations You must assign all accommodations to students You can use the Export Accommodations button to download list of all students and their currently assigned accommodations You can use the Upload Accommodations button to upload accommodations to multiple students at one time Upload Accommodations button will not be available after test window opens! See on line video tutorials for demonstrations!
93
Students Changes on Student tab:
2/1/2019 Students Changes on Student tab: Added grades 5 and 8 to student information tab grade selector Student accessibility features and accommodations options have changed Line reader and answer masking are now universal tools (accessibility features available to all) – all students will automatically have access to this Allow Accessibility Mode – allows third party accessibility software to operate concurrently with the student testing kiosk Examples of devices: screen readers and speech-to-text software Test specific software to be used with iTester practice test and kiosk prior to student testing! Must enter proctor password to activate New layout on student accommodations tab NEW!
94
2/1/2019 Students
95
2/1/2019 Students Delivered within iTester Student Kiosk Must also schedule student for the Spanish version of the test
96
Classes Groups of one or more students who will take a test
2/1/2019 Classes Groups of one or more students who will take a test Separate class needed for English and Spanish Testers Classes cannot be deleted once they have been saved Students can be assigned to more than one class! When class grade is selected, only students in that grade will be available in the list of students NEW! Use this check box to prevent students from being assigned to more than one class
97
Test Sessions Preparing for and monitoring testing
2/1/2019 Test Sessions Preparing for and monitoring testing Schedule a test session (assign class to test) Check test name for language, grade (and SBA vs ASR if you participating the ASR field test) Go to the scheduled test session to: Retrieve Session Access Codes Review students in the test session Check student forms (TTS) Print test tickets with students’ usernames and passwords Ensure student has platform-delivered accessibility and accommodations on test ticket Monitor test sessions, download test session information Also the download test sessions summary feature. See online video tutorials for demonstrations!
98
Test Sessions Completing testing
2/1/2019 Test Sessions Completing testing Check student test status for tests “not started” or “in progress” For students who cannot complete the test: Invalidate each of the test sessions and Enter a test completion code When the test is both invalidated and a test completion code is entered, the test will not be reported If a test is inadvertently invalidated or a test report code is entered, the test can be reactivated and the test report code can be removed Note: Students can still log into a test regardless of the test invalidation or test report code Complete the above activities prior to the advertised portal closing date (April 3 for Spring 2019 SBA Science) No other action is needed to complete the test administration! NEW! Not real time – previous days data going back to day 1
99
See on line video tutorials for demonstrations!
2/1/2019 Session Access Code Test Tickets Test Report Code Test Status Form Name Test Invalidate Not real time – previous days data going back to day 1 See on line video tutorials for demonstrations!
100
Administration: Other Features
2/1/2019 Administration: Other Features District and School-level dashboard for monitoring testing Not to be used for accountability purposes! Download list of students with their test completion status by school/test STCs can access the dashboard to view test statistics for their school(s) NEW! Not real time – previous days data going back to day 1 See on line video tutorials for demonstrations!
101
New Mexico Science Assessment Kiosk: Student Test Delivery System
Orientation and New Features
102
2/1/2019 Logging in to a Test If the kiosk is out-of-date, an alert will be displayed
103
2/1/2019 Logging in to a Test
104
Logging in to a Test NEW!
105
Logging in to a Test NEW!
106
Test Navigation NEW!
107
Test Navigation NEW! NEW!
108
Test Navigation NEW!
109
Accessibility Features (all students)
2/1/2019 Accessibility Features (all students) Name Tool Icon Sketch Tool (Not available on constructed response items) Highlighter Note Pad Line Reader Answer Masking Reference Sheet (Spanish Only) Pop-up Glossary (ASR Field Test) NEW! NEW! NEW! If they pause test, these will not be saved! NEW!
110
Accessibility Features Identified In Advance
2/1/2019 Accessibility Features Identified In Advance Name Tool Icon Zoom View (magnifier) Reverse Contrast Custom Masking Color Contrast Accommodations (for students with disabilities and/or ELs) Name Tool Icon Text-to-Speech English (SWD, 504, EL) Text-to-Speech Spanish (SWD, 504, EL) Allow Accessibility Mode Testing No icon (See slide 23) NEW!
111
Special Situations (TTS)
2/1/2019 Special Situations (TTS) The Science SBA Kiosk uses the default voice set on the student’s workstation. See Kiosk Installation Guide for specific steps on how to change the default voice. Assign all student text-to-speech accommodations PRIOR to student logging into tests. If you need to add an accommodation after scheduling a student, but before they log in, click on Generate Missing Student Test Logins button after TTS has been added: If student logs in and realizes they do not have TTS, you must assign accommodation and then place them in new/different class.
112
Special Situations (Spanish Tests)
Create separate class for Spanish test Schedule Spanish class for Spanish test Ensure Student changes Kiosk to Spanish version before they log-in Spanish TTS Accommodation Ensure Spanish TTS is selected Use Cepstral Software Switch between English and Spanish Kiosk
113
Test Turn-In Steps Button to Click
2/1/2019 Test Turn-In Steps Button to Click On the last item, students click Finish. On the test review screen, students click Turn In. Below the confirmation question, students click Turn In. Student returns to test section selection page and may select the next section or click Exit to exit the kiosk.
114
Finishing Testing Ensure no students are still “in progress”
2/1/2019 Finishing Testing Ensure no students are still “in progress” Use “Download Test Session Details” in Portal main test session tab for complete list! Ensure any workstation that had stored responses was relaunched after the network connection has been restored (see slides 41-44) For students who did not complete test, add test report codes and invalidate tests in accordance with PED policy
115
Special Situations (Proctor Password)
2/1/2019 Special Situations (Proctor Password) Type of Password Utilization Entered By Student Password Used to log the student into the appropriate test Student Session Access Code Used to log the student into the appropriate session of the test Proctor Password** Required if: Student has been paused test for more than 20 minutes Student has been inactive for more than hour Student has the Allow Accessibility Mode accommodation If the student has saved responses on their device (see slide 43: “What if a student finishes a test but has no network connection?”) Proctor Proctor password must be kept confidential.
116
Site Technology Preparation
iTester™ Site Technology Preparation
117
Kiosk Requirements Windows and Mac Applications
2/1/2019 Kiosk Requirements Windows and Mac Applications Available to download in Portal (22 Jan 2019) iPad and Chromebook Applications Available to download in iTunes/Google Play Browser (practice test only) Available on Chrome, Safari, Internet Explorer, Firefox, and Microsoft Edge New kiosks are ARE required for Spring 2019!
118
System Requirements – All Hardware
2/1/2019 Kiosk Requirements Updated! System Requirements – All Hardware Connectivity Must be able to connect to the internet via wired or wireless networks Screen Size 9.7” screen size or larger/ “10-inch class” tablets or larger Screen Resolution 1024 X 768 Browsers (Practice Test ONLY) Chrome™ 71 or newer Firefox® 64 or newer Safari® 12 or newer Internet Explorer® 11 Microsoft Edge™ or newer Headphone/Earphone/Ear Buds Headphones/earphones/ear buds are required for students who have a text-to-speech accommodation Updated 21 Dec Check the Measured Progress help and support site for more recent updates.
119
Desktop and Laptop Specific Requirements
2/1/2019 Desktop and Laptop Specific Requirements CPU 1.3 GHz Memory 2 GB (4GB strongly recommended) Input Device Keyboard – wired or wireless/Bluetooth® mouse or touchpad Windows® operating system Windows 7, 8.1, 10 (32-bit and 64-bit) Mac OS® operating system 10.12* – (64-bit only) Tablet/Netbook/2-in-1 Specific Requirements iPad® 11.4 – 12.1 Chromebook™ notebook computer Chrome OSTM 69 – 71 Windows-based tablets/netbooks/2-in-1 Windows 10 (32-bit and 64-bit) (Windows 10S is not supported) Updated 21 Dec Check the Measured Progress help and support site for more recent updates.
120
Kiosk Requirements (devices)
2/1/2019 Kiosk Requirements (devices) iPad users: use Automatic Assessment Configuration iPad users: external keyboard is optional *Mac 10.12: known bug (disappearing cursor), recommend updating Mac OS 10.14: new setting must be enabled to allow kiosk to launch – see kiosk installation guide Chrome users: ensure user’s local data is not erased Windows users: MSI for distribution using GPOs Best Practice for all OS’s: turn off auto updates during testing Students testing on devices that do not meet the Student Workstation Specifications are likely to encounter performance-related issues during testing. Technology Guidelines may be updated throughout the test administration window as new operating systems are released and tested. Do not update your test device OS until the Technology Guidelines have been updated. Guided Access was used previously Disables spell check, predictive text, etc…
121
1. Submit responses for scoring
2/1/2019 Kiosk Requirements (network) Beginning of Test: Authenticate login Download test content End of Test: 1. Submit responses for scoring What happens if a student loses network connection in the middle of a test?
122
Kiosk Test Integrity A B 45-90sec A B A B C D C Stored Response Folder
2/1/2019 Kiosk Test Integrity 45-90sec A D B C Stored Response Folder A D B C Pause, log out is OK, A D B C
123
What if a student finishes a test but has no network connection?
2/1/2019 What if a student finishes a test but has no network connection? A D B C A D B C Turn In Pause, log out is OK,
124
Kiosk Test Integrity Loss of Network Connectivity Procedure Summary
If a student loses network connectivity in the middle of a test: Keep testing on that device Test content and responses are stored securely on the test device Responses will be sent when network is restored If student finishes and is ready to turn in test prior to network being restored: Allow student to turn in test Record the exact device the student is testing on Ensure no network management tools or system maintenance will alter that devices files or configuration When network connectivity is restored, return to that exact device and relaunch the kiosk If you are unsure of the status of the student responses, call the help desk
125
Kiosk Requirements Firewalls Allow traffic through ports 80 and 443 Proxy and Content Filter Servers List of URLs to whitelist on ports 80 and 443 available in Kiosk Installation Guide Sandboxing Applications (e.g. Deep Freeze) Choose network folder or local folder that is not touched by the sandboxing applications Applicable for both stored response and kiosk installation folders Thin Clients Ensure there is enough memory, CPU, and bandwidth on the server to accommodate multiple student test sessions. Client requires a minimum of 80 MB per Client session. Review Kiosk Installation Guide for further information
126
Practice Test Options Use demo students in the portal. Between 22 Jan – 8 Feb, demo students and a practice test will be available in the portal for each school. Assign accommodations to demo students, create classes, schedule test sessions and print log-in tickets for your students. Have student launch the test kiosk and log in to the practice test with the test ticket log in information. Best option for: Practice end-to-end process of editing students, creating classes and scheduling test in the portal Assigning specific accommodations to specific students for practice testing Note: not available for ASR Field test Use single username/password practice test with web browser Practice testing on devices that do not have a testing kiosk installed Note: kiosk is not secure, all accommodations except allow accessibility mode and screen zoom are available Use single username/password practice test with student Kiosk Realistic practice testing in secure kiosk without setting-up tests with demo students in portal and practice after demo students have been removed Note: all accommodations are available except allow accessibility mode
127
Practice Test Options (SBA)
To access the practice test in web browser: Launch Browser go to Enter the credentials below to log-in and begin test To access the practice test in student testing kiosk: Launch Kiosk Click on the “Access the Practice Test” link SBA Practice Test Username Password Grade 4 English G4english practice Grade 4 Spanish G4spanish Grade 7 English G7english Grade 7 Spanish G7spanish High School English HSenglish High School Spanish HSspanish
128
Practice Test Options (ASR)
To access the practice test in web browser: Launch Browser go to Enter the credentials below to log-in and begin test To access the practice test in student testing kiosk: Launch Kiosk Click on the “Access the Practice Test” link ASR Practice Test Username Password Grade 5 English Grade5english practice Grade 5 Spanish Grade5spanish Grade 8 English Grade8english Grade 8 Spanish Grade8spanish High School English Grade11english High School Spanish Grade11spanish
129
Practice Test
130
Additional Training Resources
Help Guides Kiosk Installation Guide Portal User Guide Kiosk User’s Guide (formerly Test Administrators Technology Guide) Technical Guide for Spanish Language Support Training videos ( Support Desk Call-in Information Sheet NEW! NEW!
131
Remember! DTCs/STCs: Deactivate unused accounts
Dashboard is not used for official accountability Test report codes/ test invalidation will not prevent student from logging in to test but will prevent test from being scored Download student test status 1-3 April 2019 to keep record of test status TAs: Ensure Students have TTS form BEFORE they log into test (see TTS slide) Watch out for stored responses (see What happens if student finishes test and network connection has not been restored? slide) ITCs: New Kiosks DO need to be downloaded Turn-off operating system auto updates Both parts of site readiness test must be completed to log site readiness test results Make sure network management tools don’t delete stored response folder Spanish Testers: Spanish version of test must be scheduled – accommodation setting is for record-keeping only (see Spanish Test slide & Spanish Testing Guide)
133
Questions?
134
New Mexico Alternate Performance Assessment (NMAPA)
135
Spring 2019 Window: March 11 – April 5
Assessment Program: New Mexico Alternative Performance Assessment (NMAPA) Required Grades/Subjects: Grade Subject Grade 3 & 5 ELA, Math Grade 4 ELA, Math, Science Grade 6 & 8 Grade 7 Grade 10 Grade 11 ELA, Math, Science, Social Studies Spring 2019 Window: March 11 – April 5
136
NMAPA Banking Student scores proficient in ELA or Math in Grade 10.
Student may bank score for graduation. Student must take Science and Social Studies in Grade 11. Student may not attempt Science or Social Studies in Grade 10. Student scores proficient in ELA or Math in Grade 10. Student retakes ELA or Math in Spring of Grade 11. Student may not use Fall retake window. Grade 10 score may be used as baseline for IEP team to identify cut score when assessment is administered in Grade 11. Student does not score proficient in ELA or Math in Grade 10.
137
NMAPA Quick Links Sample Test Items
Test Coordinator Manuals Teacher Resources Parent Resources Ordering Test Information Distribution Engine (TIDE) NMAPA Help Desk
138
Students and parents may not refuse accountability testing.
Federal and State Law: Students and parents may not refuse accountability testing. All students must participate in state accountability assessments. Federal Statute: Elementary and Secondary Education Act (ESEA) Title I, Part A, Subpart 1, Section 1111, (b), 3, C New Mexico Statute: 22-2C-4 NMSA 1978
139
Eligibility criteria Impairments must affect students in multiple settings. IEP team, as a group of individuals with a clear understanding of a student’s needs, must determine whether that student is eligible to take the NMAPA per (E)(3) NMAC
140
Guiding Questions Does the student’s past and present performance in multiple settings (home, school, community) indicate that a significant cognitive disability is present? Does the student need intensive, pervasive, or extensive levels of support in school, home, and community settings? Do the student’s current cognitive and adaptive skills and performance levels require direct instruction to accomplish the acquisition, maintenance, and generalization of skills in multiple settings (home, school, and community)?
141
Guiding Questions The information gathered through questions 1-3 demonstrates to the team that this student “cannot participate in the regular assessment; and the particular [alternate] assessment selected is appropriate for the child.” Parents have been informed of the potential consequences of having their student assessed against alternate achievement standards (such as potential limitations to postsecondary opportunities).
142
Online ordering Log into the Test Information Distribution Engine (TIDE). ALL students must be in TIDE. ALL answer documents must have a label. Log into TIDE and order: Student Score Forms TA Kits for all tested grades
143
NMAPA Online Training Test Administrator online training is at
Online training opened January 7. Click on Teacher/TA tab, then click
144
NMAPA Online Training The five training modules can be completed in multiple sessions. Manipulatives available to print prior to watching the modules to use during training. Print certificate at the end of training. TAs must be re-certified every two years.
145
Online Training Modules
146
Assessment-Specific Manuals
TCM: Test Coordinator Manual TAM: Test Administration Manual New information for Spring PLEASE READ!
147
Online Reporting System (ORS)
Access at Click on either tab Then click on Online Reporting System (ORS) to see data/reports.
148
Online Reporting System (ORS)
If your students are not in TIDE, they will not be in the ORS. Online access to score reports and score data Users access the ORS through TIDE DTCs or STCs must add Test Administrators as users in TIDE
149
Online Reporting System (ORS)
Download Excel spreadsheets with student scores View school or district overall scores. View individual scores by subtests.
150
Resources
151
PED Policy: ped.assessment@state.nm.us
NMAPA Help Desk Tel Fax
152
Summative Assessment Transition Information for District Test Coordinators
153
Spring 2019 Summative Math & ELA Transition Assessment Memorandum
As stated in the January 10, 2019, memorandum, the transition assessment is: 1 to 1.5 hours shorter per subject area, reducing overall testing time up to 30%; comparable to prior year’s results, with five reporting categories; delivered on the same platform and during the April 22-May 10 scheduled window. A new test will be developed for SY, which will have a new name, TBD.
154
Spring 2019 Summative Math & ELA Transition Assessment Key Messages for Educators
Teachers should continue to do what they do best: teach content with high rigor that is aligned to our adopted New Mexico Common Core Standards (NMCCSS). The test is called the Spring 2019 New Mexico Standards-Based Transition Assessment of Mathematics and English Language Arts. This test is fully aligned to NMCCSS. This is not the same assessment as the old New Mexico SBA for Math and Reading from years past. The prior test was aligned to the former New Mexico Standards and Benchmarks. New Mexico is no longer using the PARCC test blueprint or PARCC test design. A new test blueprint has been developed and there are similarities in test design and structure in order to maintain comparability.
155
Spring 2019 Summative Math & ELA Transition Assessment Comparability Message
This is a transition assessment created with linking items that have undergone educator reviews for content, bias and sensitivity, and field testing. Linking items are items that have been utilized on prior operational forms or were field tested on the spring 2018 forms to allow for comparability, rather than starting from a new baseline. This results in parents, educators, and public officials being able to compare spring 2018 and prior scores to spring 2019 scores. All publicly available resources (e.g., online practice sites) for prior administrations are still appropriate for use as preparation and practice for the Spring 2019 transition assessment. The Spring test will be administered in TestNav and managed through PearsonAccessNext.
156
Comparability Grade 4 ELA 24.9% 25.2% 29.1% Grade 8 ELA 24.4% 27.9%
Subject 2017 NAEP % Proficient 2017 PARCC % Proficient 2018 PARCC % Spring 2019 Transition Summative Assessment % Proficient Grade 4 ELA 24.9% 25.2% 29.1% ? Grade 8 ELA 24.4% 27.9% 29.0% Grade 4 Math 27.2% 23.1% 25.6% Grade 8 Math 20.2% 20.8%
157
Spring 2019 Assessment Transition Quick Links
Support Resource Link PED Spring 2019 Assessment Transition Memo PED Assessment Transition Page Pearson Support Page PearsonAccessNext nm.pearsonaccessnext.com
158
Spring 2019 English Language Arts Design & Unit Times
Students are assigned either Form A or Form B
159
Spring 2019 Mathematics Design & Unit Times
3 Hours for all grades
160
Publicly Available New Mexico Assessment Resources Support Page
Resources Audience Tutorials for Students to use TestNav and tools to be used during the test. Students Parents Teachers Spring 2019 Transition Assessment New Mexico Test Administration Manuals & Spring 2019 Transition Assessment New Mexico Accessibility Features and Accommodations (AF&A) Manual Test Coordinators Test Administrators IEP, 504, and EL Teams NM Support page accessible 2/1/2019
161
Publicly Available New Mexico Assessment Resources Support Page
nm.digitalitemlibrary.com Released 2/1/2019 Access to high quality math and ELA items Ability to search test items by grade, content area, evidence statement, and task type Coming Soon: Teachers will have the ability to create formative “testlettes” and administer formatives in TestNav Professional development will be provided
162
Spring 2019 Transition Assessment Performance Levels Remain the Same for Comparability
Exceeded expectations Level 4 Met expectations Level 3 Approached expectations Level 2 Partially met expectations Level 1 Did not yet meet expectations The Spring 2019 results still inform a level of career and post secondary readiness
163
Important Dates Deliverable Date
Release of Feb. 1 Spring 2019 SR/PNP import window Feb. 4 – March 8 Fall Block 2018 reports in PAN March 11 Fall Block 2018 ISRs shipped March 31 Spring 2019 materials arrive at LEAs April 8* Spring 2019 Testing Window April 22 – May 10 Spring Results Available in PAN for DTCs 2 weeks after test submission for online tests* *Subject to change
164
Reports and Data Transition Assessment Individual Student Report (ISR)
Transition Assessment School Roster Report Transition Assessment District Summary Report Transition Assessment District and School Summative Files Transition Assessment Performance Level Summary Report Transition Assessment Evidence Statement Analysis Report Transition Assessment Content Standards Roster Report
165
Publicly Available Accessibility Features and Accommodations
The Spring 2019 New Mexico AF&A Manual will be available at on 2/1/2019 Quick Reference Version at PED Website: content/uploads/2019/01/FINAL_Accessibility- Accommodations-Features.pdf Accessibility Features for all Students Administrative Considerations Accommodations for Students with Disabilities Accommodations for English Learners
166
Accessibility Features for All Students
Blank Scratch Paper – Must supply at least 1 sheet for each student. Additional pages may be provided as needed. Graph paper may be used. Bookmark – Allows students to flag items. Highlight Tool – Highlighter color option will change depending on the color contrast option selected. Spell Check – Embedded spell check is an accessibility feature. Spelling is NOT assessed.
167
Administrative Considerations
Frequent Breaks Separate/Alternate Location Small Group Testing Specialized Equipment or Furniture Specified Area or Setting Time of Day
168
Accommodations Must Enable students to participate with equal access.
Be based on individual needs identified in the instructional/assessment setting. Be documented in either the IEP, 504 Plan, or EL Plan. For English learners, be described and documented in the student’s file. Be utilized during daily instruction. Parents receive notification.
169
Text-To-Speech Accessibility vs Accommodations on Assessments
English Language Arts Mathematics Always an accommodation, documented in a legal plan, parent/guardian involved A student need not have an legal plan to receive Text-To-Speech feature assignment for mathematics. This must be a Pre-identified Accessibility Feature in testing system Rare cases/seldom Needs to be thoughtfully assigned, not a blanket assignment for all students in a given grade, class, or school PED Monitored Examples when suitable to assign: A disability that severely limits or prevents them from accessing printed text after varied and repeated attempts to teach accessibility have been exhausted. Student qualifies as documented and receives accommodation during instruction. Student may be in SAT process and deficit skills may be appearing. A discussion between parent, student, and teacher results in assigning text-to-speech for math. Student has utilized this feature during 50% or more of classroom instruction.
170
Accommodation for Students with Disabilities: ELA/Literacy Assessments
Text-to-Speech ASL Video Human Reader/Human Signer
171
Accommodation for Students with Disabilities: Calculators Allowed on Non-Calculator Sections
Grades 3-7: Four-function calculators with square root and percentage functions Grades 8: Scientific calculators High School: Graphing calculators with functions consistent with TI-84 or similar models Reference sheets will be posted at PED Assessment Bureau Webiste: pring2019mathela/
172
Use Accommodations with Caution
Calculators allowed on NON-Calculator Sections and ELA/L Text-To-Speech, ASL video, Human Reader/Human Signer must only be provided to students who meet eligibility criteria listed in the New Mexico 2019 Spring Transition Assessment AF&A Manual. PED will audit schools/districts based on high usage of these accommodations. See ELA text to speech, ASL video, Human Reader/Signer eligibility criteria in the New Mexico 2019 Spring Transition Assessment AF&A Manual.
173
Accommodations for English Language Learners
Content Area Accommodations Mathematics only Spanish Translation of Math Test, Spanish Translation of Math Test in Text-to-Speech, Mathematics Responses Both Content Areas Translation of General Test Directions*, Administration Directions Clarified in Student’s Native Language, Word to Word Dictionary (English/Native Language) *General Test Administration directions available in Spanish and Navajo.
174
PearsonAccessnext (PAN)
Live Site: Training Site: Training site will be available 2/1/2019
175
Technology Specifications
Technology Coordinators must review guidelines on the TestNav support site: For devices supported, see: Browser-based TestNav is no longer supported, please use the TestNav app instead.
176
Technology To-Do List Install new proctor cache software in each school. Install latest version of TestNav app. Configure TestNav in PAN. Conduct local infrastructure trials in March 2019 to address any potential issues arising from technology changes, previous challenges, or new staff.
177
TestNav http://download.testnav.com/
Installation of TestNav app on every testing device. TestNav 8.12 will be availale prior to spring testing. If you have already upgraded to 8.11, no further action is needed; TestNav will auto-update to 8.12. Use of app is required for all online testing situations beginning Spring 2019. Proctor cache software is available at the above website, however is no longer necessary or recommended.
178
PearsonAccessnext PED Responsibilities
Steps PED performs to prepare for summative assessments: Imports initial Organization and Org Participation files. Creates the initial User Accounts for PED-approved test coordinators. Imports Student Registration/PNP File using this year’s 80 day STARS snapshot and accommodations from the Spring 2018 administration.
179
User Accounts in PearsonAccessnext
180
DTC Permissions* * some permissions may change as needed
Request Additional Order- Allows user to place additional orders. Delete Student Role–Allows user to delete students from PAN. Sensitive Data Role–Allows user who will be able to view and edit Student Sensitive Data. Student Test Update Role–Allows user to update student Not Tested Code/Reason and Void Score Code/Reason after testing. Rejected Student Test–Allows user to view resolve rejected paper tests. Published Reports Role–Allows user to access published reports. * some permissions may change as needed
181
Support for PAN User Accounts
Pearson Customer Support: Can reset passwords Can unlock accounts for DTC Test Coordinator accounts Cannot create accounts Cannot lock/unlock accounts other than DTC accounts Cannot update addresses Cannot delete/undelete accounts PED: Only PED staff can create new DTC Test Coordinator accounts LEAs: Can contact if you are a PED-approved DTC/STC and need a PAN user account.
182
Student Registration/Personal Needs Profile
SR/PNP Contains: Student demographic data Test-specific information Assessment accommodations Review/Edit: SR/PNP data PAN user interface File (spreadsheet) import
183
LEAs are able to: Review students pre-registered by PED in the PAN user interface. Change test assignment(s) or PNP information on Manage Student Test screen. Switch student from one school to another (within district transfer). Switch student from one district to another (between districts).
184
Test Session Management
Test Coordinators (DTCs or STCs) must prepare sessions the day before testing. Test Administrator is responsible for unlocking test units. Test Administrator is responsible for locking each test unit BEFORE leaving the testing room. NO TEST SESSIONS ARE TO BE LEFT UNLOCKED WHEN THE UNIT IS COMPLETE.
185
Future Summative Assessment 2019-20 SY
Comparability of results over time still a primary driver for assessment design. This matters to stakeholders. Item & Bias Review meetings will be held in Albuquerque May/June: TBA. Stakeholder engagement meetings on future assessment designs are being planned.
186
PED Policy: ped.assessment@state.nm.us
187
ASSESSMENT OF ENGLISH LEARNERS
188
IDENTIFICATION PROCESS
PART 1 ENGLISH LEARNER IDENTIFICATION PROCESS
189
This Session English Learner (EL) Identification Process
English Language Proficiency Screening Assessments
190
“Every exit is an entry somewhere else.”
—Tom Stoppard
191
ELs Are Protected Federal law through:
Title VI of the 1964 Civil Rights Act Equal Educational Opportunities Act of 1974 requires that all ELs have equal access to a high-quality education opportunity to achieve their full academic potential.
192
Federal Definition of EL
(A) Age 3 – 21; (B) In elementary or secondary school; (C) (i) not born in the US or whose native language is a language other than English; (ii) (I) who is a Native American or Alaskan Native or native resident of the outlying areas and (II) language other than English has had a significant impact on English language proficiency level; or (iii) migratory and where a language other than English is dominant; AND ESSA Section 8101(20)
193
EL Identification Step One
Parents complete the New Mexico language usage survey (LUS)—only for students new to public education If one or more ‘yes’ responses in question 1-6 and/or a language other than English indicated in question 7 student is a potential EL
194
Federal Definition of EL (cont.)
D. whose difficulties in speaking, reading, writing, or understanding the English language denies them the ability to: (i) meet the State’s academic proficiency levels on required assessments; (ii) successfully achieve in classrooms where English is the language of instruction; or (iii) opportunity to participate fully in society. ESSA Section 8101(20)
195
EL Identification Step Two
Potential ELs are administered the department-approved English language proficiency screening assessment W-APT in Kindergarten WIDA Screener Online in grades 1-12
196
EL Identification Step Three
Within two weeks of initial enrollment if not enrolled at the beginning of the school year Parent Notification to parents of identified ELs for a sample letter, please visit
197
LUS Process Map
198
ENGLISH LANGUAGE PROFICIENCY SCREENING ASSESSMENTS
PART 2 ENGLISH LANGUAGE PROFICIENCY SCREENING ASSESSMENTS
199
W-APT Kindergarten WIDA has begun the development of a new Screener for Kindergarten students.
200
Test Administrator—W-APT
Please follow state regulation C(2) NMAC for staff qualified to administer the W-APT. Review all training materials.
201
W-APT Materials Find all materials in the Quick Start Guide (follow links) Review all training materials in section 4 of the Quick Start Guide including the Kindergarten W-APT Webinar.
202
WIDA Screener Online Grades 1-12
203
Where Are the Training Materials?
204
Speaking and Writing WIDA Screener Online calculates Listening and Reading scores automatically. Speaking and Writing scored locally. Speaking and keyboarded Writing responses are electronically recorded in WIDA AMS. Use the WIDA Screener scoring scales For writing, use the Sentence Complexity Guidelines Grades 1-3 and Grades 4-12 under the Materials and Resources tab.
205
Does the Student Have an IEP?
WIDA Screener accessibility and accommodations are the same as for ACCESSS for ELLs 2.0 Exception: WIDA Screener is not available in braille.
206
When Do You Order a Paper Kit?
Students whose IEP or 504 Plan requires a paper-based assessment Newcomers with no previous computer experience
207
Score Reports Score reports available on-demand.
Keep a copy in the student’s cumulative file. Score Reports provide the student’s Proficiency Level (PL) score for each domain, and three different composite scores: 1. Overall 2. Oral Language 3. Literacy All domains must have been completed and scored or the overall score cannot be calculated.
208
Test Administrator —WIDA Screener
Please follow state regulation C.(2) NMAC for staff qualified to administer the WIDA Screener. The TA has to re-certify each school year to administer the test. To be certified, a TA must pass the speaking and writing scoring quizzes with passing score of 80% or higher. Certifications must be kept on file.
209
Testing Irregularities
Submit any testing irregularities that occur with W-APT and WIDA Screener through the Testing Irregularity Reporting Portal.
210
PART 3 WIDA ACCESS for ELLs 2.0
211
This Session General Information and Ordering Test Administration
Accommodations
212
General information and ordering
213
Test Administrator—ACCESS for ELLs
Please follow state regulation C. NMAC for staff qualified to administer the ACCESS for ELLs 2.0 and Kindergarten ACCESS assessments. The TA has to re-certify each school year to administer the tests. To be certified, TAs must complete the required quizzes with passing score of 80% or higher. Certifications must be kept on file.
214
Test Administrator—Alternate ACCESS
Administered by a licensed special education teacher who is familiar with the student, the student’s need, responses, and communication style, or An instructional support provider as defined in B. NMAC who is familiar with the student, student’s needs, responses and communication style The TA has to re-certify each school year to administer the tests. To be certified, TAs must complete the required quizzes with passing score of 80% or higher. Certifications must be kept on file.
215
ACCESS for ELLs 2.0 Annual English language proficiency assessment for all current EL students Testing Window: January 14, 2019 –March 8, 2019 Student growth to proficiency affects the school’s points in the ELP Indicator in school grades.
216
Alternate ACCESS ELs with significant cognitive disabilities are annually administered the Alternate ACCESS for ELLs (Alternate ACCESS) assessment if the students also take the NMAPA. This must be written in the student’s IEP. Alternate ACCESS starts in grade 1.
217
Students with Impairments
The ESEA requires that a State provide appropriate accommodations for ELs with disabilities and, if an EL has a disability that precludes assessment in one or more domains of the ELP assessment such that there are no appropriate accommodations for the affected domain, assess the student’s ELP based on the remaining domains in which it is possible to assess the student.
218
Students with Impairments cont…
Students with impairments that cannot be accommodated: Indicate in the State Defined Optional Data field under Demographics 1 = hearing impairment (HI) 2 = visual impairment (VI) 3 = speaking domain for students taking the braille version (VIBR) 4 = non-verbal (NV)
219
Students with Impairments cont…
Ensure that the student’s IEP or 504 Plan states that the student is unable due to the impairment to take one or more domains on ACCESS for ELLs and that there is no accommodation for the affected domain(s). Non-examples: 1. A student unable to produce functional speech but who uses an Augmentative/Alternative Communication (AAC) device would not be included in the State Defined Optional Data field. 2. A student with visual impairment who can be accommodated with large print (LP) would not be included in the State Defined Optional Data field.
220
Ordering Materials Initial order for test materials was placed by PED through a pre-id file upload to DRC on November 21, 2018. Pre-id file was based on 40D data reporting. WIDA AMS Test Setup has been available for Test Sessions since November 29, 2018. Test materials arrived at districts on January 7, 2019.
221
Initial Orders Material overage sent out with initial order is 15%, which is distributed 7.5% to district, 7.5% to schools No overage for districts with less than 10 initial orders Alternate ACCESS materials are packaged with ACCESS test materials. State Specific Directions are no longer sent in the initial shipment. They can be accessed on the NM State page at wida.wisc.edu.
222
Additional Orders Additional ordering window: January 7, 2019 – March 1, 2019 Use overage before placing an additional order. Consolidate the need for additional materials into one district additional order or a few (if absolutely necessary) placed by the DTC in WIDA AMS In NM had over 600 additional orders In NM had 278 additional orders
223
How to Place an Additional Order
In WIDA AMS Materials > Additional Materials > Add Order button activates once a school is selected Complete Administration, District, School fields, then click “Add Order”
224
How to Place an Additional Order cont…
List of materials Select amounts for each grade and tier Once the order is complete, click Submit. No expedited shipment, except for a very rare emergency
225
Test administration
226
WIDA Secure Portal
227
My Account and Secure Portal
Trainings and quizzes can be found under each tile.
228
Are All TAs Certified? Test Coordinators can also view Test Administrators’ completion of the training courses within the WIDA Secure Portal by clicking on the tile. Certificate listing completed training components Records of training
229
Prior to Testing Use test demos with students
Students get familiar with the platform and the universal tools
230
Universal Tools Audio Aid Color Contrast Color Overlay Highlighter
Line Guide Magnification Sticky Notes Scratch Paper online only
231
Test Administration ACCESS for ELLs is not a timed test.
In the Speaking domain each individual response to each question is timed once the student clicks the Record button. Each domain is a separate test session. A thoughtful test schedule will ensure that students are able to show their English language proficiency (ELP) level
232
Test Administration cont…
Complete a domain in one session. Schedule enough time for students to finish each domain. Do not combine multiple test domains into one test session. For example, the Listening test should be administered in a different test session than the Reading, Writing, or Speaking test. Do not combine online and paper modes for a student Please note: Writing booklets for grades 1-3 are part of online testing.
233
Test Sequence (Order of Test Administration)
Listening – Reading – Speaking – Writing Listening and Reading tier students for the remaining tests, based on performance.
234
ACCOMMODATIONS
235
Accessibility and Accommodations
Scoring and Reporting Accessibility and Accommodations Accommodations for students with disabilities Flexible administrative considerations and universal tools for all students Linguistic scaffolding and Universal Design principals to the development of test items
236
Accommodations Specified in student’s IEP or 504 Plan
Ensure meaningful and appropriate participation Only use allowable accommodations. Accommodations used in daily instruction over a period of time
237
Accommodations (cont.)
Scoring and Reporting Accommodations (cont.) Some accommodations must be preselected in WIDA AMS: Repeat item audio (repeat button) Manual control of item audio Extended speaking test response time For further guidelines please read the Accessibility and Accommodations Supplement, starting page 13.
238
Accessibility and Accommodations Resources
For further guidelines please read the Accessibility and Accommodations Supplement, starting page 13.
239
Post Testing Deadline for shipping completed test materials to DRC: March 15, 2019 Do not wait until the deadline to return materials. No pre-reporting data validation
240
WIDA NM State Page
241
Exit Criteria for ACCESS
ACCESS for ELLs 2.0: overall composite score of 5.0 or higher Alternate ACCESS: overall composite score of P1 or higher
242
WIDA Client Services Center PED Language and Culture Bureau
Quick Links Who… Help lines… Can help with…. WIDA Client Services Center (WIDA.US) 7 a.m.-6 p.m. CT Mon-Fri Test preparation - Test practice - User guides Certification training - Testing manuals NM Checklist - Accommodations DRC Help Desk (WIDA-AMS) WIDA AMS Login issues - Ordering materials Adding students and test sessions Printing test tickets - Technology issues Unlocking and invalidating tests PED Assessment Bureau Karen Greer Assessment Coordinator (505) New DTCs enrollment WIDA AMS website help Issues with WIDA/DRC help desks PED Language and Culture Bureau Kirsi Laine Deputy Director (505) EL identification EL programs Testing in English Waivers
243
TESTING ACCOMMODATIONS FOR ELs INCLUDING TESTING IN ENGLISH WAIVER
244
ELs and Statewide Assessment Programs
Per M.(2)(a)(i) NMAC: Students who have been in U.S. schools for less than three consecutive years shall participate in the statewide assessment program in one of three ways: 1. the student may participate in the standard administration of the English-language version of the assessment without accommodations;
245
ELs and Statewide Assessment Programs cont…
Scoring and Reporting ELs and Statewide Assessment Programs cont… 2. the student may participate in the English-language version of the assessment with appropriate accommodations; 3. the student may participate in the standard administration of the Spanish-language version of the assessment, where available and appropriate.
246
Testing Accommodations
Scoring and Reporting Testing Accommodations Assessment accommodations enable students to overcome a language barrier or a disability. An allowable assessment accommodation does not alter the concept being measured. Only ELs with disabilities can have accommodations on the English language proficiency assessment (ACCESS for ELLs 2.0).
247
ELs and Accommodations
Scoring and Reporting ELs and Accommodations School-based team must include at least three school staff who are familiar with the student’s abilities, student’s data including English language proficiency level, and language needs. The district shall ensure that students do not receive accommodations without current justification supported by data. Only use allowable accommodations. Written documentation of accommodations kept in student’s cumulative file For further details, see M.(2)(a)(iii) NMAC.
248
Spanish –Language Version of State Assessments
M.(2)(a)(ii) NMAC: Students who have been in U.S. schools for three or more consecutive years shall participate in the English-language version of the assessment with or without allowable accommodations, unless a waiver request to continue the testing of the student in the home language of Spanish is approved by the secretary.
249
Spanish –Language Version of State Assessments cont…
Scoring and Reporting Spanish –Language Version of State Assessments cont… M.(2)(a)(ii) NMAC: If, after three consecutive years in U.S. schools, the district or charter school determines (on a case-by-case basis) that academic assessments in the student's home language of Spanish would yield more accurate and reliable information about the student's knowledge of a subject, the district or charter school may request a waiver from the secretary to continue to assess the student in the home language of Spanish.
250
Testing in English Waivers
Scoring and Reporting Testing in English Waivers M.(2)(a)(ii) NMAC: Approved waivers are effective for the current year only; Annual waiver requests may be approved for a maximum of two years.
251
Questions Assessment Bureau ped.assessment@state.nm.us
Language and Culture Bureau Kirsi Laine Deputy Director (505)
252
END OF COURSE EXAMS (EOCs)
253
Assessment Program: End of Course Exams (EOCs)
Assessments created by New Mexico educators for New Mexico students Assessment Program: End of Course Exams (EOCs) Required Grades: Varies by subject and course
254
Overview Purpose of EoCs
Updates to New Mexico’s Exam Platform for Informing Curriculum (EPIC) NMEPIC Demonstration Data Submission for Paper-Based Testing Resources for EoCs Frequently asked questions
255
EOC Quick Links EoC Website at NMPED:
DTC Secured Log-in to EPIC: EOC Practice Test on EPIC: EOC Course Linkage Chart: EOC Frequently Asked Questions EOC Policy Questions Issues related to NMEPIC, Rostering
256
Purpose of EoCs: Theory of Action
New Mexico educators will use EoC results to make curricular decisions that improve achievement outcomes for students. New Mexico EoC results are used to establish a measure of teacher effectiveness create common measures for course content determine if a student has met the requirements for graduation
257
What is EPIC? Repository for Secured EoC Documents:
Paper test forms and keys Testing Platform for students to take EoCs online: DTCs/STCs to set up test sessions Automated scoring Reporting engine Item Bank Author test questions
258
NMEPIC Setup Overview Rostering – STARS Coordinators submit roster data to the 7/15 Snapshot to populate NMEPIC. Bulk Upload (Assigning login credentials) Exam Sessions – linking tests with classes Starting the test – teacher side/student side Retakes
259
EPIC EoC Practice Test Available
260
NMEPIC Usage Numbers 2017-18 372,000+ exams administered
116,000+ students took exams 74 districts used EPIC (83%) 74 different exams given
261
Digital Delivery-EPIC
Testing Paper-Based Testing Digital Delivery-EPIC Blueprints are available at DTCs have login access to EPIC to download paper test forms and scoring keys. DTCs /STCs can start setting up testing sessions. Fall/Spring Testing Window: Last three weeks of the semester Senior retakes can be administered as needed Scored locally Automated scoring; except for essay – blind scoring on EPIC Use EoC Naming Conventions found on the EoC website to submit EoC data to PED. Teacher reports available immediately except for EoCs containing Essays. DTC reports available on EPIC Submit data to STARS Raw data provided to PED
262
Testing Announcements
Science EOC test forms have been revised to align to the NM STEM-ready! science standards. Testing Irregularities can now be submitted via online form. 6 New EOCs this year (5 science, 1 PE) NMEPIC Training Webinar April 15th at 3:00 pm Safe Exam Browser recommended.
263
Precision Exams Statewide Adoption of Exams for CTE Courses
Expanded opportunities for industry certification and demonstrating competency 31 Exams now available at no cost to districts Assessment is required if you have course that is linked Student performance data will not be used for teacher evaluation calculations for SY1819 Discounted pricing for site licenses giving access to more tests
264
Precision Exams About the platform Resources
Students can download certificate widely recognized by industry Immediate results Reports available to students, teachers, administrators Resources Virtual Technical Trainings for administration to be provided from January – March. Stay tuned to Assessment Newsletter for dates Memo announcing adoption – general information List of adopted exams
265
Precision Introductory Webinars
Precision Exams will be offering 4 sessions of their introductory training to their testing platform. Please register with the following link: January 15 – 12:30pm January 16 – 8:00am January 16 – 3:30pm January 17 – 12:30pm
266
Questions
267
GRADUATION REQUIREMENTS
268
Graduation Quick Links
Graduation Manuals By Year NEW: Graduation Policy for Class of 2022 Alternate Demonstration of Competency (ADC) Manual Class of Graduation Waivers and Forms *must be ed to State 2018 Graduation Requirements NMAC Demonstration of Competency for High School Graduation Questions on Class of 2022 and all cohort Course Requirements
269
Primary Demonstration of Competency Cohort 2019 Standard Option
Mathematics PARCC Algebra II, Geometry, Integrated Mathematics II or III* Reading** PARCC ELA Grade 11 Writing** PARCC ELA Grade 11 Science SBA Grade 11 Science Social Studies One state Social Studies EoC * There are no Fall retests for Integrated Mathematics II or III; seniors on this path may proceed directly to an ADC after one attempt on PARCC. * * Refer to the ADC Manual for other requirements on Reading and Writing subscores.
270
Primary Demonstration of Competency Cohort 2019 Career Option
Mathematics PARCC Algebra I or II, Geometry, Integrated Mathematics I, II, or III Reading PARCC ELA Grade 11 Writing PARCC ELA Grade 11 Science SBA Grade 11 Science Social Studies One state Social Studies EoC An ADC may be used after completing the same attempt requirements as students on the standard graduation option.
271
Primary Demonstration of Competency
Ability Option Mathematics NMAPA Mathematics with 506+ or IEP individualized scores ELA NMAPA Reading with 479+ or IEP individualized scores Science NMAPA Science with 501+ or IEP individualized scores Social Studies NMAPA Social Studies with 500+ or IEP individualized scores
272
Primary Demonstration of Competency Career and Ability Option
Cut Scores Cut scores are not retroactive. IEP Teams set individual passing cut scores after the student’s initial attempt. Students must be identified as career pathway no later than 20th day of senior year.
273
Reminder 2019 Class of 2019, the passing score for the ELA and Math primary demonstrations of competency (PARCC) is Level 3. Scaled Score = 725
274
Test Attempt Requirements
2019 Cohort State EoC minimum of 1 time SBA minimum of 2 times PARCC Math ELA Social Studies Science
275
ADC Implementation and Graduation Waiver ADC Implementation Waivers
To apply for using an ADC without minimum attempts at primary demonstration of competency (e.g., for transfer students) To apply for graduation status for students using scores from other states’ graduation tests to meet the New Mexico graduation assessment requirements ADC Implementation Waivers Graduation Waivers All waivers can be found at
276
ADC Waiver Needed? Fewer than 2 attempts at ELA or Math summative assessment Fewer than 2 attempts at SBA/NMASR An ADC implementation request must only be submitted when the attempt requirement is not met. OR
277
Remember A passing score on an approved ADC exam must be noted on the waiver before it will be reviewed.
278
Alternate Demonstration of
Competency (ADC) Manual The ADC Manual can be found on the PED Assessment website: Options If students do not pass the primary demonstration of competency for graduation, the ADC includes EoCs, CCR indicators, and local ADCs according to NMAC Waivers Districts may use an ADC Waiver if applicable. All waivers must be sent to state.nm.us
279
Transfer In Final Year of High School
Cohort 2019 Must demonstrate competency in ELA (reading and writing) and Mathematics only. Does not require a waiver for Science and Social Studies. Passing a high school graduation exam in another state may apply to assessment requirements by subject. Requires a Graduation Waiver.
280
Wondering about the new graduation
policy for the Class of 2022? Check out the following links and resources: Available on the College and Career Readiness website: Class of 2022 High School Graduation Manual Class of 2022 Graduation Checklist Class of 2022 Graduation FAQ Recorded webinars providing a comprehensive overview of the new policy Available on the Policy, Innovation, and Measurement website: Proposed and final versions of NMAC All public comment received during the comment period for NMAC Available on the New Mexico Sunshine Portal website: Complete rule record for NMAC
281
QUESTIONS For questions related to ADCs and graduation waivers:
To send waivers: For questions related to new graduation policy for class of 2022: Education Administrator College & Career Readiness Bureau
Similar presentations
© 2025 SlidePlayer.com Inc.
All rights reserved.