Preparing for the Administration of the Spring 2015 Dynamic Learning Maps (DLM) in English Language Arts and Mathematics February 23, 2015 Version NJ DLM Winter Training 2015

Updates and Additional Modules This presentation may require updates. If so it will be reposted when needed. Additional modules will be posted in late March on topics such as avoiding a security breach and teacher observation forms. Please check the DLM NJ webpage www.dynamiclearningmaps.org/newjersey periodically for new and updated information. Please note that not all slides contain information that may not be stated in the audio. Please review the slide content in addition to listening to the presentation. NJ DLM Winter Training 2015

Presentation Topics Listed by Slide Numbers Overview of the DLM slides 5–8 Computer Adaptive Test Design slides 9-10 CCSS, Essential Elements, and Linkage Levels slides 11-12 Engagement Activities slide 13 Student Testing Policies slides 14-29 Includes Who Tests including retained students, homebound students, out-of-state students, and other policies Student Scheduling and Test Administrator Requirements slides 30-39 Educator Preparation slides 40-50 for Part One Includes roles and responsibilities of educators Includes upcoming DLM Webinars NJ DLM Winter Training 2015

Presentation Topics Listed by Slide Numbers IF Both Presentations are Saved Into One File If Part One and Part Two of the Presentation is Viewed Separately the Slide Numbers will Reset Beginning with Zero Educator Preparation slides 51-66 for Part Two Includes roles and responsibilities of educators Includes upcoming DLM Webinars Test Accessibility and Other Features slides 67-85 Includes accessibility, manipulatives, math glossary, etc. Security Information slides 86-91 More Information slides 92-103 Includes contact information NJ DLM Winter Training 2015

Overview of the DLM General Information NJ DLM Winter Training 2015

DLM Year End (YE) Test Information Students with the most significant intellectual disabilities are assessed in grades 3 – 8 and11. Students in grades 9 and 10 are not assessed. NJ DLM does not test “end of course” skills; it assesses a set of skills instructed over a period of 3 years. Content areas assessed are English language arts (ELA) and mathematics. The DLM replaces the APA in ELA and math. NJ DLM Winter Training 2015

2015 TEST DATES Districts may test between April 13, 2015 and May 15, 2015. These five weeks should accommodate testing for all students taking into account student absences, school closings, and schools with high numbers of students to test. Schools may not begin testing prior to April 13. Schools may not continue to test after May 15. Schools should begin administering the DLM early in the test window. NJ DLM Winter Training 2015

DLM Year End Test Information Skills linked to the Common Core State Standards (CCSS) are assessed. DLM is a computer adaptive assessment which has short testlets that contain small numbers of test items. NJ is using the Year End model, not the embedded model Review the test blueprints for the YE model for more information on what skills are tested. NJ DLM Winter Training 2015

Computer Adaptive Testing The computer adaptive process: The student is assigned the first testlet, a small set of items, taking into account the student information provided in the First Contact survey and the level of difficulty of the test items available in the item pool for the Year End (YE) required essential elements. The YE test blueprint determines which essential elements (EEs) must be tested. There are multiple items (nodes) for each EE which range in difficulty and complexity. Based on the student First Contact survey, the system selects the level of nodes and items to assign. NJ DLM Winter Training 2015

Computer Adaptive Testing The computer adaptive process continued: After the first testlet is computer scored, the second testlet is assigned. It is based on the student’s performance and the level of difficulty of the items in the first testlet (nodes), as well as the test blueprint EE requirements. The items assigned might be at the same level as the first testlet, or might be somewhat easier or harder than the previous testlet (higher or lower level skills are selected). This process is what makes the test “adaptive.” This is an iterative process until the testlets address all Essential Elements in the YE test blueprint. Each student will take approximately seven testlets in each content area. NJ DLM Winter Training 2015

Example of the Relationship between CCSS and the DLM EE & Nodes Grade-Level CCSS Standard ELA.RL.3.4 Determine the meaning of words and phrases as they are used in a text, distinguishing literal from non-literal language.   DLM Essential Element ELA.EE.RL.3.4 Determine words and phrases that complete literal sentences in a text. DLM nodes on right are listed from highest to lowest skill level. Successor Node: Can identify simple semantic definitions for unambiguous words in a text Target Node: Can ascertain which words or phrases fit the meaning of literal sentences in a text and can complete those sentences by choosing the best ones. Proximal Precursor: Can provide real- life examples of words connected to a use (describe people who are friendly) Distal Precursor: Can demonstrate understanding of the names of objects or people who are not immediately present. Initial Precursor: Can pay attention to either the entire object, a characteristic of the object, or an action in which the object can perform after some verbal label has been attached to it. NJ DLM Winter Training 2015

DLM Linkage Levels In order to assist in the understanding of the nodes/linkage levels of the DLM, below is the general APA association for the levels. This is for illustrative purposes only, as the APA Links were testing the NJ Core Curriculum Content Standards, not the Common Core State Standards. Linkage levels consist of: Successor – skills to instruct once demonstrated mastery of Target skills Target – similar concept to APA Matched Links Proximal Precursor – similar concept to APA Near Links Distal Precursor – similar concept to APA Far Links Initial Precursor – foundational skills NJ DLM Winter Training 2015

Engagement Activities DLM testing in math and English Language Arts includes directions on engaging the student at the beginning of the test. Please review the test administrator manual for details on this topic. A module on engaging the students, including a video of a New Jersey teacher administering a passage to a student, will be posted in mid-March. NJ DLM Winter Training 2015

Student Testing Policies: Who must test? NJ DLM Winter Training 2015

Who Tests? Students in grades 3 - 8 for the first time must be tested in English language arts and math. Students in grade 11 for the first time must be tested in English language arts and math. NJ DLM Winter Training 2015

Retained Students in Grades 3-8 If a student was designated to participate in the APA last year, and the individual score report (ISR) stated a Proficiency level (partially proficient, proficient, or advanced proficient) then he/she has already tested and is not required to participate in the DLM. A district may choose to test the student if desired. NJ DLM Winter Training 2015

Students in Grades 9 or 10 The DLM is an alternate assessment to PARCC. PARCC has specific end-of-course assessments while DLM is an assessment based on a broad range of skills in a content area. DLM students do not participate in a state alternate assessment in grades 9 or 10 because NJ DLM does not test “end of course” skills; it assesses a set of skills instructed over a period of 3 years. DLM students in high school will receive approximately three years of instruction on the CCSS skills and DLM Essential Elements prior to participating in the grade 11 assessment. Districts may decide to assess students with the most significant intellectual disabilities in grades 9 and 10 with a local assessment in order to ascertain skill acquisition and provide feedback to teachers and parents. NJ DLM Winter Training 2015

Retained Students in Grade 11 If a student “participated” in the APA as a first time 11th grader and received an ISR, obtaining either a proficiency level or Void code, then he/she will not participate in the DLM. The majority of these students’ instruction has not been related to the Common Core State Standards (CCSS). This policy aligns with the HSPA policy. NJ DLM Winter Training 2015

Retained Students in Grade 11 Students retained in grade 11 that did not participate in the Language Arts and math APA as a first time 11th grader must participate in DLM. Obtaining a passing or “Proficient” score on DLM is not a requirement for graduation. Therefore even students in grade 11 that have not had significant exposure to instruction related to the CCSS must participate in the DLM. It is expected that many of the skills tested in DLM are related to the skills assessed by the APA. NJ DLM Winter Training 2015

Students in Grade 12 Students in grade 12 that did not participate in the Language Arts and math APA in grade 11 must participate in DLM. For example, a student moved from Florida to New Jersey as a high school senior. Obtaining a passing or “Proficient” score on DLM is not a requirement for graduation. Therefore even students in grade 12 that have not had significant exposure to instruction related to the CCSS must participate in the DLM. It is expected that many of the skills tested in DLM are related to the skills assessed by the APA. NJ DLM Winter Training 2015

Homebound and Medical Facilities If a student is ill and receiving instruction at home or in a medical facility, AND the district can provide the instructor a laptop or tablet that contains the KITE application, the student will participate in the DLM. AND the district cannot provide the instructor with a laptop or tablet that contains the KITE application, the student will not participate in the DLM in 2014-2015. This student must be added to the DLM roster and will count as a non-participant in the accountability reports. Beginning 2015-2016 districts will need to arrange for DLM testing for students in medical facilities or on homebound instruction. NJ DLM Winter Training 2015

Medical Facility Placements HOMEBOUND, BEDSIDE & Medical Facility Placements Test Administrator MUST be: Licensed professional employed by the district. Trained by school or district test coordinator and review all DLM teacher training materials. Sign Test Security Agreement. Maintain test security at ALL times. Return equipment to school coordinator ASAP after testing is completed. See additional test administrator requirements in upcoming slides. NJ DLM Winter Training 2015

Homebound and Medical Facilities If a student is ill and is not receiving instruction at home or in a medical facility the student will not participate in the DLM. A student might not be receiving instruction due to a medically fragile state, PVS state, attendance at a psychiatric facility, etc. This student must be added to the DLM roster and will count as a non-participant in the accountability reports. NJ DLM Winter Training 2015

Absent Students If a student is not receiving instruction for the entire test window for a reason other than illness he/she cannot participate in DLM. The school must have documentation of the student’s absence for the entire five week testing window. This student must be added to the DLM roster and will count as a non-participant in the accountability reports. NJ DLM Winter Training 2015

Testing of Students Receiving Instruction in Unapproved Schools Students with the most significant intellectual disabilities whose IEP team determines participation in the DLM must be tested. The sending district must send an educator (teacher, case manager, etc.) to the unapproved school to administer the test. The sending district must provide a laptop or tablet that has DLM KITE application installed, and must have a teacher login ID/password and the student’s test ticket(s). The student’s regular special education teacher must assist the sending district educator during the DLM administration. Assisting ensures the student is working with a familiar instructor and that the student receives the appropriate supports based on their needs. The completion of the First Contact and Personal Needs Profiles will be done by the sending district however they must confer with the attending school to ensure accurate survey responses. Manipulatives will be provided by the attending school however the sending district may need to assist in the provision of necessary materials. Districts that are unable to complete this requirement in Spring 2015 must implement this policy in 2015-2016. This student must be added to the DLM roster and will count as a non-participant in the accountability reports. NJ DLM Winter Training 2015

Students Sent Out-of-State When a student’s home district is paying tuition for the student to attend a school outside of New Jersey, find out the following: Is the out-of-state school administering the DLM? If yes the NJ student must participate in the DLM. The attending school teacher will administer the DLM. Is the attending state administering a different alternate assessment? If so the student this student must be added to the DLM roster, will not test, and will count as a non-participant in the accountability reports. However if the out-of-state placement is a neighboring state, and the sending district can send someone to administer the DLM, the student will participate. NJ DLM Winter Training 2015

Student Mobility and Participation If a student moves from one New Jersey school district to another during the DLM test window, the sending school must “Exit” the student per the Data Steward manual instructions, then the receiving school will “Enroll” the student per the Data Steward manual instructions. Upon enrolling the student, the student’s First Contact and PNP survey will be available. Once staff are trained the receiving school will administer/continue to administer the DLM. NJ DLM Winter Training 2015

Student Mobility and Participation DLM staff are producing written guidance on these type of enrollment/mobility issues. This will include information on how to code a student that moves from one school to another within the district. Please check the DLM website in March for more details. NJ DLM Winter Training 2015

Student Mobility and Participation Any student who is enrolled in school during the test window must participate in the DLM. This includes students who moved into New Jersey from another state. Be sure and add the new student to the appropriate data files (rosters, etc.) and complete the FC and PNP surveys as soon as possible. Once staff are trained the New Jersey school will administer the DLM. NJ DLM Winter Training 2015

Student Scheduling and Test Administrator Requirements NJ DLM Winter Training 2015

Who Can Administer the DLM? The student’s primary certified special education teacher The student’s certified math or English teacher The student’s long term substitute teacher who holds a NJ teaching certificate and has a district employment contract The student’s primary teaching assistant ONLY IF he/she holds a NJ teaching certificate These teaching assistants are fully certified teachers and are not employed as full time classroom teachers but employed as assistants The student’s primary SLP who works with the student on a weekly basis NJ DLM Winter Training 2015

Who Can Not Administer the DLM? Any individual without a NJ teaching certificate such as a nurse or nursing aide non-certified teaching assistant administrative assistant teaching intern and other similar school personnel Also any individual that does not have direct interaction with the student on a regular basis may not administer the DLM, regardless of holding a NJ teaching certificate Test Administrators must be a NJ certified teacher with whom the student is familiar. NJ DLM Winter Training 2015

Test Administration Details Each student will take approximately seven testlets in English language arts and math. For each content area, after a testlet has been completed, it can take one to three hours for the next testlet to be assigned. This is based on the volume of students testing and the computer adaptive system, which must select new test items based on several statistical measures (e.g. performance on linkage level, new EE to be tested, etc.) Te NJ DLM Winter Training 2015

Test Administration Details A student may complete all seven testlets in a content area prior to completing the other subject, or May complete the testlets in order as they are assigned, switching back and forth between the two content areas. For each content area, after a testlet has been completed and another assigned, a test administrator may have the student complete the new testlet as soon as it is assigned, or wait until another day. These decisions affect the school’s scheduling plan. Care must be taken to ensure all students complete all testlets within the five week window. Testlets in English language arts may take 10-15 minutes to complete. Testlets in math may take 7-10 minutes to complete. These times may vary depending on the student’s support needs. Te NJ DLM Winter Training 2015

Scheduling Testlets Utilize ANY day during the 25-day testing window - Start ASAP Determining how many testlets to administer each day is the teacher’s decision. Consider student’s engagement level, fatigue factor, behavior, etc. A minimum of two testlets will be available in the morning and the afternoon (two per subject). If administering multiple testlets in one seating be sure to give student a brief break if needed. Multiple students can be scheduled in a single day. Most test administrations are set up to be one student testing per teacher. It will be rare to test two students at one time, due to the need for the test administrator to be engaged with the student, utilize manipulatives, etc. NJ DLM Winter Training 2015

Scheduling Testlets Prepare in advance a schedule that indicates when every student will participate in the multi-day DLM assessment. Schedules may be revised as necessary in order to ensure every student has completed the DLM within the test window of April 13 to May 15, 2015. If administering multiple testlets in one day, decide if you want to administer in the morning and afternoon for the same student or to schedule different students in the morning than afternoon. Sample Schedule: a student takes one ELA and one math testlet during their regularly scheduled morning ELA instruction. Testing takes approximately twenty minutes for seven days, testing only in the morning. Sample Schedule: a student takes one ELA testlet in the morning, and one in the afternoon. Upon ELA completion, they are scheduled to test math using the same schedule. Testing takes approximately twenty minutes for seven days for each content area. Sample Schedule: a student takes one ELA and one math testlet in the morning, then if fatigue is not an issue, takes one or two more testlets in the afternoon. Testing takes thirty to forty minutes for four to five days . NJ DLM Winter Training 2015

Scheduling Testlets A schedule form for your use is available. Review the student information categories to assist you in considering in which location to test, whether special equipment is needed, etc. This form can also be used to store the student’s username and password. This form is optional but highly recommended. NJ DLM Winter Training 2015

Schedule Form Please note Computer Read Aloud is no longer available NJ DLM Winter Training 2015

Prior to Testing Check the Status of KITE System on the DLM Webpage Note: This page indicates the system status and any current issues. NJ DLM Winter Training 2015

Educator Preparation NJ DLM Winter Training 2015

DLM Information Updates Educators should sign up for automatic email notifications of DLM updates through the website http://www.dynamiclearningmaps.org/content/ope rational-testing Visit the DLM website often to check for news and updates Manuals and notices are updated often as this new system is being developed. Office of Assessments staff will upload more information as it becomes available prior to the testing window. NJ DLM Winter Training 2015

How to Prepare for DLM Test Three district administrators must be assigned to the roles of Assessment Coordinator, Data Steward, and Technical Liaison. The “fourth role” is the student’s teacher who will administering the test. DLM uses the term Test Administrator in place of “teacher.” All must review the applicable DLM Manuals and webinars to obtain specific information on district preparation. Utilize the role specific documentation tab under the DLM NJ webpage to find important information. Other DLM tabs also cover important topics so please review the contents of the DLM website as related to your role. NJ DLM Winter Training 2015

Roles and Responsibilities There are four specific roles for district educators in the DLM testing process: Assessment Coordinator Point of contact for test administration Oversees and assists teachers in their roles See DLM site for required training manual, webinar, and other materials Technical Liaison Oversees computer and other technology device components to ensure district technology readiness and implementation (IT staff) Assists in resolving technology issues during testing Data Steward District administrator who collects and delivers all necessary data files to DLM, obtains login IDs and passwords for staff, maintains accurate records for others use, etc. Classroom Teacher (Test Administrator) Individual teacher administers assessments to students and assists in the selection of accessibility features and necessary supports NJ DLM Winter Training 2015

How to Prepare for DLM Test The Data Steward will follow the instructions in the handbook that detail submission of district names, email addresses, etc., in order to obtain Login ID and Password access for all. Once the three administrators and district teachers receive an email confirmation from DLM each must activate their login ID. The Technical Liaison must ensure that DLM emails are allowed to reach the necessary district email boxes. If district staff are not receiving emails from DLM, ask your Technical Liaison to check if the emails are being routed to the district’s SPAM file. NJ DLM Winter Training 2015

How to Prepare for DLM Test The Assessment Coordinator, Data Steward, and Technical Liaison role specific webinars are found on the web link http://dynamiclearningmaps.org/content/district- staff-training-resources-ye All administrators and teachers who will administer the assessment must review seven required DLM training modules. Note access to these training modules is gained after the district data steward uploads all names and email addresses of the staff involved in DLM. Teacher’s must complete the quiz at the end of the modules. NJ DLM Winter Training 2015

How to Prepare for DLM Test Each staff fulfilling the four roles for DLM will need to activate his/her educator portal account. DLM will send each individual an email with login and account activation information. All staff must review and follow the instructions in the applicable DLM User Manual and other materials to fulfill their responsibilities successfully Access to each students test items is given via the receipt of a computer generated student username and password for each student. This Student Ticket is accessible by the classroom teacher as defined in the roster data file. Each ticket should be printed out and retained by the classroom teacher for use during testing. See the Test Administrator Manual for more information. NJ DLM Winter Training 2015

How to Prepare for DLM Test After the login IDs are activated the following seven DLM training modules may be reviewed individually (Self-Directed) or as a group (Group Facilitated): Module I Overview of the DLM System Module 2 Test Security Module 3 Accessibility for All Students Module 4 How the Assessment Works Module 5 Preparing for the Test Module 6 Computer Delivered Testlets Module 7 Teacher Administered Testlets Each module has a post test that must be independently and successfully completed after logging into the Educator Portal. Teachers must complete the post tests. It is recommended that the Assessment Coordinator also complete the post test, as these questions helps one determine if they have a thorough understanding of the DLM program. NJ DLM Winter Training 2015

District Directed Teacher Training The training modules for the DLM alternate assessment is available on the website www.dynamiclearningmaps.org A school test administrator must ensure that all teachers participate in the required DLM training sessions. Teachers may be trained immediately, but every effort must be taken to ensure all teachers are trained prior to March 6, 2015. Administrators may select either the Facilitated Group Training or Self-Directed Training formats for teacher training sessions. Either selection requires an Administrator to track and ensure completion of training modules. All educators participating in training must successfully complete the post-test for each module in order to be approved for administration of the testlets. NJ DLM Winter Training 2015

DLM Manual Revisions DLM manuals are often updated so check the website often. When a manual is updated, all screen shots, data dictionaries, and templates shown or referred to in a manual are accurate on the Revision Date noted above. When a manual is updated, the Revision Date will also be updated. An alert will be posted on the Test Updates webpage. A summary of changes is included in the Appendix under Document History. NJ DLM Winter Training 2015

DLM Manual Revisions (as of 2/19/15) The Assessment Coordinator Manual has a revision date of 01/20/2015 for the Year End (YE) Version The Data Steward Manual has a revision date of 01/5/2015 for the Year End (YE) Version The Technical Liaison Manual has a revision date of 01/13/2015 for the Year End (YE) Version The Test Administration Manual has a revision date of 01/6/2015 for the Year End (YE) Version NJ DLM Winter Training 2015