1. Preparing for the Administration of the Spring Dynamic Learning Maps (DLM) in English Language Arts and Mathematics February 23, 2015 Version
NJ DLM Winter Training 2015

2. Updates and Additional Modules
This presentation may require updates. If so it will be reposted when needed.
Additional modules will be posted in late March on topics such as avoiding a security breach and teacher observation forms.
Please check the DLM NJ webpage periodically for new and updated information.
Please note that not all slides contain information that may not be stated in the audio. Please review the slide content in addition to listening to the presentation.
NJ DLM Winter Training 2015

3. Presentation Topics Listed by Slide Numbers
Overview of the DLM slides 5–8
Computer Adaptive Test Design slides 9-10
CCSS, Essential Elements, and Linkage Levels slides 11-12
Engagement Activities slide 13
Student Testing Policies slides 14-29
Includes Who Tests including retained students, homebound students, out-of-state students, and other policies
Student Scheduling and Test Administrator Requirements slides 30-39
Educator Preparation slides for Part One
Includes roles and responsibilities of educators
Includes upcoming DLM Webinars
NJ DLM Winter Training 2015

4. Presentation Topics Listed by Slide Numbers IF Both Presentations are Saved Into One File If Part One and Part Two of the Presentation is Viewed Separately the Slide Numbers will Reset Beginning with Zero
Educator Preparation slides for Part Two
Includes roles and responsibilities of educators
Includes upcoming DLM Webinars
Test Accessibility and Other Features slides 67-85
Includes accessibility, manipulatives, math glossary, etc.
Security Information slides 86-91
More Information slides
Includes contact information
NJ DLM Winter Training 2015

5. Overview of the DLM
General Information
NJ DLM Winter Training 2015

6. DLM Year End (YE) Test Information
Students with the most significant intellectual disabilities are assessed in grades 3 – 8 and11.
Students in grades 9 and 10 are not assessed.
NJ DLM does not test “end of course” skills; it assesses a set of skills instructed over a period of 3 years.
Content areas assessed are English language arts (ELA) and mathematics.
The DLM replaces the APA in ELA and math.
NJ DLM Winter Training 2015

7. 2015
TEST DATES
Districts may test between April 13, 2015 and May 15, 2015.
These five weeks should accommodate testing for all students taking into account student absences, school closings, and schools with high numbers of students to test.
Schools may not begin testing prior to April 13.
Schools may not continue to test after May 15.
Schools should begin administering the DLM early in the test window.
NJ DLM Winter Training 2015

8. DLM Year End Test Information
Skills linked to the Common Core State Standards (CCSS) are assessed.
DLM is a computer adaptive assessment which has short testlets that contain small numbers of test items.
NJ is using the Year End model, not the embedded model
Review the test blueprints for the YE model for more information on what skills are tested.
NJ DLM Winter Training 2015

9. Computer Adaptive Testing
The computer adaptive process:
The student is assigned the first testlet, a small set of items, taking into account the student information provided in the First Contact survey and the level of difficulty of the test items available in the item pool for the Year End (YE) required essential elements.
The YE test blueprint determines which essential elements (EEs) must be tested.
There are multiple items (nodes) for each EE which range in difficulty and complexity.
Based on the student First Contact survey, the system selects the level of nodes and items to assign.
NJ DLM Winter Training 2015

10. Computer Adaptive Testing
The computer adaptive process continued:
After the first testlet is computer scored, the second testlet is assigned. It is based on the student’s performance and the level of difficulty of the items in the first testlet (nodes), as well as the test blueprint EE requirements.
The items assigned might be at the same level as the first testlet, or might be somewhat easier or harder than the previous testlet (higher or lower level skills are selected). This process is what makes the test “adaptive.”
This is an iterative process until the testlets address all Essential Elements in the YE test blueprint. Each student will take approximately seven testlets in each content area.
NJ DLM Winter Training 2015

11. Example of the Relationship between CCSS and the DLM EE & Nodes
Grade-Level CCSS Standard
ELA.RL.3.4
Determine the meaning of words and phrases as they are used in a text, distinguishing literal from non-literal language.
DLM Essential Element
ELA.EE.RL.3.4
Determine words and phrases that complete literal sentences in a text.
DLM nodes on right are listed from highest to lowest skill level.
Successor Node: Can identify simple semantic definitions for unambiguous words in a text
Target Node: Can ascertain which words or phrases fit the meaning of literal sentences in a text and can complete those sentences by choosing the best ones.
Proximal Precursor: Can provide real- life examples of words connected to a use (describe people who are friendly)
Distal Precursor: Can demonstrate understanding of the names of objects or people who are not immediately present.
Initial Precursor: Can pay attention to either the entire object, a characteristic of the object, or an action in which the object can perform after some verbal label has been attached to it.
NJ DLM Winter Training 2015

12. DLM Linkage Levels
In order to assist in the understanding of the nodes/linkage levels of the DLM, below is the general APA association for the levels. This is for illustrative purposes only, as the APA Links were testing the NJ Core Curriculum Content Standards, not the Common Core State Standards.
Linkage levels consist of:
Successor – skills to instruct once demonstrated mastery of Target skills
Target – similar concept to APA Matched Links
Proximal Precursor – similar concept to APA Near Links
Distal Precursor – similar concept to APA Far Links
Initial Precursor – foundational skills
NJ DLM Winter Training 2015

13. Engagement Activities
DLM testing in math and English Language Arts includes directions on engaging the student at the beginning of the test.
Please review the test administrator manual for details on this topic.
A module on engaging the students, including a video of a New Jersey teacher administering a passage to a student, will be posted in mid-March.
NJ DLM Winter Training 2015

14. Student Testing Policies:
Who must test?
NJ DLM Winter Training 2015

15. Who Tests?
Students in grades for the first time must be tested in English language arts and math.
Students in grade 11 for the first time must be tested in English language arts and math.
NJ DLM Winter Training 2015

16. Retained Students in Grades 3-8
If a student was designated to participate in the APA last year, and the individual score report (ISR) stated a Proficiency level (partially proficient, proficient, or advanced proficient)
then he/she has already tested and is not required to participate in the DLM.
A district may choose to test the student if desired.
NJ DLM Winter Training 2015

17. Students in Grades 9 or 10
The DLM is an alternate assessment to PARCC.
PARCC has specific end-of-course assessments while DLM is an assessment based on a broad range of skills in a content area.
DLM students do not participate in a state alternate assessment in grades 9 or 10 because NJ DLM does not test “end of course” skills; it assesses a set of skills instructed over a period of 3 years.
DLM students in high school will receive approximately three years of instruction on the CCSS skills and DLM Essential Elements prior to participating in the grade 11 assessment.
Districts may decide to assess students with the most significant intellectual disabilities in grades 9 and 10 with a local assessment in order to ascertain skill acquisition and provide feedback to teachers and parents.
NJ DLM Winter Training 2015

18. Retained Students in Grade 11
If a student “participated” in the APA as a first time 11th grader and received an ISR, obtaining either a proficiency level or Void code, then
he/she will not participate in the DLM.
The majority of these students’ instruction has not been related to the Common Core State Standards (CCSS).
This policy aligns with the HSPA policy.
NJ DLM Winter Training 2015

19. Retained Students in Grade 11
Students retained in grade 11 that did not participate in the Language Arts and math APA as a first time 11th grader must participate in DLM.
Obtaining a passing or “Proficient” score on DLM is not a requirement for graduation.
Therefore even students in grade 11 that have not had significant exposure to instruction related to the CCSS must participate in the DLM.
It is expected that many of the skills tested in DLM are related to the skills assessed by the APA.
NJ DLM Winter Training 2015

20. Students in Grade 12
Students in grade 12 that did not participate in the Language Arts and math APA in grade 11 must participate in DLM.
For example, a student moved from Florida to New Jersey as a high school senior.
Obtaining a passing or “Proficient” score on DLM is not a requirement for graduation.
Therefore even students in grade 12 that have not had significant exposure to instruction related to the CCSS must participate in the DLM.
It is expected that many of the skills tested in DLM are related to the skills assessed by the APA.
NJ DLM Winter Training 2015

21. Homebound and Medical Facilities
If a student is ill and receiving instruction at home or in a medical facility,
AND the district can provide the instructor a laptop or tablet that contains the KITE application, the student will participate in the DLM.
AND the district cannot provide the instructor with a laptop or tablet that contains the KITE application, the student will not participate in the DLM in
This student must be added to the DLM roster and will count as a non-participant in the accountability reports.
Beginning districts will need to arrange for DLM testing for students in medical facilities or on homebound instruction.
NJ DLM Winter Training 2015

22. Medical Facility Placements
HOMEBOUND, BEDSIDE &
Medical Facility Placements
Test Administrator MUST be:
Licensed professional employed by the district.
Trained by school or district test coordinator and review all DLM teacher training materials.
Sign Test Security Agreement.
Maintain test security at ALL times.
Return equipment to school coordinator ASAP after testing is completed.
See additional test administrator requirements in upcoming slides.
NJ DLM Winter Training 2015

23. Homebound and Medical Facilities
If a student is ill and is not receiving instruction at home or in a medical facility
the student will not participate in the DLM.
A student might not be receiving instruction due to a medically fragile state, PVS state, attendance at a psychiatric facility, etc.
This student must be added to the DLM roster and will count as a non-participant in the accountability reports.
NJ DLM Winter Training 2015

24. Absent Students
If a student is not receiving instruction for the entire test window for a reason other than illness he/she cannot participate in DLM.
The school must have documentation of the student’s absence for the entire five week testing window.
This student must be added to the DLM roster and will count as a non-participant in the accountability reports.
NJ DLM Winter Training 2015

25. Testing of Students Receiving Instruction in Unapproved Schools
Students with the most significant intellectual disabilities whose IEP team determines participation in the DLM must be tested.
The sending district must send an educator (teacher, case manager, etc.) to the unapproved school to administer the test.
The sending district must provide a laptop or tablet that has DLM KITE application installed, and must have a teacher login ID/password and the student’s test ticket(s).
The student’s regular special education teacher must assist the sending district educator during the DLM administration. Assisting ensures the student is working with a familiar instructor and that the student receives the appropriate supports based on their needs.
The completion of the First Contact and Personal Needs Profiles will be done by the sending district however they must confer with the attending school to ensure accurate survey responses.
Manipulatives will be provided by the attending school however the sending district may need to assist in the provision of necessary materials.
Districts that are unable to complete this requirement in Spring must implement this policy in
This student must be added to the DLM roster and will count as a non-participant in the accountability reports.
NJ DLM Winter Training 2015

26. Students Sent Out-of-State
When a student’s home district is paying tuition for the student to attend a school outside of New Jersey, find out the following:
Is the out-of-state school administering the DLM? If yes the NJ student must participate in the DLM. The attending school teacher will administer the DLM.
Is the attending state administering a different alternate assessment? If so the student this student must be added to the DLM roster, will not test, and will count as a non-participant in the accountability reports.
However if the out-of-state placement is a neighboring state, and the sending district can send someone to administer the DLM, the student will participate.
NJ DLM Winter Training 2015

27. Student Mobility and Participation
If a student moves from one New Jersey school district to another during the DLM test window,
the sending school must “Exit” the student per the Data Steward manual instructions, then
the receiving school will “Enroll” the student per the Data Steward manual instructions.
Upon enrolling the student, the student’s First Contact and PNP survey will be available.
Once staff are trained the receiving school will administer/continue to administer the DLM.
NJ DLM Winter Training 2015

28. Student Mobility and Participation
DLM staff are producing written guidance on these type of enrollment/mobility issues.
This will include information on how to code a student that moves from one school to another within the district.
Please check the DLM website in March for more details.
NJ DLM Winter Training 2015

29. Student Mobility and Participation
Any student who is enrolled in school during the test window must participate in the DLM.
This includes students who moved into New Jersey from another state.
Be sure and add the new student to the appropriate data files (rosters, etc.) and complete the FC and PNP surveys as soon as possible.
Once staff are trained the New Jersey school will administer the DLM.
NJ DLM Winter Training 2015

30. Student Scheduling and Test Administrator Requirements
NJ DLM Winter Training 2015

31. Who Can Administer the DLM?
The student’s primary certified special education teacher
The student’s certified math or English teacher
The student’s long term substitute teacher who holds a NJ teaching certificate and has a district employment contract
The student’s primary teaching assistant ONLY IF he/she holds a NJ teaching certificate
These teaching assistants are fully certified teachers and are not employed as full time classroom teachers but employed as assistants
The student’s primary SLP who works with the student on a weekly basis
NJ DLM Winter Training 2015

32. Who Can Not Administer the DLM?
Any individual without a NJ teaching certificate such as a
nurse or nursing aide
non-certified teaching assistant
administrative assistant
teaching intern
and other similar school personnel
Also any individual that does not have direct interaction with the student on a regular basis may not administer the DLM, regardless of holding a NJ teaching certificate
Test Administrators must be a NJ certified teacher with whom the student is familiar.
NJ DLM Winter Training 2015

33. Test Administration Details
Each student will take approximately seven testlets in English language arts and math.
For each content area, after a testlet has been completed, it can take one to three hours for the next testlet to be assigned.
This is based on the volume of students testing and the computer adaptive system, which must select new test items based on several statistical measures (e.g. performance on linkage level, new EE to be tested, etc.) Te
NJ DLM Winter Training 2015

34. Test Administration Details
A student may complete all seven testlets in a content area prior to completing the other subject, or
May complete the testlets in order as they are assigned, switching back and forth between the two content areas.
For each content area, after a testlet has been completed and another assigned, a test administrator may have the student complete the new testlet as soon as it is assigned, or wait until another day.
These decisions affect the school’s scheduling plan. Care must be taken to ensure all students complete all testlets within the five week window.
Testlets in English language arts may take minutes to complete.
Testlets in math may take 7-10 minutes to complete.
These times may vary depending on the student’s support needs. Te
NJ DLM Winter Training 2015

35. Scheduling Testlets
Utilize ANY day during the 25-day testing window - Start ASAP
Determining how many testlets to administer each day is the teacher’s decision.
Consider student’s engagement level, fatigue factor, behavior, etc.
A minimum of two testlets will be available in the morning and the afternoon (two per subject).
If administering multiple testlets in one seating be sure to give student a brief break if needed.
Multiple students can be scheduled in a single day.
Most test administrations are set up to be one student testing per teacher.
It will be rare to test two students at one time, due to the need for the test administrator to be engaged with the student, utilize manipulatives, etc.
NJ DLM Winter Training 2015

36. Scheduling Testlets
Prepare in advance a schedule that indicates when every student will participate in the multi-day DLM assessment.
Schedules may be revised as necessary in order to ensure every student has completed the DLM within the test window of April 13 to May 15, 2015.
If administering multiple testlets in one day, decide if you want to administer in the morning and afternoon for the same student or to schedule different students in the morning than afternoon.
Sample Schedule: a student takes one ELA and one math testlet during their regularly scheduled morning ELA instruction. Testing takes approximately twenty minutes for seven days, testing only in the morning.
Sample Schedule: a student takes one ELA testlet in the morning, and one in the afternoon. Upon ELA completion, they are scheduled to test math using the same schedule. Testing takes approximately twenty minutes for seven days for each content area.
Sample Schedule: a student takes one ELA and one math testlet in the morning, then if fatigue is not an issue, takes one or two more testlets in the afternoon. Testing takes thirty to forty minutes for four to five days .
NJ DLM Winter Training 2015

37. Scheduling Testlets
A schedule form for your use is available. Review the student information categories to assist you in considering in which location to test, whether special equipment is needed, etc.
This form can also be used to store the student’s username and password.
This form is optional but highly recommended.
NJ DLM Winter Training 2015

38. Schedule Form Please note Computer Read Aloud is no longer available
NJ DLM Winter Training 2015

39. Prior to Testing Check the Status of KITE System on the DLM Webpage
Note:
This page indicates the system status and any current issues.
NJ DLM Winter Training 2015

40. Educator Preparation
NJ DLM Winter Training 2015

41. DLM Information Updates
Educators should sign up for automatic notifications of DLM updates through the website
rational-testing
Visit the DLM website often to check for news and updates
Manuals and notices are updated often as this new system is being developed.
Office of Assessments staff will upload more information as it becomes available prior to the testing window.
NJ DLM Winter Training 2015

42. How to Prepare for DLM Test
Three district administrators must be assigned to the roles of Assessment Coordinator, Data Steward, and Technical Liaison.
The “fourth role” is the student’s teacher who will administering the test. DLM uses the term Test Administrator in place of “teacher.”
All must review the applicable DLM Manuals and webinars to obtain specific information on district preparation.
Utilize the role specific documentation tab under the DLM NJ webpage to find important information.
Other DLM tabs also cover important topics so please review the contents of the DLM website as related to your role.
NJ DLM Winter Training 2015

43. Roles and Responsibilities
There are four specific roles for district educators in the DLM testing process:
Assessment Coordinator
Point of contact for test administration
Oversees and assists teachers in their roles
See DLM site for required training manual, webinar, and other materials
Technical Liaison
Oversees computer and other technology device components to ensure district technology readiness and implementation (IT staff)
Assists in resolving technology issues during testing
Data Steward
District administrator who collects and delivers all necessary data files to DLM, obtains login IDs and passwords for staff, maintains accurate records for others use, etc.
Classroom Teacher (Test Administrator)
Individual teacher administers assessments to students and assists in the selection of accessibility features and necessary supports
NJ DLM Winter Training 2015

44. How to Prepare for DLM Test
The Data Steward will follow the instructions in the handbook that detail submission of district names, addresses, etc., in order to obtain Login ID and Password access for all.
Once the three administrators and district teachers receive an confirmation from DLM each must activate their login ID.
The Technical Liaison must ensure that DLM s are allowed to reach the necessary district boxes.
If district staff are not receiving s from DLM, ask your Technical Liaison to check if the s are being routed to the district’s SPAM file.
NJ DLM Winter Training 2015

45. How to Prepare for DLM Test
The Assessment Coordinator, Data Steward, and Technical Liaison role specific webinars are found on the web link staff-training-resources-ye
All administrators and teachers who will administer the assessment must review seven required DLM training modules.
Note access to these training modules is gained after the district data steward uploads all names and addresses of the staff involved in DLM.
Teacher’s must complete the quiz at the end of the modules.
NJ DLM Winter Training 2015

46. How to Prepare for DLM Test
Each staff fulfilling the four roles for DLM will need to activate his/her educator portal account.
DLM will send each individual an with login and account activation information.
All staff must review and follow the instructions in the applicable DLM User Manual and other materials to fulfill their responsibilities successfully
Access to each students test items is given via the receipt of a computer generated student username and password for each student.
This Student Ticket is accessible by the classroom teacher as defined in the roster data file.
Each ticket should be printed out and retained by the classroom teacher for use during testing.
See the Test Administrator Manual for more information.
NJ DLM Winter Training 2015

47. How to Prepare for DLM Test
After the login IDs are activated the following seven DLM training modules may be reviewed individually (Self-Directed) or as a group (Group Facilitated):
Module I Overview of the DLM System
Module 2 Test Security
Module 3 Accessibility for All Students
Module 4 How the Assessment Works
Module 5 Preparing for the Test
Module 6 Computer Delivered Testlets
Module 7 Teacher Administered Testlets
Each module has a post test that must be independently and successfully completed after logging into the Educator Portal.
Teachers must complete the post tests.
It is recommended that the Assessment Coordinator also complete the post test, as these questions helps one determine if they have a thorough understanding of the DLM program.
NJ DLM Winter Training 2015

48. District Directed Teacher Training
The training modules for the DLM alternate assessment is available on the website
A school test administrator must ensure that all teachers participate in the required DLM training sessions.
Teachers may be trained immediately, but every effort must be taken to ensure all teachers are trained prior to March 6, 2015.
Administrators may select either the Facilitated Group Training or Self-Directed Training formats for teacher training sessions.
Either selection requires an Administrator to track and ensure completion of training modules.
All educators participating in training must successfully complete the post-test for each module in order to be approved for administration of the testlets.
NJ DLM Winter Training 2015

49. DLM Manual Revisions
DLM manuals are often updated so check the website often.
When a manual is updated, all screen shots, data dictionaries, and templates shown or referred to in a manual are accurate on the Revision Date noted above. When a manual is updated, the Revision Date will also be updated. An alert will be posted on the Test Updates webpage. A summary of changes is included in the Appendix under Document History.
NJ DLM Winter Training 2015

50. DLM Manual Revisions (as of 2/19/15)
The Assessment Coordinator Manual has a revision date of 01/20/2015 for the Year End (YE) Version
The Data Steward Manual has a revision date of 01/5/2015 for the Year End (YE) Version
The Technical Liaison Manual has a revision date of 01/13/2015 for the Year End (YE) Version
The Test Administration Manual has a revision date of 01/6/2015 for the Year End (YE) Version
NJ DLM Winter Training 2015