1. Preparing for the Administration of the Spring Dynamic Learning Maps (DLM) in English Language Arts and Mathematics February 23, 2015 Version
PART TWO
NJ DLM Winter Training 2015

2. Professional Development Modules
DLM developed over forty self-directed professional development modules to help support the transition to the new alternate assessment and Common Core State Standards instruction.
Some of the modules include:
DLM Claims and Conceptual Areas
Composing, Decomposing, and Comparing Numbers
Writing: Text Types and Purposes
The learning modules provide significant information on the background, purpose, and design of the assessment as well as guidance on providing instruction on the CCSS, the DLM conceptual areas, EEs, and nodes.
Viewing the PD modules is optional, though educators will find the information informative.
NJ DLM Winter Training 2015

3. Assessment Coordinator Responsibilities
Includes but not limited to:
Schedules training for teachers and is the direct liaison for teacher questions
Ensures the correct students are assessed
Assists in scheduling students for testing
Interacts with District Data Steward and Technical Liaison to ensure all tasks are completed
Utilizes DLM website, reviews materials, and disseminates information to staff
Reviews DLM Manual and any other required documents
Contacts DLM help desk when DLM documents do not provide clear answers to district questions
District point of contact for test activities
NJ DLM Winter Training 2015

4. Sample of Assessment Coordinator Checklist in Manual
NJ DLM Winter Training 2015

5. Note:
This page is from the DLM NJ website and is for the Assessment Coordinator
NJ DLM Winter Training 2015

6. Data Steward Responsibilities
Includes but not limited to:
Interacts with Assessment Coordinator, Technical Liaison, and Teachers as necessary to ensure successful completion of testing
Creates and uploads data files including:
the Users file (opens DLM user accounts for testing)
Enrollment file
Class roster files
Assigns roles to users which generates user login IDs
Understand and utilize IT/technical expressions contained in the System Start-Up Manual in order to prepare files correctly according to specifications
Utilize consistent and appropriate naming conventions and provide clean data for data files in order to successfully upload files as outlined by the DLM User Guide for State and District Staff (Data Steward)
Utilizes DLM website, reviews materials, and disseminates information to staff
Reviews DLM Manual and other applicable documents (e.g. Data Tips, etc.)
Contacts DLM help desk when DLM documents do not provide clear answers to user account issues, data file upload errors, etc.
NJ DLM Winter Training 2015

7. Sample of Data Steward Checklist in Manual
NJ DLM Winter Training 2015

8. This page is from the DLM NJ website and is for the Data Steward
Note:
This page is from the DLM NJ website and is for the Data Steward
NJ DLM Winter Training 2015

9. Recent DLM Email Update
Recent KITE and Educator Portal updates.
Looking for the student Username and Password to access KITE? You’ll find it in the Test Management area of Educator Portal. See the procedure titled View Student Username and Password in the Test Administration Manual.
Up to 6,000 records may be uploaded at a single time using the Enrollment or Roster templates.
Accessibility Profile Data Extract includes new fields for Last Modified Time (with date and time) and Last Modified User.
NJ DLM Winter Training 2015

10. Technical Liaison Responsibilities
Includes but not limited to:
Is responsible for the infrastructure (network, hardware and devices), software applications and technical support as well as understanding how the hardware, software, policies, and procedures fit together in the big picture of the district’s technology implementation.
Ensures district technology readiness and implementation (IT staff)
Reviews DLM Technical Liaison Manual revised 1/13/2015 and completes all tasks
Interacts with Assessment Coordinator, District Data Steward, and Teachers as necessary to ensure successful completion of testing
Utilizes DLM website, reviews materials, and disseminates information to staff
Contacts DLM help desk when DLM documents do not provide clear answers to technology issues
NJ DLM Winter Training 2015

11. Sample of Technical Liaison Checklist in Manual
NJ DLM Winter Training 2015

12. This is from the KITE page
Note:
This page is from the DLM NJ website and is for the Technical Liaison
NJ DLM Winter Training 2015

13. Webinars for School and District Staff Who Monitor Assessment
NJ DLM Winter Training 2015

14. Webinars for School and District Staff Who Monitor Assessment
Recorded versions of the webinars will be available on the DLM website 2 days after the live session. Staff who could not participate in a live webinar could use the recording to learn about the responsibilities and procedures to monitor assessments.
NJ DLM Winter Training 2015

15. Classroom Teacher/Test Administrator Responsibilities
Includes but not limited to:
Provide instruction throughout the year related to the CCSS, EEs, nodes, etc.
Assist in the completion of the First Contact and PNP surveys.
Activate educator portal user ID in KITE
Schedule students for testing and gather needed supports such as manipulatives
Reviews DLM Manual, reviews the accessibility features of the DLM system, completes required training modules, and reviews DLM website for any other required documents/necessary information
Contacts District/School Test Coordinator with any questions or issues
NJ DLM Winter Training 2015

16. Test Administrator Partial Checklist from Manual for Teachers
NJ DLM Winter Training 2015

17. Note:
This page is from the DLM NJ website and is for the teacher who administers the DLM
NJ DLM Winter Training 2015

18. Test Accessibility and other features
NJ DLM Winter Training 2015

19. Online Student Surveys
There are two student surveys that are completed by the student’s teacher, and who may be assisted by other educators who knows the student well.
The First Contact survey asks questions about the student’s level of skills in ELA and Math.
This survey assists in the selection of the level of test items (node linkage levels).
The Personal Needs Profile asks questions about the students’ support and accessibility needs during testing.
This survey assists in the selection of the computer accessibility features and other support needs during testing.
NJ DLM Winter Training 2015

20. Online Student Surveys
Personal Needs Profile (PNP)
PNP online survey must be completed for each individual student being tested for DLM.
Once PNP is completed, a summary will be generated.
This profile collects information on the students support needs and current level of instruction, and engages computer accessibility features.
First Contact
Online survey completed by ELA and Math classroom teachers. A copy of the student’s IEP is needed as a reference when answering the questions.
This survey helps identify the student’s academic levels in order to establish a baseline as the system selects test items.
NJ DLM Winter Training 2015

21. Accessibility Manual This manual was updated on February 16, 2015.
If the FC and PNP surveys were completed during field testing, please review them one more time, then hit submit in order to finalize the survey info.
NJ DLM Winter Training 2015

22. Accessibility Features
DLM offers a variety of accessibility tools and supports during assessment.
Some of these are delivered through the KITE system, which are determined by responses to the First Contact and Personal Needs Profile (PNP) survey.
Other supports, such as having the teacher read the test aloud, is provided by the school.
NJ DLM Winter Training 2015

23. Accessibility Features
Six Steps to Customize DLM Accessibility Features for Students
 Step 1: Include Eligible Students in the DLM Assessment
 Step 2: Learn About the DLM Accessibility Features: What Does DLM Provide?
 Step 3: Discuss and Select Appropriate Supports and Tools: Considerations for IEP Teams
 Step 4: Enter Appropriate Supports into the DLM System
 Step 5: Prepare for the Assessment: Using the Chosen Accessibility Features
 Step 6: Evaluate the Accessibility Features Used After the Assessment
These six steps are explained in detail in the Accessibility Manual for DLM Steps 1 through 3 are intended for full IEP teams to determine the accessibility features for eligible students, and steps 4 through 6 are for the educator or test administrator to enter, use, and evaluate the effectiveness of the selected features.
NJ DLM Winter Training 2015

24. Category 1: Supports provided within DLM via the PNP profile
Computer synthesized read aloud is no longer available. Teachers will need to provide this support if needed by the student.
Category 1: Supports provided within DLM via the PNP profile
Online supports include magnification, invert color choice, color contrast, and overlay color. Descriptions about how to select supports provided by the PNP are found in Step 4 of the six-step DLM accessibility customization process.
NJ DLM Winter Training 2015

25. Category 2: Supports requiring additional tools or materials
These supports include Braille, switch system preferences, iPad administration, and use of special equipment and materials. These supports typically require prior planning and setup. These supports are all recorded in the PNP even though two-switch system is the only option actually activated by PNP.
NJ DLM Winter Training 2015

26. Category 3: Supports provided outside the DLM system
These supports require actions by the test administrator, such as reading the test, signing or translating, and assisting the student with entering responses. These supports are recorded in the PNP even though they are delivered by the test administrator.
NJ DLM Winter Training 2015

27. Supports: Braille Test
Please contact the Office of Assessments if you have a DLM student that needs a Braille test.
Final information is not yet available.
NJ DLM Winter Training 2015

28. What Must Be Written in a Student’s IEP Regarding Accessibility?
Specific instructional supports are usually included, such as use of communication board, picture symbols, text read aloud to the student, etc.
For DLM the training materials will describe which accessibility features, supports, etc. are available.
Select only the DLM accessibility features that are familiar to the student based on instruction.
It is not necessary for all test accessibility features and supports be listed in the IEP for DLM. However, it is important to select the features and supports for testing that students need during instruction.
An accessibility feature may be used by the student even if it is not explicitly listed in the IEP.
NJ DLM Winter Training 2015

29. General Test Information
Practice item testlets are available on the DLM system and should be administered to the students prior to testing.
Practice testlets relate to various accessibility features the student may use. Select the practice testlets (“demos”) based on the PNP features.
The purpose of using the practice items are to
confirm that the accessibility features engaged are appropriate for the student.
If they are not you may revise the PNP before administering the test.
give the student experience with the online test experience prior to answering live test questions.
This allows the student and teacher to be aware of the computer features, and helps to determine whether the student or teacher would “drive” (use the computer mouse) during testing.
NJ DLM Winter Training 2015

30. General Test Information
Prompting is not allowed in the DLM system.
Teachers may repeat a test question and then pause an appropriate amount of time for a student to process the question and select an answer.
If a student does not answer a question the teacher will mark “no response” if listed as one of the student response options.
If a student cannot answer the question, and ‘no response’ is not an option provided by the system, then do not mark a response and continue to the next test item.
NJ DLM Winter Training 2015

31. Clarification Allowed if Needed
Some test item directions ask the teacher to say “Show me the ….”
If necessary, after stating the phrase “Show me the …,” you may restate the phrase for clarification by saying either of the following:
“Look at the …”
“Point to the …”
“Touch the …”
For example, the teacher may say “Show me the red marker.” Then for clarification say “Point to the red marker.”
NJ DLM Winter Training 2015

32. Educator Resource Page
Review the DLM web page ent/erp_ye to obtain information on sample testlets, tested Essential Elements, familiar texts, and other important information.
The following slide shows an excerpt from the DLM math glossary, a summary of the math terms utilized during testing.
NJ DLM Winter Training 2015

33. Section of the Glossary
NJ DLM Winter Training 2015

34. Manipulatives
The list of math manipulatives needed for each grade level is available on the Educator Portal.
Teachers can login to the portal and access the list of manipulatives needed for any grade.
Once the student ticket is available, click on the Test Management tab in the Educator Portal.
This tab is where the TIPS pages are located, as well as the student test tickets.
The manipulative list associated with the assigned student testlet will be described in the TIPS page.
NJ DLM Winter Training 2015

35. Testlet Information Page
NJ DLM Winter Training 2015

36. Manipulatives
Once a teacher reviews the TIPS page and the recommended manipulative list, he/she may make appropriate substitutions if necessary when the original manipulative is not available in the school/district or if substituting a manipulative is best for the student.
Consider the attributes of the required manipulative when selecting a substitute. The substitute manipulative must fulfill the required attributes,.
Example: if the original manipulatives were two large red buttons and one small blue button, you may substitute with two large red markers (exact same markers) and one small blue marker. Do not use red markers that are not the same size, and do not use a blue marker that is the same size as the red markers.
NJ DLM Winter Training 2015

37. Security Information
NJ DLM Winter Training 2015

38. SECURITY PLAN Technology Problems Reporting Breaches & Irregularities
Mandatory Turnkey Training
Technology Problems
Reporting Breaches & Irregularities
Chain of Command
Disruptive or Sick Student
NJ DLM Winter Training 2015

39. Security Protocols for Computer Based Testing
All computers must have the required software to support computer-based testing.
KITE is the site used to access testlets.
Educator Portal is used to input and review data, obtain student test tickets, etc.
All computers have access to broadband and secure internet connectivity.
Consider whether or not proctor caching is necessary in each school.
NJ DLM Winter Training 2015

40. TESTING SITES
Testing requires a computer or tablet device with the KITE application
Testing may be done in the classroom as long as:
The student can hear and respond to directions and test questions without loud background noise or noise at a level that would disturb the testing student.
Other students and staff cannot view the test questions.
Testing may be done in a computer center, quiet office, or other alternate location that offers a secure and quiet environment.
NO Cell Phones, MP3 Players or Any Unauthorized Electronics
NJ DLM Winter Training 2015

41. TEST SECURITY Security is a district wide responsibility.
Absolutely NO reproduction or transmittal by any means of test items, passages, prompts, or other secure items or materials.
Security breaches may have:
Financial consequences for the district
Professional consequences for staff
Disciplinary consequences for students
Inform ALL district & school personnel of security procedures prior to test administration
Review the module on test security posted in late March on the DLM NJ webpage.
NJ DLM Winter Training 2015

42. Test Security
Information on reporting irregularities and security breaches during testing along with the forms will be posted to the DLM NJ page by the end of March.
The test security agreement for all educators involved in DLM will be posted on the DLM NJ page in March.
Teachers administering the DLM will electronically sign a test security form found on the KITE Educator Portal.
All other educators involved in DLM will sign the New Jersey paper version of the test security agreement and submit it to the District Test Coordinator prior to April 6, 2015.
This form will be posted to the DLM NJ page in late March.
DLM test results will be included in the state accountability reports produced by the Title I office.
NJ DLM Winter Training 2015

43. More Information
NJ DLM Winter Training 2015

44. Topics Not Included
As information becomes available on scoring and reporting of DLM results, it will be posted on the DLM website.
Standard setting will occur the week of June 15. Educators who are interested in participating in DLM standard setting should contact
DLM test results will be included in the state accountability reports produced by the Title I office.
NJ DLM Winter Training 2015

45. Forms for DLM
Forms for documenting teacher administration observations will be available online by end of March.
These forms are optional, but will help you collect administration information useful for DLM, Office of Assessments, and your school.
Please check the DLM NJ page in late March to review the forms for possible use.
NJ DLM Winter Training 2015

46. District Communication
Districts must share information among staff, and ensure that all DLM teachers are prepared for instruction and testing.
The Assessment Coordinator must turn key train all administrators involved in testing, and provide copies or web links to the required training materials.
Only the District Assessment Coordinator, Data Steward, and Technical Liaison may contact the DLM help desk or DOE with questions.
Please ask others to communicate their questions to you clearly with specific error references and/or training material page references so that you might obtain the information.
NJ DLM Winter Training 2015

47. Where To Get More Information?
DLM has various customer support contact information depending on the issue. It is imperative that:
Only those individuals serving as Assessment Coordinator, Technical Liaison, and Data Steward contact DLM.
Contact DLM support only after reviewing all pertinent manuals, handbooks, and modules.
Use the specific contact info listed in the applicable manual to ensure your question is directed to the correct individuals.
Provide in your your CDS code (known to DLM as your “Organization”), your name and which of the three positions above you hold, as well as detail the specific issue/error you encountered.
Questions directed to DLM Support, and when necessary NJ DOE, must be from either the Assessment Coordinator, Technical Liaison, or the Data Steward.
Questions from other district staff including teachers must be directed to one of the following individuals noted above.
NJ DLM Winter Training 2015

48. Where To Get More Information?
Questions regarding DLM please contact the Customer Service Help Desk via PHONE: (toll free) or
Prior to requesting assistance, DLM information must be reviewed. Specific questions related to the training manuals, KITE, educator portal, and other DLM topics should be addressed to the DLM helpline with specific details about the issue. Use manual page references when applicable, and cite the exact system error or issue you are experiencing.
DLM and Office of Assessment staff cannot summarize or provide topic information in place of educator review of the training materials. Review all DLM materials prior to contacting the help desk.
NJ DLM Winter Training 2015

49. Where To Get More Information?
Assessment Coordinators with general questions about test design, training, accessibility features, scheduling, test administration, etc., contact: Elizabeth Celentano Office of Assessments Data Stewards with questions about APA and DLM student data file uploads, Pre-ID, SDIF, record changes, score interpretation, and other data file issues etc., contact: Jo-Lin Liang Please contact DLM support for assistance prior to the Office of Assessments in order to facilitate a timely response.
NJ DLM Winter Training 2015

50. Where To Get More Information?
Technical Liaisons with questions about technology readiness issues contact:
Linda Carmona-Bell
Office of Assessments
Joseph Seaman
Please contact DLM support for assistance prior to the Office of Assessments in order to facilitate a timely response.
NJ DLM Winter Training 2015

51. NJDOE Contact Information
Test Coordinators
PARCC Orlando Vadel
PARCC Timothy Steele Dadzie
PARCC HS & HSPA Veronica Orsi
DLM Technology Joseph Seaman
DLM Technology Linda Carmona-Bell
NJBCT & NJASK Science Michael Luke, Interim
APA & DLM Elizabeth Celentano
AHSA Faye Ball
NAEP Tabitha McKinley
NJ DLM Winter Training 2015

52. Office of Assessment - Fax 609-984-6032 NJDOE Measurement Specialists
HSPA & Biology Rob Akins
DLM/APA Jo-Lin Liang
PARCC Don White
NJ DLM Winter Training 2015

53. Where To Get More Information?
Office of Special Education (general special education questions; please do not send DLM questions to this office) New Jersey Department of Education Department of Education website:
NJ DLM Winter Training 2015

54. Final Notes I hope you have found this information helpful.
Please check back to the DLM NJ webpage periodically in March for additional modules.
Thank you for your time.
NJ DLM Winter Training 2015