1. Spring 2017 Writing SOL Training
Presented by:
Stephanie E. Haskins
February 8, 2017

2. Training Agenda Timeline What’s New? Testing Upload
Testing and Curriculum Resources
Student Registration & Test Assignments
Role of Examiners
Reminders for Testing Coordinators
Questions
Main “NEW” Item is TestNav and update to testing accommodations (as reflected in new accommodations sheet)

3. Testing Timeline Date Event February 15 Paper Orders Due February 27
Data Upload File Due to DDOT
March 10
Non-secure/ Secure Material Delivery prior to this date
March 14
March 15
March 16-17
SOL Testing:
Writing Multiple-Choice
Writing Prompt
Make-ups (Alternate)
March 24
Last day to return materials
April
Writing term grad testing (Attempt 2)
June 16
Requests for rescore due to VDOE

4. What’s New for Writing?
Proctor Caching – no earlier than 24 hours prior to the start of the test window

5. Proctor Caching

6. Writing Reminders
ALL Writing is combined to in Pearson (versus Fall, Spring, Summer).
All short papers will be scored once by a human scorer and once by a computer. If disagreement exists, short paper will be scored again by human reader.
Term grads are NO longer automatically scored a second time; review during rescore process.
Examiner manual and Test Implementation Manual – directions updated to include discussion of cell phones & cheating.
VDOE Examiner training

7. Resources School Test Coordinator Handbook
Student Data Upload File Requirements
Test Implementation Manual
Supplement to Test Implementation Manual
Examiner’s Manual
Pearson Access User’s Guide for the Virginia Assessment Program
Virginia Standards of Learning Assessments Guidelines for Administering the Read-Aloud Accommodation
TIMS Manual Updates:
Index Section Added
Updates Appendix C (Special Testing Accommodations)
Expanded Sections on Make-up testing (5.8), Term Grad Testing (5.9), and Expedited Retake Testing (5.10)
Expanded section on Preparing for Online Testing (4.4)
Expanded description for test manipulatives (scratch paper and highlighter – pages 17 and 18)
Examiner Manual Updates:
Directions to address TestNav 7, including screen shots
Test directions that have students verify: name on test ticket, name on computer screen, test on math formula sheet

8. Testing Upload Additions in RED and Deletions in RED
Group Name: Consider how you want score reports to be organized.
Group code: Will NOT appear on printed reports; allows for data sorts; Max 10 characters
Test code: Check against file requirements.
Disability: Based on time of testing – applies to all tests.
Ethnicity/ Race: Hispanic; 32 categories
ELL information: Test tier, composite, literacy, SOA-LEP, AYP-D
SOA Transfer: Enrolled after 20th day – on Sept 7th or after; on Feb 2nd or after
AYP: If a student began school ANY day AFTER the first day AND was NOT in our division last year, can be coded as AYP. May disregard reference to “September 30”.
A: within division
B: outside division/ within Virginia
C: outside Virginia
Term grad: Scheduled to graduate by August 31, 2016; Assigns equated forms first
Project Graduation: Assigns term grad form
RP-Code: Genesis
Retest: High school only – if retaking test
Recovery: Reading or Math only – May only be coded Recovery 1 time per test – on FIRST test, following remediation
D-Code: High school only – if pursuing modified standard diploma (needs literacy/ numeracy requirements) – last year available
Online Test: Students NOT marked as online should have documented need
1st semester – 20 days = Sept 19
2nd semester –Snow days – Jan 21, 22, 29, Feb 13, 14, March 3, 4
Additions in RED and
Deletions in RED

9. Testing Upload
Distribute/ discuss Documentation of Need for Paper/pencil SOL tests

10. Form Matrices - Paper
A maximum of four attempts are available during the spring Non-Writing test administration.

11. (Highlighter or pen of two colors, as needed)
Materials
Paper/Pencil
Online
Multiple-choice
Pencil
Scratch paper
Short paper
Dictionary
(Highlighter or pen of two colors, as needed)
Multiple-choice
Pencil
Scratch paper
Short paper
(Highlighter or pen of two colors, as needed)

12. Closings or Delays
2-hour delay: Multiple-choice testing will continue on modified schedule. Short-paper testing will be rescheduled.
Closing: Testing will re-scheduled, and a new schedule will be communicated.

13. Curriculum Resources
SOL Writing Test Blueprint and Rubric
SOL Writing Test Prompts
Writing Practice Tools and Guides
Writing MC/ TEI Practice Items and Guides
Checklists for Writers
Standards and Framework
Released Tests
(Assessment & Testing Services)
SOL Writing Rubric
Writing Scoring (Password is: Virginia)

14. Other WRITING Testing Reminders:
Review the test blueprint to make sure all writing standards are reviewed.
Review multiple-choice format using released practice items, including technology-enhanced items.
Writing prompts are all released. Students will write to one of the released prompts.
Use rubric to evaluate Writing prompts – 2/3 of score is composing/written expression & 1/3 is usage/mechanics.
Use editing checklist to self-evaluate writing.
Use Perspective website for anchor papers, practice papers, and verification sets. In addition to classroom use, this site could also be shared with parents for at home use.
Other WRITING Testing Reminders:
Actual SOL tests are scored online and are not printed.
Item Practice and Review
Analysis of Writing
Application of Prompts
Prompt Writing Practice

15. Other WRITING Online PRACTICE Tips:
Use writing prompt practice tool (and guide) to respond to prompts and become familiar with tool.
Refer to Prompt Writing Practice reminders.
Other WRITING Online PRACTICE Tips:
Actual SOL tests are scored online and are not printed.
Item Practice and Review
Analysis of Writing
Application of Prompts
Prompt Writing Practice

16. Examiners & Groups
Determine how students will be grouped for testing and which staff members will serve as Examiners.
If resources permit, it is recommended that teachers do not serve as Examiners or Proctors to their own students.

17. Test Security Agreement
READ all Test Security Agreement prior to signing and administering any SOL assessment.

18. Pre-Testing Discussion
Discuss consequences of accessing cell phones, electronic devices, or other unauthorized materials during testing.
Discuss consequences of cheating on the test.
In addition to any school consequences . . .
“Remember, you must do your own work and not discuss the test at any time with anyone, including your classmates and teachers. Students who cheat on the test will receive a score of zero and will not be permitted another opportunity to take the test until next test administration.”

19. Security Reminders
Reviewing Test Items: Examiners/ Proctors must NOT spend any time reading test items, creating any type of answer key to items, reviewing/ grading short papers, copying test items, taking notes about items, recording student responses, or discussing test items with anyone.
Students leaving test room during test: Students may NOT leave the testing site and return to finish the test unless they are closely monitored. Students must NOT discuss the test or be allowed to interact with students, educational materials, or electronic devices while out of the test room. Each component must be completed in one school day.

20. Role of Examiners/ Proctors
During test administration, Examiners/Proctors must monitor the testing process by moving as unobtrusively as possible about the room. They should ensure that students are working independently and do not have access to unauthorized materials.

21. Answering Student Questions
Examiners/ Proctors MAY answer questions regarding technical issues of the assessment.
They may NOT answer questions that would provide any hint or clue with regard to the assessment.
If the student is testing online, the student should either be Exited from the online test or the computer monitor turned off prior to break to maintain test security.
If the test is to be administered in sections over more than one school day, care must be taken to ensure that students are exposed to only those test items in the section that they are currently attempting.
A test booklet may be sealed to prevent a student from being exposed to previously completed items and items not yet accessed. (i.e. stapling booklet)

22. Examples of Technical Questions
Scrolling: “To view all of the reading passage, use the scroll bar to the right of the passage to move the page up and down.”
Navigating the test: “To move to the next question click the Right Arrow”; “To go back to the previous question click the Left Arrow”; “To go back to a question from the review dropdown, select the question’s number”; “To submit your test click the Submit final answers button”; “Go back to the test item to make sure the Pointer was used to indicate the answer.”
Student Inactivity: “Are you finished with your test? If not, You need to continue working on your test.”
GRADES 6-8 & EOC: If examiner sees that student has unfinished items, examiner may only tell student to “Read the screen carefully.”
NOTE: Examiners/ Proctors may NOT use the student’s mouse or keyboard to navigate any portion of the test for the student.

23. Examples of Hints or Prompts
Short Paper: Do NOT remind students to make adjustments or corrections to the short paper or to write more (or less).
Multiple-Choice: Do NOT prompt students to go back to any specific questions.
Questions about test items or prompt: “Read it carefully and choose the best answer” or “Read the topic carefully and write a short paper about it.”

24. Guidance for Submitting a Test
GRADES 6-8 & EOC: If examiner sees that student has unfinished items, examiner may only tell student to “Read the screen carefully.”

25. Paper vs. Online
Students who meet one or more of following criteria may be assigned a paper/pencil test:
Placement: Special situation school, homebound, Governor’s school
Accommodation requires paper/pencil: large-print, Braille, flexible schedule (multiple testing sessions requiring more than one day)
Documented medical condition: Exposure to computer will aggravate condition (i.e. seizure disorder, etc.)

26. Small-group Recording
AUDIO Recording Required
VIDEO Recording Required
Read-aloud accommodations (10)
Examiner records responses (18*)
Specific verbal prompts (20)
Response devices (21*)
Dictation to a scribe (25)
Read back student response (30)
Dry erase board (2)
Interpreting/ translating (12)
Communication Board, Choice cards (13)
Augmentative Communication Device (22)
18: If a student responds verbally, points, or otherwise indicates a response, the student must be assessed individually and recorded or proctored.
21: Sessions involving speech-to-text must be recorded or proctored.

27. Online Writing Tests: How
Creating test sessions for online SOL Writing tests:
One difference in test session management when administering online writing:
Unlike a non-writing test administration
One online SOL Writing test assignment will allow a DDOT or STC to add that student to two sessions
A session for the short paper component
A session for the multiple-choice/TEI component
Student must complete both components to have a complete, scorable writing test
A student MUST complete both components in the same mode

28. Test Alerts and Reporting
Must have both components completed in the same mode to be reported as a complete test
New alerts will be used such as:
Unmatched Test Component
Either the online short paper or online MC/TEI component is not complete

29. Online Writing Tests: How
The Student Test Details screen for a writing test assignment (this is an example of a Grade 8 writing test assignment), will have a different look than in a non-writing test administration.
Some test details will be identified about each component while others will be coded for the entire test.
Once both components are completed, they will be merged into a single SOL Writing test. Both components must be completed in order to have a scoreable SOL writing test.
In a writing test administration, the two components (MC/TEI and short paper component) will show individually on the Student Test Details screen for an online SOL Writing test.

30. Online Writing Tests: How
Special test accommodations will be recorded on the Student Test Details screen for each component of the writing test. If the same accommodation is used on both components, it is coded only once.

31. STC Reminders . . .
Proctor Authorization Tickets and Student Authorization Tickets – These tickets should be printed no more than 4 days prior to the test window start date and must be stored in a secure location until needed.
Start the test session the day of the scheduled session.
Use the Examiner’s/ Proctor’s Test Booklet/ Test Ticket Transmittal Form/ Affidavit to distribute and collect test tickets and materials to examiners. Provide Examiners extra copies of the formula sheets and the Periodic Table of the Elements, where applicable.
Ensure that all examiners/ proctors have allowable test manipulatives. (Refer to instructions in TIM and Examiner Manual for clearing calculator memory.)
Approximately 75 minutes is a typical testing time. Make sure that testing sessions are scheduled so that they begin early enough to allow students reasonable amounts of time to complete the test before lunch or before the end of the school day. Prior to the first date of testing, develop a plan to accommodate situations in which “allocated” time has elapsed but students have not yet completed the test. Plans for alternate testing sites should include appropriate test security precautions. If students must be moved to an alternate testing site to complete the test, their test materials must be collected by an Examiner or Proctor prior to the move and redistributed only after the students are settled in the new site. While in transit, students must not be allowed to discuss the test with anyone or have access to educational materials.
Provide a copy of the testing schedule to the DDOT in advance.

32. More reminders . . .
View the status of each test session through Session Details screen (Ready, Active, Exited, Resumed, Resumed-Upload, Submitted, Processing, Completed, Marked Complete).
Add, move, and remove students from test sessions, as needed. Students who are absent on the day of testing must be removed/moved from the session before it can be stopped.
Stop all online test sessions at the end of the day. All students must show a Completed status on the Session Details screen. Any students with a Not Started, Exited, or Resume status must be removed/ moved to a make-up or irregularity session before stopping the test session.
VDOE will be monitoring dates and times proctor tests were accessed as well as read-aloud sessions left “Started” overnight
Read-aloud sessions should be stopped immediately upon completion of the test session and should NEVER be left “Started” at the end of the testing day
If the read-aloud session involves a grade 3 reading test that will be administered over two days, move the students to a new session and stop the original session; Print new test tickets

33. More reminders . . .
Moving a student: If students are moved to an alternate testing site to complete their tests, their Student Authorization tickets must be collected by the Examiner or Proctor prior to the move and redistributed only after the students are settled in the new location. While in transit, students must not be allowed to discuss the test with anyone or have access to educational materials.
Their online test must be Exited prior to being moved to the new location. Before the student can log in (using the same information on the test ticket) to complete their test, the student’s test must be Resumed in Test Session Management.

34. Marking Tests Complete
Mark test complete guidelines: Every student identified for testing must be accounted for via an online test or a paper document, including students who were not tested because they:
Were exempt due to LEP
Were absent during the entire testing window
Refused or were disruptive
Parent refusal
Cheated
Were involved in a medical emergency
Failed the course but passed the test and are retaking the course
Took a substitute test for verified credit
Move these students to a new session and the DDOT will mark these tests complete at the conclusion of testing.
It is not necessary to submit a test with a Testing Status code for students who were scheduled to retest for a verified credit (having previously passed the course) and who did not take the retest.

35. Other reminders . . .
Testing Accommodations: Add Test-Specific data in PearsonAccess to indicate what accommodations were provided to the student under the Test Details screen of PearsonAccess. (Temporary Accommodations may be handled through the upload or under Student Registration.)
Student Alerts: Clear all student alerts for the school, when possible. Ask if there are questions related to alerts.
Be sure that the RETEST flag is selected on the Test Assignment screen for every student who is retaking the test for verified credit.

36. High School Only:
Substitute Tests: If a student is enrolled for the first time in a course that requires an EOC test and has taken or will take an approved substitute test in place of the EOC tests, include in upload and select Testing Status code 10. If a student has failed an EOC test and takes an approved substitute test as a retest in an attempt to earn a verified credit, complete Testing Status code 10 AND set Retest flag to Y.
Distribute/ discuss Documentation of Need for Paper/pencil SOL tests

37. Trouble-Shooting Trouble-Shooting Audio is not working.
Audio is working (but student shouldn’t have audio).
Shading is not visible on the test question.
Review screen indicates “unanswered” but student answered.
Question shows not answered
Choice Eliminator tool on TEI question is not working.
Overwriting/ Deleting Text unexpectedly
Cannot type any more in response area (has NOT exceeded 6000 characters)
Submitted test prematurely
Attempting to submit & gets an error message
Attempting to test & error message appears

38. Requests for Rescore Determine that the student failed the test.
Examine the score on the multiple-choice portion and the short-paper portion to determine area of weakness.
Determine if short paper should have received a higher score.
Two people should review the short paper and come to agreement that the score should be higher.
Submit a rubric for the writing, along with highlights in the writing or explanation for why the score should be higher to DDOT prior to deadline.

39. Questions?