1. 2012-13 Maryland School Assessment Test Integrity Plan
James Gresham, Ed.D.
Coordinator of Assessments and
Security Investigations

2. Maryland School Assessments (MSAs) Context
Purpose for Monitoring MSA Administrations
Compliance with COMAR statutes
Address the increasing concern on test integrity
Ensure that schools are adhering to MSDE test administration guidelines
Background on MSA s
Administered Spring
Reading and Math Paper and Pencil, Grades 3-8
Reading Online, Grades 5 and 7
Science, Grades 5 and 8
Content Areas Assessed
Reading, Mathematics, and Science
Number of City Schools Participating
162

3. City Schools 2013 MSA Schedule (Paper & Pencil)
March
MON
TUES
WED
THUR
FRI 4
Monitors meet Principals/ STC 5
Reading
Grades 3-8 6 7
Reading Make-up 8
Reading Make-up 11
Make-up 12
Math 13 14
Reading/Math 15 18 19 20 21 22

4. 12 Tips for Principals Principals can NOT serve as STC
Work with your STC to develop a well thought out testing plan (envision your plan)
Make sure that your STC attends the district MSA trainings prior to each administration
Participate in your staff MSA trainings (view and discuss CEO’s video on Test Integrity
Make sure that all person participating in the administration have been trained.

5. 12 Tips for Principals
Make sure your STC keeps a copy of signed Training Certifications and Student Tracking forms on file for 6 years
Make sure your STC immediately inventories testing materials (report discrepancies )
Make sure your STC Tracking Record to account for, and secure test booklets at all times.
Work collaboratively with monitors
Make sure that your STC is prepared to seal boxes at end of the day

6. 12 Tips for Principals
Make sure that all test books are returned on time
When in doubt call OAA (410)

7. School Testing Plan
time you want the monitor to report
Grade
Subject
Examiner (Must Be Certified Employee)
Proctor
Room
Testing With Accommodations
Tues. March 5
Wed March 6
Thurs. March 7 Make-up
Ex: 3
Reading
J. Gresham
C. Wilson
203 No X
Maryland School Assessment (MSA)
School Name and #: Anywhere Ele School #122 Daily Start Time: 9:00am Phone:
Test Coordinator’s Signature:_____________________________________ Date ___________________
Principal’s Signature ____________________________________________Date ___________________
Please return this form to James Gresham: by February 22, 2013

8. Inventory Test Materials
Also verify that only your school’s boxes are in the shipment. Do not accept/sign for boxes belonging to another address. Have the courier take the box for re-routing.
TACM p. 38

9. Inventory Test Materials (cont.)
If possible, inventory boxes while courier is present
If you are missing a box:
Inventory boxes 1 of X, 2 of X, etc. and note missing box number(s)
Alert courier, if possible, to the missing box number(s)
Check PearsonAccess website to confirm delivery of the box(es)
If the box(es) do not arrive within 2 days of the initial shipment, contact the Pearson Customer Support Center.
TACM p. 39

10. If you encounter a discrepancies during the inventory process:
Inventory Discrepancies
If you encounter a discrepancies during the inventory process:
Complete the Testing Materials Inventory Checklist (TACM, page 79, Appendix F)
Contact Pearson immediately; you may be asked to fax a copy of the Testing Materials Inventory Checklist
Pearson
8 am – 6 pm EST
TACM p. 39

11. Inventory Checklist 11
TACM p. 79 11

12. Test Security What are secure materials?
Student Test Books –used and unused, standard-sized and special accommodation
KurzweilTM CDs
Used scratch paper
Examiner's Notes for Braille
School or district staff are prohibited from studying or discussing test items in any manner.
TACM p. 12

13. Test Security What are non-secure materials?
TACM and – Examiner’s Manuals
Unused preprinted student ID labels
Shipping labels – Bills of Lading & colored return labels
Unused MSA Header Sheets
When not in us ALL materials must be kept under lock and key!
TACM p

14. Test Security
Non-Secure materials may be used at any time by STC and TE for training
STCs have access to secure and non-secure materials to prepare materials and training sessions for Test Examiners. STCs may open packages of student Test books to inventory and prepare materials for distribution to TEs.
TEs are not permitted to have access to secure paper and online testing materials prior to the scheduled test date.
TACM p

15. Materials are NOT available to proctors or members of the
Test Security
Non-certified staff: May have access to secure materials for clerical purposes as approved by the LAC and only if supervised by the STC. Non-certified staff may perform activities such as taking inventory of materials or applying preprinted student ID labels to Test Books.
Materials may NOT be copied.
Materials are NOT available to proctors or members of the
general public.
TACM p

16. Test Security Secure materials are available to:
TEs on the day of the scheduled test date
Staff providing certain accommodation may need access to secure materials prior to the first day of testing in order to prepare their accommodations.
STC must contact OAA to determine if a specific accommodation warrants the review of a Test Book prior to the first day.
TACM p. 13

17. Test Security
When not in use ALL materials must be kept under lock and key!
ALL materials must be returned to the STC each day
STCs can use the School Security Checklist or the Daily Test Materials Tracking Record to check in and check out materials on a daily basis.
TEs must account for materials BEFORE and AFTER testing
Any security breach MUST be reported to the school principal, OAA, and MSDE
TACM p. 17

18. Testing Documentation – COMAR Compliance with 13A.03.04
Students should only receive accommodations noted in their IEP, ELL, or 504 plans.
Anyone having access to test materials must sign the Test Administration and Certification of Training Form and Non-Disclosure Agreement
Each TE must be provided The Test Archive Student Tracking Form (Appendix V)
Record ten-digit security barcode number and test form number/letter and sign to confirm all student returned testing materials
STC and TEs must sign one for each test group including one-on-one accommodated administrations and all make-up sessions(for both paper and online)
TACM p. 9-11

19. Testing Documentation – COMAR Compliance with 13A.03.04
All testing documentation must be retained for six years after date of test administration.
Test Administration and Certification of Training Form and Non-Disclosure Agreement
Sign-in sheets from training session
Test Archive Student Tracking Form
TACM p. 9-11

20. Daily Tracking Record
TACM p. 88

21. School Security Checklist
TACM p. 80

22. Test Archive : Student Tracking Form
TACM p. 103

23. Eligible School Test Coordinator(STC)
Must be an employee of the local school system and have a valid MSDE professional school staff certificate:
Principals are NOT eligible to serve as the STC.
Academic classroom teachers
Teachers who teach in Special Education, Gifted, and Talented, and ESOL programs
Physical education teachers, PE, art, health, technology ed. etc.
Media specialists, guidance counselors, school administrators (other than the Principal), etc.
TACM p. 15

24. Eligible Test Examiners
Must be an employee of the local school system and have a valid MSDE professional school staff certificate:
Academic classroom teachers
Teachers who teach in Special Education, Gifted, and Talented, and ESOL programs
Physical education teachers, PE, art, health, technology ed. etc.
Media specialists, guidance counselors, school administrators, etc.
Retired teachers who may be working as instructional assistants, aides, or regular substitutes
TACM p. 16

25. Eligible MSA Proctors Proctors can be:
Non-certified instructional assistants and aides (e.g., student teachers)
State-certified teachers who are not employed by the district
Proctors can assist by:
Helping to distribute and collect testing materials
Circulating and observing during testing
Ensuring students working on correct section
Ensuring students using allowed materials during testing
TACM p. 17

26. Monitoring Plan All schools will be monitored for monitoring;
Work collaboratively with monitor
Review your schools test plan and training certification forms
Conduct classroom observations
Monitor will not assist with test administration
Be prepared to pack test books immediately after testing
Observe daily packing and opening of used test books

27. Monitoring Plan Work collaboratively with monitor and supervisor
Review your school’s test plan and training certification forms
Conduct classroom observations
Be prepared to pack test books immediately after testing
Observe daily packing and opening of used test books
Monitors will not assist with test administration

28. Post Test
The School Test Coordinator is responsible for conducting training for Test Examiners.
____ True _____False
2.  The School Test Coordinator should confirm that all boxes listed on the courier’s shipping invoice have been received before signing for the delivery.
_____ True _____False
 3. The School Test Coordinator can erase a student’s response to a question on the test if he/she is sure that the student knows the correct answer.
4. All students in grades 3-8 must participate in either the MSA , or Alt MSA.
5. If there’s not enough personnel to handle testing accommodations, we just make do.

29. Post Test (cont)
6. It is required for a MSA Test Examiner to have a valid MSDE professional school staff certificate.
_____ True _____False
7. MSA Test Proctors can be student teachers or state-certified teachers who are not employed by the district.
 8. Students who are disruptive during testing can be removed from the classroom to take the test somewhere else.
9. Teachers are permitted to cue regular educations students to select correct answers while testing.
10. Teachers can read the question aloud for the child, if they have difficulty reading the passage.

30. Post Test (cont)
11. As the School Test Coordinator , you can return student test books after the MSDE deadline for returning materials.
_____ True _____False
12. Teachers can have access to student test books at anytime during the testing window.
13. Principals, Assistant Principals, and school-level Chairpersons are prohibited from viewing or discussing secure test materials in any manner, either among themselves or with students before, during, or after testing.
14. All testing materials must be stored in a secure location prior to the test administration.
_____ True _____False 
15. If a student completes a section of the test before the allotted time for that section has expired, he/she may go back to complete questions missed in previous sections.

31. Post Test (cont)
16. Test Examiners are NOT required to read directions to the test verbatim.
_____ True _____False
17. When in doubt about testing administration protocols, the School Test Coordinator should call Baltimore City School’s Office of Achievement and Accountability at (410) for guidance.
18. School are permitted to start paper and pencil testing on Monday March 4, 2013
When the school does not have enough test booklets, the School Test Coordinator is the only person permitted to make photocopies of test booklet
20. Test Examiners and Proctors are permitted to use their cell phones for texting and ing during testing.

32. Questions or Comments?

33. Certification of Training and Non-Disclosure Agreement
TACM p. 72

34. Point of Contact Contacts Test Security :James Gresham
Coordinator of Assessment and Security Investigations, at
MSA Administration: Carol Wilson
Director of Assessments at