1. Educational Testing Service, Copyright 2005, all rights reserved Controlling Education Testing Fraud Raymond Nicosia World Bank Privacy Protection Officer & Washington, D.C. Testing Integrity Executive Director November 10, 2008 Educational Testing Service

2. Educational Testing Service, Copyright 2005, all rights reserved Percentage That Admit Having Cheated? 97%

3. Educational Testing Service, Copyright 2005, all rights reserved Purpose Today Share with you the tricks test takers try Brief you on what we do at ETS Q&A

4. Educational Testing Service, Copyright 2005, all rights reserved Educational Testing Service ETS administers 24 million tests in 192 countries in 25,000 test centers The Office of Testing Integrity, with a staff of 35, oversees both the paper- and computer-based security operations

5. Educational Testing Service, Copyright 2005, all rights reserved Four Types of Cheating Copying/Communication Impersonation Preknowledge Internal Fraud

6. Educational Testing Service, Copyright 2005, all rights reserved Copying remains the most common form of gaining an unfair advantage Courtesy http://www.clipartheaven.com/clipart/education_&_schools/cartoons/cheating_on_test.gif

7. Educational Testing Service, Copyright 2005, all rights reserved Three Types of Copying Planned Opportunistic Desperate

8. Educational Testing Service, Copyright 2005, all rights reserved Two Types of Communication Signals Notes

9. Educational Testing Service, Copyright 2005, all rights reserved What’s the Biggest Threat to Secure Testing?

10. Educational Testing Service, Copyright 2005, all rights reserved Four Types of Cheating Copying/Communication Impersonation Preknowledge Internal Fraud

11. Educational Testing Service, Copyright 2005, all rights reserved Four Types of Cheating Copying/Communication Impersonation Preknowledge Internal Fraud

12. Educational Testing Service, Copyright 2005, all rights reserved Information Out

13. Educational Testing Service, Copyright 2005, all rights reserved Answers In, Answers Out Unacceptable calculators include those that use typewriter-style (QWERTY) keypads. -- e.g., TI-92

14. Educational Testing Service, Copyright 2005, all rights reserved Information Or Answer Key Out

15. Educational Testing Service, Copyright 2005, all rights reserved Preknowledge

16. Educational Testing Service, Copyright 2005, all rights reserved Preknowledge

17. Educational Testing Service, Copyright 2005, all rights reserved Four Types of Cheating Copying/Communication Impersonation Preknowledge Internal Fraud

18. Educational Testing Service, Copyright 2005, all rights reserved Internal Fraud Test Development Test Production Shipping/Receiving Administration Scoring

19. Educational Testing Service, Copyright 2005, all rights reserved Three Steps of Test Security Prevention Detection Remediation

20. Educational Testing Service, Copyright 2005, all rights reserved Supervisors Need To: Secure material Count material Train staff (video)

21. Educational Testing Service, Copyright 2005, all rights reserved Prevention

22. Educational Testing Service, Copyright 2005, all rights reserved Prevention: Training

23. Educational Testing Service, Copyright 2005, all rights reserved

24. Prevention: Test Books “No-Calculator” Symbol will appear at top of pages in sections where calculator are not allowed: Critical Reading, Writing All Subject Tests except Math 1C/2C

25. Educational Testing Service, Copyright 2005, all rights reserved Detection Test Center Histories Test Security Procedures

26. Educational Testing Service, Copyright 2005, all rights reserved Triggers to Question Scores Studies Supervisor Irregularity Reports Large Score Differences External Inquiries Internal Inquiries

27. Educational Testing Service, Copyright 2005, all rights reserved Large Score Difference: SAT Scoring: 200-800, CR, M, W LSD:250 +/- per section (3) 350 +/- two totals (3) V&M; V&W, M&W 500 +/- total (1) V&M&W

28. Educational Testing Service, Copyright 2005, all rights reserved Test-taker’s Handwriting Sample

29. Educational Testing Service, Copyright 2005, all rights reserved

30. Remediation: Options Additional Information Cancel Retest Arbitration Release of File

31. Educational Testing Service, Copyright 2005, all rights reserved Remediation: Not an Option Exam-cheat: Indian Teachers Shot Rebels shot six male teachers in the leg for helping students cheat in exams…Abducted from their homes…Teachers took 5,000 repees ($110) for assistance…Two women teachers were beaten with sticks for the same offence….Rebels took same action against drug dealers and producers of pornographic films.

32. Educational Testing Service, Copyright 2005, all rights reserved Remediation: Board of Review F/T Chair 15 experienced ETSers, work in panels of three Any one of the three can clear a score

33. Educational Testing Service, Copyright 2005, all rights reserved Q&A