1. Score Comparison of New and Old TOEIC L&R
Masaya Kanzaki
Kanda University of International Studies
PanSIG 2017, 20 May, 2:45-3:15, D-204
Akita International University, Akita, Japan

2. Background
ETS updated the TOEIC L&R test in May The revised version looks more difficult than the old one, so learners are concerned that their TOEIC scores will go down.

3. Changes made to the new version
Number of questions in each part of the test
New types of questions

4. Number of questions Part Old version New version Difference Part 1 106 −4
Part 2 30 25 −5
Part 3 39 +9
Part 4
Part 5 40
−10
Part 6 12 16 +4
Part 7 48 54 +6

5. Listening test Three-speaker conversations
Meaning-in-context questions
Graphic questions

6. Reading test Choosing a full sentence to fill a gap
Text message chains
Meaning-in-context questions
Placing a sentence
Triple passage sets

7. ETS said:
Although some of the question formats within the test will change, ETS has conducted several studies to verify that there will be no change in meaning for the TOEIC Listening and Reading test scores before and after the updates. There also will be no change to the level of test difficulty or total testing time. Scores will continue to be comparable across test-form administrations.

8. Public and Institutional Programs
The new version of the TOEIC started in May 2016 but in the Public Testing Program only; the old version continued to be used in the Institutional Program until March 2017.

9. Purpose
To compare scores of the old and new versions of the TOEIC L&R test and see if they are comparable

10. Materials The old version of the TOEIC L&R test
 Institutional Testing Program
The new version of the TOEIC L&R test
 Public Testing Program

11. Participants 141 university students (121 female, 20 male)
81 in July 2016 (PP on 24th and IP on 29th) and 60 in January 2017 (IP on 26th and PP on 29th)

12. Listening scores Mean SD Minimum Maximum Old 370.74 55.94 185 495 New
371.70
59.56
150

13. Reading scores Mean SD Minimum Maximum Old 295.21 73.76 120 480 New
306.67
71.65 95
440

14. Total scores Mean SD Minimum Maximum Old 665.96 120.72 330 970 New
678.37
122.75
245
930

15. Correlation: Listening scores r = .80

16. Correlation: Reading scores r = .84

17. Correlation: Total scores r = .87

18. Questionnaire survey
56 participants who took part in January 2017 responded to a questionnaire

19. Q1. Whose listening test was more difficult?

20. Q2. Whose Reading test was more difficult?

21. Q3. Overall, which version was more difficult?

22. Q4. When you prepared for the exam, which version did you mainly focus on?

23. Q5. Which version do you like better?

24. Conclusion
The new version looks more difficult than the old one and the majority of the survey respondents indicated that the new version was more difficult. Yet, the average score of the new version was slightly higher than that of the old one. This supports ETS’s claim that TOEIC scores would continue to be comparable after the update. Learners should not worry the changes.

25. Any questions? Thank you.
Q&A
Any questions? Thank you.