1. Assessment Literacy for Language Teachers by Peggy Garza Partner Language Training Center Europe Associate BILC Secretary for Testing Programs

2. What is assessment literacy? “Knowledge, skills, and understanding of assessment principles and practice” (Taylor, 2009)

3. Why is it important? So teachers can provide fair and accurate assessments of their students To improve alignment between classroom instruction and desired final learning outcomes To support increasing accountability for classroom instruction For professional development purposes

4. Fundamental Concepts Test purpose Test types Item formats and scoring –Objective vs subjective Measurement principles –Validity, reliability, practicality Basic statistical concepts –Mean, median, mode, dispersion, correlations

5. Classroom Assessment Placement tests Achievement tests Performance tests –Teacher/peer feedback Portfolio assessments

6. Proficiency Testing IAW STANAG 6001 Proficiency testing –Not based on any specific curriculum Separate testing of the four skills –Listening, speaking, reading, and writing Criterion-referenced test –Descriptors for each level Not military-specific special purposes testing

7. Washback “ Washback is the term that is used when students and teachers do things they would not necessarily otherwise do because of the test.” (Alderson and Wall, 1993) Positive and negative washback –Positive: improvements in classroom instruction to better align it with STANAG 6001 testing –Negative: test prep courses, such as those focusing on memorized or rehearsed language

8. Positive Washback STANAG 6001 Testing Familiarization with the descriptors ‒ Content, tasks and accuracy Reading ‒ Tasks ‒ Variety of topical domains Listening ‒ Tasks ‒ Authenticity ‒ Different NS accents ‒ Pace, passage length

9. Positive Washback STANAG 6001 Testing Speaking ‒ Tasks Role play ‒ Unrehearsed speech Writing ‒ Tasks ‒ Timed writing ‒ Scoring rubrics Plus levels

10. Hallmarks of Level 3 Proficiency Professional level language –Abstract concepts and complex topics –Low frequency vocabulary –Understanding the author’s tone –Argumentation, analysis, hypothesis –Extended discourse –Errors almost never interfere

11. 2013 Calendar of STANAG 6001 Testing Events Language Testing Seminar (LTS) –February and September in Garmisch, Germany Advanced Language Testing Seminar (ALTS) ‒ June and October/November in Garmisch, Germany Annual STANAG 6001 Testing Conference ‒ Early September at SHAPE in Mons, Belgium New: Is there interest in an item development workshop? ‒ POCs: Peggy Garza and Jana Vasilj-Begovic