European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC English language Proficiency for Aeronautical Communication Adrian Enright EUROCONTROL

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC  1. Introduction  2. Test structure  3. Test development  4. The future

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Test Objectives  Design a specific purpose proficiency test to meet ICAO and EC language proficiency requirements  Develop test specifications based on a Needs Analysis  Continuous review and evaluation  Deliver a test that assesses the English language proficiency of the air traffic controller

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 There is a need for a specific purpose proficiency test

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Development Team  Development team of ATC and English language experts  6 States and Eurocontrol  Consultant  Project team

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC  1. Introduction  2. Test structure  3. Test development  4. The future

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Test Design  Evaluating all ICAO language skills  Levels 4 and 5  Tasks elicit phraseology and plain language  2 test papers –1. Listening Comprehension (internet based) –2. Oral Interaction

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Paper 1 Internet based Testing understanding  Controller/pilot  Controller/controller  Routine & non-routine situations  Based on authentic communications  Range of accents ensured

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Test Security ELPAC – Test Security  High stakes test = high level of security  Servers on 3 layers  Different rights of access for different users  Economic to administer  Confidentiality ensured

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Paper 2 (i) Candidates must demonstrate:  Appropriate use of phraseology (RTF)  Switching between RTF and plain language  Making appropriate responses  Resolving misunderstandings  Dealing effectively with pilot/controller relationship  Negotiating an unusual situation

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 The controller must respond appropriately to pilot messages With acknowledgements to Martin Germans

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Paper 2 (ii)  Dealing effectively with pilot/controller relationship  Negotiating an unusual situation  Making a verbal report in plain English  Produce extended speech in an aviation context –Give opinions –Put forward arguments –Evaluate –Speculate –Hypothesise

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC  1. Introduction  2. Test structure  3. Test development  4. The future

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Trialling  Sample of controllers MUST reflect target population  Ensure “Face validity” - feedback  Already two major trialling exercises –20 countries –237 controllers  Next trial – October 2006 –+/- 300 controllers –Ensure standardisation of administrators/examiners

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Test Evaluation  Quantative and qualitative analysis –Test results –Feedback forms –Bio data –Reports etc.  Check how tasks and items perform  Determine reliability  Evaluate “fairness” of the test

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – Test Validation  Internal –Periodic checks that ELPAC meets purpose and requirements  External –Team of language testing experts from Lancaster University –Independent “audit” of whole test package

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC  1. Introduction  2. Test structure  3. Test development  4. The future

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC – 2006/2007  Major trialling exercises –October 2006 –March 2007 –May 2007  Sample tests  Production of training packages  Production of supporting materials

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC  Delivery - July 2007  Evaluation  Training  Assisting Member States with implementation  Ensuring sustainability of the ELPAC Test

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 ELPAC  The ELPAC Test Development Team applies best practice in language testing  Language skills, not ATC skills are assessed  ELPAC is a specific purpose language proficiency test

European and North Atlantic Office ICAO Regional Workshop Language Proficiency Requirements Paris September 2006 Thank you for your attention Any questions?