Analysis of results of the survey circulated by WG C and dealing with the integration of an FDM Programme into an operator processes Author : EOFDM WG C

EOFDM WG C2 The European Operators Flight Data Monitoring (EOFDM) forum is a voluntary partnership between European operators and the European Aviation Safety Agency (EASA) in order to:  facilitate the implementation of FDM programmes;  help operators in drawing the maximum safety benefits from an FDM programme. There are four working groups (WG) in EOFDM, of which WG C focuses on the Integration of an FDM programme into operator processes:  To define solutions for the integration of FDM into an operator’s Safety Management System (SMS);  To provide guidance that will help an operator to best manage: limited resources; relationships with top-management and unions; the application of “just culture” or “safety culture” in the use of FDM data; the dissemination of lessons learned from FDM within each company.  To identify best practice with regard to data handling: during day-to-day operation (transfer from the aircraft to the ground, handling of memory media, etc.); in the long term, the de-identification of data and the storage in a secure way. As a part of this work, WG C established a survey to determine the current practice by operators as well as to identify best practice by industry. It could also be used to identify areas where improvement could be encouraged. The survey was conducted towards the end of 2013 and was closed in the second half of January With 74 questions and a wealth of narrative text that was provided by survey participants, once analysed the survey has provided a good deal of valuable data. Of the 50 full responses, mostly coming from scheduled passenger operations, 80% originated in EASA Member States. Forewords

EOFDM WG C3 The purpose of this survey was to establish what forms of outputs operators have from their FDM programmes. The survey  All information collected are confidential and de-identified;  The survey consists of around 70 questions;  Around 50 organisations answer. NB: The survey contains MAIN questions with YES or NO answer. The answer “NO” to the main question inhibits the following questions related to the same topic to be shown to the interviewed

EOFDM WG C4 The survey covers the following topics: The survey  O PERATOR G ENERAL I NFORMATION  FDM T EAM  T HE FDM R EPORT  F EEDBACK TO C REWS /P ERSONNEL  U SE OF FDM FOR T RAINING P URPOSES  F EEDBACK TO F LIGHT O PERATIONS  F EEDBACK TO O THER A REAS (FRMS, M AINTENANCE AND ATC)  T OP M ANAGEMENT R EPORTS view results C ONCLUSIONS view conclusions PLEASE SELECT A TOPIC OR CLICK TO CONTINUE WITH THE WHOLE PRESENTATION

EOFDM WG C5 OPERATOR GENERAL INFORMATION The survey  THE PICTURE OF THE REPORTER  FDM WITHIN THE OPERATOR  T HE FDM S OFTWARE  MEMORANDUM OF UNDERSTANDING  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C6 OPERATOR GENERAL INFORMATION The picture of the reporter NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C7 OPERATOR GENERAL INFORMATION FDM within the operator NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C8 Is your FDM programme outsourced or run in-house OUTSOURCED :18% IN HOUSE :82% Does your reporting software interface with your FDM software? NO 78% YES 20% OPERATOR GENERAL INFORMATION The FDM software NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU No link between the dimension of the fleet and the choice to outsource No reporting software available : 2%

EOFDM WG C9 Does your organization have an MOU with pilots on your FDM program? NO 14%YES 86% Is non-punitive use of FDM data covered by your MOU? NO 8,5% YES 91,5% OPERATOR GENERAL INFORMATION Memorandum of Understanding NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU No link between the dimension of the fleet or the type of operations and the adoption of the MoU

EOFDM WG C10 THE FDM TEAM The survey  T EAM C OMPOSITION  T RAINING AND E XPERIENCE  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C11 THE FDM TEAM Team Composition Full time members Part time members 36% From 5 to 7 14% From 2 to 4 Only 1 50% Only 1From 2 to 4From 5 to 7more than 7 34%56%4%6% Pilot representative within the team YES 66% NO 34% NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C12  An acting pilot.  2 or more years of FDM experience THE FDM TEAM Training and Experience NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C13 THE FDM REPORT The survey  F REQUENCY OF FDM R EPORTS  T YPES OF FDM R EPORTS  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C14 THE FDM REPORT Frequency of FDM reports NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C15 What types of report do you produce? UNSCHEDULED REPORTS82% INDIVIDUAL PILOTS REPORTS43% REPORTS FOR AREAS OF OPERATIONS53% AIRFIELD SPECIFIC REPORTS74% AUTOMATED REPORTS57% Unscheduled report following investigations CAT C Airports Home base Automated fuel monitoring reports If requested by pilot Automated engine reports Aircraft group by areas of ops THE FDM REPORT Types of FDM reports OTHER TYPES OF REPORTS PRODUCED: NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C16 THE FEEDBACK TO CREW/PERSONNEL The survey  G ENERAL F EEDBACK  I NDIVIDUAL F EEDBACK  I S YOUR F EEDBACK E FFECTIVE ?  A CCEPTABLE OR UNACCEPTABLE ?  P ROTECTION OF D ATA  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL General feedback 98% of the interviewed provides feedback to pilots on FDM programme. In which form (multiple choice) : 81,3% 35,4% 68,8% 31,3% 16,7% 12,5% 16,7% Newsletters Replay Web based Video remote play Roadshow Posters Other (Seminars, initial & recurrent training, magazines) 21% Dedicated newsletter 79% Flight safety newsletter 37,5% Fleet specific newsletter NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 17

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL General feedback 98% of the interviewed provides feedback to pilots on FDM programme. How often?: “Do you publicise trends?” YES: 80% NO: 20% “How do you de-identify data (m.c.) ?” Remove LOCATION: 24% Remove CREW: 86% Remove DATE AND TIME: 94% Remove A/C REGISTRATION: 2% NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 18

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL Individual pilot feedback 75% of the interviewed provides INDIVIDUAL feedback to pilots on FDM programme (main question) 1. “What is the method (m.c.*) ?” Phone call: 73% 89% Letter: 11% Text message: 3% Face to face: 8% Web based feedback: 5% 2. “What is the content (m.c.) ?” Request of a report: 72% Notification/review of an excedeence: 77% Request for contact (SM or Pilot rep): 65% 3. “Which department/role provides the feedback? (m.c.) ?” Air Safety Office: 51% Flight operations: 8% Honest Broker/Gatekeeper: 35% Union representative: 5% Outsourced entity: 0% NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU *m.c. = multiple choice 19

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL How do you determine if feedback is effective? How is feedback determined on an individual basis? (open answer) CHECK OF INDIVIDUAL REPORTS TO VERIFY ANY CHANGE OF BEHAVIOUR DIALOGUE AND DISCUSSION WITH THE CREW MEMBER NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 20 IT IS NOT ALLOWED TO ANALYSE THE PERFORMANCE OF A SPECIFIC CREW MEMBER NO INDIVIDUAL FEEDBACK PROVIDED:

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL How do you determine if feedback is effective? Safety culture indicators (ex. ASR/1000 sectors) increase Discussion during recurrent training or other sessions General Crew Surveys Monitoring of the group performance Trend analysis or analysis of a specific type of event How is feedback determined on an group basis? (open answer) NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 21

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL Acceptable or unacceptable?  Do you define circumstances where protection is removed for a pilot or crew? YES: 83% NO:17%  Do you explain to your pilots who draw the line between acceptable and unacceptable? YES: 81% NO:19%  Do you explain to your pilots what is considered unacceptable? YES: 92% NO:8% NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 22

EOFDM WG C THE FEEDBACK TO CREW/PERSONNEL How is the data protected?  Secure database/server/special arrangements with IT  Limited access (group limitation, password protected access)  Outsourced FDM program with various rights profiles depending on the role in the FDM group.  Flights are codified  Data Protection Acts NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 23 How is the data protected? (open answer)

EOFDM WG C24 USE OF FDM for TRAINING PURPOSES The survey  T HE W AY T RAINING IS PROVIDED  ATQP AND S IMULATOR E XERCISES  FDM AND R ECURRENT T RAINING  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C25 Do you provide data from your FDM programme to your training department? (main question) NO 8%YES 92% Do you provide statistical data? NO 2%YES 98% Do you use FDM data for event analysis for training? NO 16%YES 84% Do you provide replays (m.c.)? on request 64%individually: 33% group basis: 29% no: 18% USE OF FDM for TRAINING PURPOSES The Way Training is provided NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C26 USE OF FDM for TRAINING PURPOSES ATQP and Simulator Exercises NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU next slide

EOFDM WG C Correct landing techniques to prevent "long landing" or flat landings Stabilised and unstable approaches, go around Go around with two engine following some level bust events Training of special circle to land procedures, airport approaches with specific conditions Visual approaches or changes on route by ATC lead to unstable approaches FDM Results in simulator exercises – examples: USE OF FDM for TRAINING PURPOSES ATQP and Simulator Exercises NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU Approach to stalls, upset recovery, Severe wake turbulence encounter during cruise TCAS handling F OR A PPROACH AND L ANDING : 27

EOFDM WG C28 reports presentations briefing packages statistics/trends verbal briefings FDM incidents review NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU USE OF FDM for TRAINING PURPOSES FDM and Recurrent Training

EOFDM WG C29 FEEDBACK to FLIGHT OPERATIONS The survey  I NTERVAL AND T YPE OF R EPORT  FDM AND F UEL S AVING  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C 98% of the interviewed provides data from FDM programme to the Flight Operations Department. “over what interval?” FEEDBACK to FLIGHT OPERATIONS Interval and Type of Report NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 30

EOFDM WG C31 FDM & FLIGHT OPERATIONSYESNO Do you provide trending data?95,7%4,3% Do you provide event analysis?82,6%17,4% Is FDM data used to verify the events associated with an Air Safety Report? 95,6%4,4% FEEDBACK to FLIGHT OPERATIONS Interval and Type of Report NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C32 Is FDM data used to monitor fuel efficiency? accuracy of flight planning software Follow up on clean-up altitudes and use of air condition during take-off Remaining fuel planned fuel vs. fuel used FEEDBACK to FLIGHT OPERATIONS FDM and Fuel Saving NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C33 THE FEEDBACK TO OTHER AREAS The survey  F ATIGUE R ISK M ANAGEMENT S YSTEM  M AINTENANCE  A IR T RAFFIC C ONTROL  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C34 Do you use FDM data as part of a Fatigue Risk Management System? (main question) NO 69% YES 31% Do you correlate event trends/rates against fatigue reports? NO 20%YES 80% FEEDBACK to OTHER AREAS Fatigue Risk Management System NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C35 FDM and FRMSYESNO Do you merge FDM data to planned/flown roster for FDM purposes? 46,7%53,3% Do you monitor event rates against flight couplings? (Mirroring) 46,7%53,3% FEEDBACK to OTHER AREAS Fatigue Risk Management System NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C36 FDM & MAINTENANCEYESNO 1.Is FDM data used to investigate events for Maintenance purposes? (main question) 87,5%12,5% 1.1 Do you use FDM data for maintenance investigation? (e.g Structural limit exceedence, flaps, landing gear) 100%0% 1.2 Do you use FDM data to verify the maintenance status of any systems? (e.g. anti-icing, air conditioning etc) 45,2%54,8% 1.3 Do you use FDM data for engine condition monitoring? 64,3%35,7% FEEDBACK to OTHER AREAS Maintenance NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C37 FDM & ATCYESNO Do you share any ATM relevant FDM event with ANSP or NAA?41,7%58,3% Do you use FDM to monitor speed control compliance? (e.g taxi speed, approach speed) 95,8%4,2% Noise abatement procedures or SID compliance?50% Rushed approaches caused by ATC?58,3%41,7% FEEDBACK to OTHER AREAS Air Traffic Control NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

EOFDM WG C38 TOP MANAGEMENT REPORT The survey  T OP M ANAGEMENT R EPORT  V IEW ALL B ACK TO S URVEY M AIN M ENU

EOFDM WG C39 TOP MANAGEMENT REPORTS Do you provide FDM reports to the management/board level of your organisation? (main question) NO 12,5% YES 87,5% What format is used?What is the reporting frequency? NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU

TOP MANAGEMENT REPORTS NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU EOFDM WG C40

EOFDM WG C41 As this was an open question, the answers have been summarised as follow : TOP MANAGEMENT REPORTS How do you report and monitor adverse trends to your top management? (1/2) NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU 1.What is provided? (content included in the report)  Statistics  Trends of specific high risk events  In some cases FDM events included in KPIs 2. When is it provided?  Various intervals (monthly, quarterly, annually)  Immediately for high severity events or trends  In many cases management informed during SRB

EOFDM WG C42 TOP MANAGEMENT REPORTS How do you report and monitor adverse trends to your top management? (2/2) NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU As this was an open question, the answers have been summarised as follow : 3. In which form is it provided?  Verbally/personally  Information sent via  Specific written reports or presentations  Dashboards with real time information Various forms used:

EOFDM WG C43 Does the management usually act upon FDM reports ? NO 24,4% YES 75,6% TOP MANAGEMENT REPORTS NEXT SLIDE BACK TO MENU S URVEY M AIN M ENU  Some of the interviewed underline that no targets are defined  In several cases management ask for more details on specific parameters  Follow up is usually provided during specific meetings

EOFDM WG C44 Conclusions CONCLUSIONS NEXT SLIDE S URVEY M AIN M ENU  Due to the type of participants to the survey, results should be intended as a picture for FDM in passenger transport operators flying airplanes;  It is still preferred to keep FDM Activity in house;  No “magic” software available, issue of dedicated experienced resources still open;  FDM reports different in form and issuing timeframe;  The majority of companies has adopted a MoU  Individual feedback is largely used as well as individual performance monitoring;  FDM is commonly used for crew training purposes, the use in other activities (maintenance, crew planning) is still limited.

Thank you