1. K Jones – ICAO FRMS Symposium 2011 Can Regulators be Confident that an FRMS Provides an Acceptable Level of Safety? ICAO FRMS Symposium 29-30 August 2011 Kathryn Jones UK CAA

2. K Jones – ICAO FRMS Symposium 2011 Short Answer YES

3. K Jones – ICAO FRMS Symposium 2011 Where does the Authority start?

4. K Jones – ICAO FRMS Symposium 2011 Development of Aviation 4

5. K Jones – ICAO FRMS Symposium 2011 5 Today

6. K Jones – ICAO FRMS Symposium 2011 FRMS in Operation Some of the details the Regulator needs to consider Aesthetics vs. Substance Performance Indicators When to say "No

7. K Jones – ICAO FRMS Symposium 2011 Aesthetics Management eye candy Flashy power points Overly detailed reporting forms Manual that feels familiar Perfect paperwork Waffle 7

8. K Jones – ICAO FRMS Symposium 2011 Substance Manual that feels relevant to the operator Balanced and appropriate communication Clear fatigue reporting process Reporting forms developed for the operation Assurance finding Access to all 8

9. K Jones – ICAO FRMS Symposium 2011 How to tell the difference Evaluate the processes by asking to be shown how the process works in operation Question to test understanding Uniform message from CEO to junior crewing officer Feedback system in place Assurance – findings tracked and closed Continuous improvement How we do business attitude In summary its the People that make the difference

10. K Jones – ICAO FRMS Symposium 2011 Performance Indicators These are not performance indicators for an FRMS! Performance indicators need to varied and take a total system approach 10

11. K Jones – ICAO FRMS Symposium 2011 These are Roster metrics (inc. use of Commander Discretion Fatigue Reporting Internal surveys / research 11 LOSA ASR MOR (models)

12. K Jones – ICAO FRMS Symposium 2011 When to Say No (or maybe not yet) As a State you are not ready Operator has already has compliance issues Lack of Senior Management commitment A limit too far 12

13. K Jones – ICAO FRMS Symposium 2011 13 Areas to consider which could lead to No (or not yet) Unbalanced use of statistics or science Lack of understanding of individuals involvement and how they will be treated Reverse engineering the result Lack of feedback Rushed implementation Unclear policy and commitment Lack of resources Dont pass the show me test

14. K Jones – ICAO FRMS Symposium 2011 Summary Need to identify the commitment to FRMS throughout the organisation to get beyond the aesthetic Performance indicators must be relevant and useful Not yet rather than No – The State needs to be ready first, and the Operator needs to demonstrate fatigue management before fatigue risk management

15. K Jones – ICAO FRMS Symposium 2011 Thank You kathryn.jones@caa.co.uk