1. Module N° 5 – State ALoS

2. SSP – A structured approach Module 2 Basic safety management concepts Module 2 Basic safety management concepts Module 3 ICAO SARPs related to safety management Module 3 ICAO SARPs related to safety management Module 4 ICAO SSP framework Module 4 ICAO SSP framework Module 5 State ALoS Module 5 State ALoS Module 6 Prescription / Performance based environment Module 6 Prescription / Performance based environment Module 8 SSP familiarization plan Module 8 SSP familiarization plan Module 1 Introduction to the SSP familiarization course Module 7 SSP training programme Module 7 SSP training programme Module 5 State ALoS Module 5 State ALoS

3. At the end of this module, participants will be familiar with the concepts and dimensions underlying the acceptable level of safety (ALoS) related to an SSP Objective

4. Introductory concepts Acceptable level of safety (ALoS) ALoS related to an SSP Summary Questions Contents

5. The development and implementation of ALoS builds upon certain basic concepts of systems theory There is a hierarchy underlying the progression of these basic concepts towards the development and implementation of ALoS Understanding of the concepts and hierarchy is an essential foundation for the development and implementation of ALoS and the SSP Introductory concepts

6. 1. Safety – as defined by Doc 9859 2. Level of safety – degree of safety of a system, representing the quality of the system, safety-wise, expressed through safety indicators 3. Safety indicators – parameters that characterize and/or typify the level of safety of the system 4. Safety targets – concrete objectives to be achieved 5. Acceptable level of safety – minimum degree of safety that must be assured by a system in actual practice 6. Value of a safety indicator – quantification of a safety indicator 7. Value of a safety target – quantification of a safety target Introductory concepts – The basic theory

7. The selection of appropriate safety indicators is an essential foundation for the development and implementation of ALoS The selection of safety indicators is a function of the detail to which the level of safety of the system is to be represented Meaningful safety indicators must be representative of the elements that characterise system safety Accidents/accident rates Incidents/incident rates Level of regulatory compliance … Introductory concepts – Selection of safety indicators

8. Safety indicators Fatal airline accidents/serious incidents Runway excursion events/ground collision events Development/absence of primary aviation legislation Development/absence of operating regulations Level of regulatory compliance … Safety targets Reduction in fatal airline accident/serious incidents Reduction in runway excursion events/ground collision events Number of inspections completed quarterly … Introductory concepts – The basic theory: examples

9. Value of safety indicators 1. [Rate/number] Fatal airline accidents per [number] operations 2. [Rate/number] Runway excursion events per [number] operations 3. [Rate/number] Ground collision events per [number] operations 4. [Number] inspections to operators completed [timeframe]... Value of safety targets 1. [Reduction by/maximum] fatal airline accidents per [number] operations 2. [Reduction by/maximum] runway excursion events per [number] operations 3. [Reduction by /maximum] ground collision events per [number] operations 4. [Minimum number] of inspections completed [timeframe] …

10. Safety measurement Generally associated to the SSP Quantification of outcomes of selected high-level or high- consequence events Accident rates Serious incident rates Quantification of selected high-level State functions Development/absence of primary aviation legislation Development/absence of operating regulations Level of regulatory compliance A measure of achievement of high-level safety objectives of safety interventions and/or mitigations strategies Introductory concepts – A fundamental differentiation

11. Safety performance measurement Generally associated to an SMS Quantification of the outcomes of selected low-level, low- consequence processes Number of FOD events per number of ramp operations Number of ground vehicle events in taxiways per number of airport operations … A measure of the actual performance of safety interventions and/or mitigation strategies, beyond accident rates and regulatory compliance Introductory concepts – A fundamental differentiation

12. Safety measurement Not a continuous process A spot check Conducted following pre-specified timeframes Safety performance measurement Continuous process Monitoring and measurement of selected operational activities necessary for the provision of services Introductory concepts – A fundamental differentiation

13. The acceptable level of safety (ALoS) to be achieved shall be established by the State When establishing ALoS, consideration must be given to The level of safety risk that applies The safety risk tolerance The cost/benefits of improvements to the aviation system The public expectations in civil aviation system Basic safety management SARPs

14. Values of safety indicators and values of safety targets Initial ALoS – Quantitative action statements on selected high level/high consequence outcomes (safety measurement) Mature ALoS – Quantitative action statements on selected high level/high consequence events (safety measurement) and low level/low consequence outcomes (safety performance measurement) Expressing the ALoS

15. Examples of values of safety indicators and safety targets based on safety measurement Values of safety indicators 1. [Number] CFIT and approach & landing accidents per [number ] departures 2. [Number] runway excursions per [number ] operations 3. [Number] ground collision accidents per year on a [x-year] rolling average 4.[ Number] of high-severity events captured through the State MOR yearly 5. [Number] inspections to operators completed quarterly 6.[ Number] AIS facilities with QMS implemented 7.Electronic filing of differences completed within [number] months/weeks Values of safety indicators 1. [Number] CFIT and approach & landing accidents per [number ] departures 2. [Number] runway excursions per [number ] operations 3. [Number] ground collision accidents per year on a [x-year] rolling average 4.[ Number] of high-severity events captured through the State MOR yearly 5. [Number] inspections to operators completed quarterly 6.[ Number] AIS facilities with QMS implemented 7.Electronic filing of differences completed within [number] months/weeks Values of safety targets 1.[ Reduce by/maximum] CFIT and approach & landing accidents per [number] departures 2. [Reduce by/maximum] runway excursions per [number] operations 3. [Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average 4. [Minimum number] of high-severity events captured through the State MOR yearly 5. [Minimum number] inspections to operators completed quarterly 6.[ Number] AIS facilities with QMS implemented by [time] 7.Electronic filing of differences completed within [revised number] months/weeks Values of safety targets 1.[ Reduce by/maximum] CFIT and approach & landing accidents per [number] departures 2. [Reduce by/maximum] runway excursions per [number] operations 3. [Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average 4. [Minimum number] of high-severity events captured through the State MOR yearly 5. [Minimum number] inspections to operators completed quarterly 6.[ Number] AIS facilities with QMS implemented by [time] 7.Electronic filing of differences completed within [revised number] months/weeks

16. Tools and means to deliver the safety targets of an SSP Operational procedures Technology Systems Training programmes Delivering ALoS – Safety action plans

17. In the longer-term, once States develop safety data collection and analysis capabilities under the Safety Assurance component of the SSP, ALoS should reflect a combination of safety measurement safety performance measurement ALoS – Mature SSP

18. Examples of values of safety indicators and targets based on safety performance measurement Values of safety targets 1. [Reduce by/maximum] number of level busts per [number] operations by [date] 2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date] 3. [Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date] 4. [Reduce by/maximum] number of non- conforming approaches (NCA) at 5 international [State] airports by [date] 5. [Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date] Values of safety targets 1. [Reduce by/maximum] number of level busts per [number] operations by [date] 2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date] 3. [Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date] 4. [Reduce by/maximum] number of non- conforming approaches (NCA) at 5 international [State] airports by [date] 5. [Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date] Values of safety indicators 1.[Number] level busts per [number] operations 2.[Number] Cat B and C runway incursions in 5 international [State] airports per [number] operations 3.[Number] TCAS/airprox events per [number] operations 4.[Number] non-conforming approaches (NCA) at 5 international [State] airports per [number] operations 5.[Number] apron FOD events at 5 international [State] airports per [number] operations Values of safety indicators 1.[Number] level busts per [number] operations 2.[Number] Cat B and C runway incursions in 5 international [State] airports per [number] operations 3.[Number] TCAS/airprox events per [number] operations 4.[Number] non-conforming approaches (NCA) at 5 international [State] airports per [number] operations 5.[Number] apron FOD events at 5 international [State] airports per [number] operations

19. Establishing ALoS related to an SSP does not replace legal, regulatory, or other already established requirements, but it must support compliance with them leaves unaffected the obligations of States, and does not relieve States from compliance with SARPs ALoS – Legal considerations

20. ALoS – Initial (Safety measurement) Values of safety targets 1. [Reduce by/maximum] CFIT and approach and landing accidents per [number] departures 2. [Minimum number] inspections to operators completed quarterly 3.... 1. [Reduce by/maximum] CFIT and approach and landing accidents per [number] departures 2. [Minimum number] inspections to operators completed quarterly 3.... Action plans Action plans 1.CFIT training package distributed to industry and supported by training courses 2.Revision and if necessary update of hiring policy. Inspection manual updated 3.... 1.CFIT training package distributed to industry and supported by training courses 2.Revision and if necessary update of hiring policy. Inspection manual updated 3.... Values of safety indicators 1. [Number] CFIT and approach and landing accidents per [number] departures 2. [Number] inspection to operators completed quarterly 3.... 1. [Number] CFIT and approach and landing accidents per [number] departures 2. [Number] inspection to operators completed quarterly 3.... State Will comply all applicable international standards.

21. ALoS – Mature (Safety performance measurement) Values of safety targets 1. [Reduce by/maximum] non-conforming approaches (NCA) at 5 international airports per [number] arrivals by [date] 2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date] 3.… 1. [Reduce by/maximum] non-conforming approaches (NCA) at 5 international airports per [number] arrivals by [date] 2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date] 3.… Action plans Action plans 1.Constant Descend Arrivals (CDA) procedures implemented – Arrival procedures charts designed for stabilized approaches 2.Installation of ASDE/X in 5 international [State] airports 3.…. 1.Constant Descend Arrivals (CDA) procedures implemented – Arrival procedures charts designed for stabilized approaches 2.Installation of ASDE/X in 5 international [State] airports 3.…. Values of safety indicators 1. [Number] non-conforming approaches (NCA) at 5 international airports [State] per [ number] operations 2. [Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations 3.… 1. [Number] non-conforming approaches (NCA) at 5 international airports [State] per [ number] operations 2. [Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations 3.… State Will comply all applicable international standards.

22. Transition from initial to mature ALoS Initial ALoS (Safety measurement) Quantification of outcomes of selected high-level/high- consequence events Quantification of selected high-level State functions State safety assurance Safety oversight Safety data collection, analysis and exchange Safety data driven targeting of oversight on areas of greater concern or need Mature ALoS (Safety measurement and safety performance measurement) Quantification of outcomes of selected high-level/high- consequence events Quantification of selected high-level State functions Quantification of outcomes of selected low-level/low- consequence events Timeline

23. Summary Set of activities ATS Service provider Aerodrome operator AMO Aircraft operator N ° 1 SSP (ALoS) SSP (ALoS) ATS Service provider Aerodrome operator AMO Aircraft operator N ° 2 Training organization SMS State accepts and oversees individual service providers SMS Safety performance State accepts and oversees individual service providers SMS State agrees and supervises individual service providers SMS safety performance Safety performance Training organization SMS

24. Questions? State acceptable level of safety (ALoS)

25. Module N° 5 – State ALoS