ICAO State Safety Programme (SSP) Implementation Course Module N° 5 – ALoS related to an SSP Revision N° 5 ICAO State Safety Programme (SSP) Implementation Course 25/02/10

SSP – A structured approach Module 2 Basic safety management concepts Module 3 ICAO SARPs related to safety management Module 4 ICAO SSP framework Module 5 ALoS related to an SSP Module 6 Prescription / Performance Module 8 SSP implementation plan Module 1 Introduction to the SSP implementation course Module 7 SSP training programme

Objective At the end of this module, participants will be able to describe the concepts and dimensions underlying the acceptable level of safety (ALoS) related to an SSP If you manage to survive the 5 or 6 slides you will be ok.

Contents Introductory concepts Acceptable level of safety (ALoS) ALoS related to an SSP Summary Questions and answers Points to remember

Introductory concepts The development and implementation of ALoS builds upon certain basic concepts of systems theory There is a hierarchy underlying the progression of these basic concepts towards the development and implementation of ALoS Understanding of the concepts and hierarchy is an essential foundation for the development and implementation of ALoS and the SSP ALoS has not to do much with safety in the traditional sense of safety but has much more relations with safety assurance

Introductory concepts – The basic theory Safety – as defined by Doc 9859 Level of safety – degree of safety of a system, representing the quality of the system, safety-wise, expressed through safety indicators Safety indicators – parameters that characterize and/or typify the level of safety of the system Value of safety indicators – quantification of a safety indicator Safety targets – concrete objectives to be achieved Value of safety targets – quantification of a safety target Acceptable level of safety – minimum degree of safety that must be assured by a system in actual practice

Introductory concepts – Selection of safety indicators The selection of appropriate safety indicators is an essential foundation for the development and implementation of ALoS The selection of safety indicators is a function of the detail to which the level of safety of the system is to be represented Meaningful safety indicators must be representative of the elements that characterise system safety

Introductory concepts – The basic theory: examples Safety indicators Fatal airline accidents/serious incidents Runway excursion events/ground collision events Development/absence of primary aviation legislation Development/absence of operating regulations Level of regulatory compliance … Safety targets Reduction in fatal airline accident/serious incidents Maintain the number in runway excursion events/ground collision events Improve the actual level of regulatory compliance

Introductory concepts – The basic theory: examples Value of safety indicators [Rate/number] Fatal airline accidents per [number] operations [Rate/number] Runway excursion events per [number] operations [Rate/number] Ground collision events per [number] operations [Number] inspections to operators completed [timeframe] ... Value of safety targets [Reduce / maintain by / maximum] fatal airline accidents per [number] operations [Reduce / maintain by / maximum] runway excursion events per [number] operations [Reduce / maintain by / maximum] ground collision events per [number] operations [Minimum number] of inspections completed [timeframe]…

Introductory concepts – A fundamental differentiation Safety measurement (strategic) Generally associated to the SSP Quantification of outcomes of selected high-level or high-consequence events Accident rates Serious incident rates Quantification of selected high-level State functions Development/absence of primary aviation legislation Development/absence of operating regulations Level of regulatory compliance A measure of achievement of high-level safety objectives of safety interventions and/or mitigations strategies How far are we from the

Introductory concepts – A fundamental differentiation Safety performance measurement (tactical) Generally associated to an SMS Quantification of the outcomes of selected low-level, low- consequence processes Number of FOD events per number of ramp operations Number of ground vehicle events in taxiways per number of airport operations … A measure of the actual performance of safety interventions and/or mitigation strategies, beyond accident rates and regulatory compliance

Introductory concepts – A fundamental differentiation Safety measurement Not a continuous process A spot check Conducted following pre-specified timeframes Safety performance measurement Continuous process Monitoring and measurement of selected operational activities necessary for the provision of services

Basic safety management SARPs The acceptable level of safety (ALoS) to be achieved shall be established by the State When establishing ALoS, consideration must be given to the level of safety risk that applies the safety risk tolerance the cost/benefits of improvements to the aviation system the public expectations in civil aviation system

Expressing the ALoS Values of safety indicators and values of safety targets Initial ALoS – Quantitative action statements on selected high level/high consequence outcomes (safety measurement) Mature ALoS – Quantitative action statements on selected high level/high consequence events (safety measurement) and low level/low consequence outcomes (safety performance measurement)

Values of safety indicators Values of safety targets Examples of values of safety indicators and safety targets based on safety measurement Values of safety indicators [Number] CFIT and approach & landing accidents per [number] departures [Number] runway excursions per [number] operations [Number] ground collision accidents per year on a [x-year] rolling average [Number] of high-severity events captured through the State MOR yearly [Number] inspections to operators completed quarterly [Number] AIS facilities with QMS implemented Electronic filing of differences completed within [number] months/weeks Values of safety targets [Reduce by/maximum] CFIT and approach & landing accidents per [number] departures [Reduce by/maximum] runway excursions per [number] operations [Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average [Minimum number] of high-severity events captured through the State MOR yearly [Minimum number] inspections to operators completed quarterly [Number] AIS facilities with QMS implemented by [time] Electronic filing of differences completed within [revised number] months/weeks

ALoS – Mature SSP In the longer-term, once States develop safety data collection and analysis capabilities under the Safety Assurance component of the SSP, ALoS should reflect a combination of safety measurement safety performance measurement

Examples of values of safety indicators and targets based on safety performance measurement [Number] level busts per [number] operations [Number] Cat B and C runway incursions in 5 international [State] airports per [number] operations [Number] TCAS/airprox events per [number] operations [Number] non-conforming approaches (NCA) at 5 international [State] airports per [number] operations [Number] apron FOD events at 5 international [State] airports per [number] operations Values of safety targets [Reduce by/maximum] number of level busts per [number] operations by [date] [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date] [Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date] [Reduce by/maximum] number of non- conforming approaches (NCA) at 5 international [State] airports by [date] [Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date]

Delivering ALoS – Safety action plans Tools and means to deliver the safety targets of an SSP Regulations Training Technology Technology Training Regulations

State Civil Aviation Authority Today State Civil Aviation Authority State Civil Aviation Authority Safety measurement Capture Storage Service providers Airport N° 1 Airport N° 2 Airport N° 3 SMS

State Safety Programme Initial ALoS State Safety Programme State Civil Aviation Authority Safety measurement Capture Storage Process Analysis Service providers Airport N° 1 Airport N° 2 Airport N° 3 SMS Initial ALoS

State Safety Programme Exchange of protected safety data Initial ALoS State Safety Programme State Civil Aviation Authority Protected safety data Capture Storage Process Analysis Service providers Airport N° 1 Airport N° 2 Airport N° 3 SMS Initial ALoS Exchange of protected safety data SDCPS

State Safety Programme Exchange of protected safety data Mature ALoS State Safety Programme State Civil Aviation Authority Protected safety data Capture Storage Process Analysis Service providers Airport N° 1 Airport N° 2 Airport N° 3 SMS Exchange of protected safety data Mature ALoS SDCPS

ALoS – Legal considerations Establishing ALoS related to an SSP does not replace legal, regulatory, or other already established requirements, but it must support compliance with them leaves unaffected the obligations of States, and does not relieve States from compliance with SARPs

ALoS – Initial (Safety measurement) Values of safety targets [Reduce by/maximum] CFIT and approach and landing accidents per [number] departures [Minimum number] inspections to operators completed quarterly ... Action plans CFIT training package distributed to industry and supported by training courses Revision and if necessary update of hiring policy. Inspection manual updated Values of safety indicators [Number] CFIT and approach and landing accidents per [number] departures [Number] inspection to operators completed quarterly State Shall comply with all applicable international standards

ALoS – Mature (Safety performance measurement) Values of safety targets [Reduce by/maximum] Unstabilized approaches (NCA) at 5 international airports per [number] arrivals by [date] [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date] … Action plans Continuous Descend Operations (CDO) procedures implemented – Arrival procedures charts designed for stabilized approaches Installation of ASDE/X in 5 international [State] airports …. Values of safety indicators [Number] non-conforming approaches (NCA) at 5 international airports [State] per [number] operations [Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations State Shall comply with all applicable international standards

Transition from initial to mature ALoS Initial ALoS (Safety measurement) Quantification of outcomes of selected high-level/high- consequence events Quantification of selected high-level State functions State safety assurance Safety oversight Safety data collection, analysis and exchange Safety data driven targeting of oversight on areas of greater concern or need Mature ALoS (Safety measurement and safety performance measurement) Quantification of outcomes of selected high-level/high-consequence events Quantification of selected high-level State functions Quantification of outcomes of selected low-level/low-consequence events Timeline

STATE Summary SSP (ALoS) Set of activities SMS ATS Service provider Aerodrome operator AMO Aircraft operator N° 1 SSP (ALoS) operator N° 2 Training organization SMS State accepts and oversees individual service providers’ SMS Safety performance State agrees and supervises individual service provider’s SMS safety performance

ALoS related to an SSP Questions and answers

Questions and answers Q: Explain the fundamental differentiation between safety measurement and safety performance measurement? A: ? Slide number:

Questions and answers Q: What are the tools and means to deliver the safety targets of an SSP? A: ? Slide number:

Points to remember The basic systems safety theory Safety measurement and safety performance measurement Initial and mature ALoS ALoS does not replace legal, regulatory, or other already established requirements

Module N° 5 ALoS related to an SSP