Presented to: Pacific Aviation Directors’ Workshop By: Jim Spillane, Sr. FAA Representative, Pacific Rim Date: 3/14/2012 Transition to the USOAP Continuous Monitoring Approach (CMA)

Federal Aviation Administration Global Transition to USOAP CMA Transition to CMA Background on CMA –What is CMA –How USOAP Evolved to CMA –Benefits CMA Components –How it works –State Safety Risk Profile US Transition What States Can Do –What States Can Do –Challenges Role of Regional Offices and RSOOs

Federal Aviation Administration Global Transition to USOAP CMA What is CMA? CMA is the next evolution of the USOAP The objective of CMA is to promote global aviation safety through continuous monitoring of Member States’ safety oversight capabilities

Federal Aviation Administration Global Transition to USOAP CMA What is CMA? CMA provides a mechanism for ICAO: –To collect safety information from Member States and other stakeholders on a real time basis –To analyze the information using a risk-based approach to identify and prioritize appropriate activities to be carried out by ICAO

Federal Aviation Administration Global Transition to USOAP CMA How USOAP Evolved to CMA Mandatory Audit Programme (USOAP) A – Audits, 162 Follow- ups Annexes 1, 6, 8 (Annex-by- Annex Approach) Mandatory Audit Programme (USOAP) A – Audits, 162 Follow- ups Annexes 1, 6, 8 (Annex-by- Annex Approach) 35 th Assembly 2004 Comprehensive Systems Approach (CSA) 2005 – Audits Safety-related provisions in all Annexes Comprehensive Systems Approach (CSA) 2005 – Audits Safety-related provisions in all Annexes 36 th Assembly 2007 Development of Continuous Monitoring Approach (CMA) beyond 2010 A36-4 Development of Continuous Monitoring Approach (CMA) beyond 2010 A th Assembly 2010 CMA A37-5 Evolution of CMA as top priority 2-year transition Full CMA launch 2013

Federal Aviation Administration Global Transition to USOAP CMA Benefits Collective sharing of safety data Continuous monitoring of capabilities and performance- “real time” Proactive approach to safety- better analysis More efficient- less labor and resource intensive

Federal Aviation Administration Global Transition to USOAP CMA CMA Audit Areas CMA Core Audit Areas Legislation and Regulations Chicago Convention Aircraft Operations Annexes 6, 18 & PANS-OPS Airworthiness of Aircraft Annexes 6, 7, 8, & 16 Personnel Licensing Annex 1 Accident & Incident Investigation Annex 13 Organization & Safety Oversight Functions SAAQ Air Navigation System Annexes 2,3,4,5 10,11,12,15 & PANS-ATM Aerodromes Annex 14

Federal Aviation Administration Global Transition to USOAP CMA CMA Components Collection of safety information Determination of State’s safety risk profile Update of Lack of effective implementation (LEI) and status of SSCs Prioritization and conduct of USOAP CMA activities

Federal Aviation Administration Global Transition to USOAP CMA How it Works Through an online framework States will provide information through: -State Aviation Activity Questionnaires (SAAQs) -Updating the Compliance Checklists and Electronic Filing of Differences (EFOD) -Updating USOAP Protocol Questions (PQs) -Updating Corrective Action Plans (CAPS) Collection of safety information

Federal Aviation Administration Global Transition to USOAP CMA How it Works External Stakeholders that have audit programs, audit activities, or generate safety data or information will provide input to ICAO External Stakeholders include: –European Aviation Safety Agency (EASA) –EUROCONTROL –International Air Transport Association (IATA) –Regional Aviation Safety Oversight Organization (RSOOs) Formal agreements must be in place with ICAO Collection of safety information

Federal Aviation Administration Global Transition to USOAP CMA How it Works ICAO analyzes all of the data to determine safety risk indicators and management capabilities Safety Risk Indicators –Lack of effective implementation of standards (LEI) –Existence of Significant Safety Concerns (SSC) –Level of aviation activities for each audit area –Level of acceptability and progress of implementing CAPs –Ongoing or planned assistance projects –Progress in implementing a Safety Management System (SMS) and a State Safety Program (SSP) Collection of safey information Determination of State’s safety risk profile

Federal Aviation Administration Global Transition to USOAP CMA How it Works Based on a States’ safety risk profile, ICAO will prioritize and conduct CMA activities CMA Activities include: -Comprehensive Systems Approach (CSA) audit -Customized safety audit based on specific findings -ICAO Coordinated Validation Mission (ICVM) to ensure that all data and Finding and Recommendations are addressed Collection of safey information Prioritization and conduct of USOAP CMA activities

Federal Aviation Administration Global Transition to USOAP CMA How it Works After ICAO conducts CMA activities they will update the LEI and status of SSCs Information will be collected through: -Mandatory Information Requests (MIRs) -Findings and Recommendations -Significant Safety Concerns -Corrective Actions Plans Update of Lack of effective implementation (LEI) and status of SSCs

Federal Aviation Administration Global Transition to USOAP CMA Overview of State Roles in CMA Manages the States’ continuous monitoring program Submits and regularly updates relevant CMA reporting documentation (SAAQs, EFODs, Compliance Checklists, CMA Protocols, SSP etc.). Implements corrective and mitigation actions in a timely manner to address safety deficiencies, and Participates actively in the CMA process.

Federal Aviation Administration Global Transition to USOAP CMA CMA Stakeholders ICAO –Technical Cooperation Bureau –Regional Offices –Secretariat Bureaus External –International Organizations (IATA, EASA…) –Regional Aviation Safety Groups and Oversight Organizations Information sharing is key! –U.S., ICAO, EC, IATA signed a data sharing agreement at the 37 th Assembly.

Federal Aviation Administration Global Transition to USOAP CMA What States can do States obligation for CMA transition: –Nominate a National Continuous Monitoring Coordinator – Sign CMA MOU –Update Corrective Action Plans –Update State Aviation Activity Questionnaire –Validate differences already sent to ICAO under the CSA

Federal Aviation Administration Global Transition to USOAP CMA Challenges for States The initial validation of differences sent to ICAO can be very time consuming, especially for States that have not continuously filed differences States no longer just file differences but now must submit how they comply with a standard. This may require a new business process It may take some time to become familiar with the online framework. ICAO has step by step instructions ICAO Regional Offices and Regional Safety Oversight Organizations will have a greater role in validating State submitted data. This may require new business processes but can also provide greater assistance to States. States must remain vigilant in keeping online framework current. If States fall behind it may trigger an ICAO audit.

Federal Aviation Administration Global Transition to USOAP CMA Roles of RSOOs in CMA RSOOs can develop collaborative networks RSOOs can play an important role assisting States RSOOs can help in establishing mandatory and voluntary incident reporting systems RSOOs can facilitate the efficient collection, storage, analysis and exchange of safety data and information.

Federal Aviation Administration Global Transition to USOAP CMA United States-Transition to CMA Support for CMA Transition Conclusions

Federal Aviation Administration Global Transition to USOAP CMA Support for CMA The United States recognizes that Member States’ sustained support for the transition to CMA is key to moving USOAP to a more efficient and resourceful approach. The United States strongly supported the transition to CMA at: –CMA Work Groups and Council meetings –ICAO High Level Safety Conference –ICAO 37 th Assembly

Federal Aviation Administration Global Transition to USOAP CMA 2012 Transition Global Issues Team briefing LOB’s Feb 2012 ICAO Tools training March 2012 Compliance Checklist and CAPs updated by July Ready for transition December

Federal Aviation Administration Global Transition to USOAP CMA US Conclusions on CMA The United States is supportive of CMA Transition to CMA requires extensive updating and validating Notification of Compliance requires additional time and procedures The SSP is the regulatory foundation that CMA is built upon Information sharing is key

Federal Aviation Administration Global Transition to USOAP CMA 2012 Questions? 23

Federal Aviation Administration Global Transition to USOAP CMA Transition Timeline for States 2011 Update CAP Update SAAQ Sign CMA Agreement CMA/EFOD Training 2011 Update CAP Update SAAQ Sign CMA Agreement CMA/EFOD Training 2012 Update CAP Update SAAQ Audit protocols 2012 Update CAP Update SAAQ Audit protocols 2013 Update CAP Update SAAQ Audit protocols 2013 Update CAP Update SAAQ Audit protocols

Federal Aviation Administration Global Transition to USOAP CMA Actions for Transition Sign Memorandum of Understanding with ICAO –MOU is currently under going approval at the ICAO Council Identify a National Continuous Monitoring Coordinator Update and Validate –State Aviation Activity Questionnaire (SAAQ) –Differences –Corrective Action Plans

Federal Aviation Administration Global Transition to USOAP CMA Tools of CMA State Aviation Activity Questionnaire Electronic Filing of Differences Corrective Action Plans State Safety Program (SSP)

Federal Aviation Administration Global Transition to USOAP CMA Update and Validate SAAQ –Updated on a regular basis Differences –Differences are updated by response to State Letters with every amendment –Validating our differences in the EFOD database –Currently reviewing our compliance and differences with over 10,000 filed SARPS Corrective Action Plans –Continuously reviewed and updated

Federal Aviation Administration Global Transition to USOAP CMA Electronic Filing of Differences No longer just filing “differences”, now must also file compliance USOAP CSA USOAP CMA Level of Implementation Text of Difference Comments If difference exists than cite regulation Level of Implementation Text of Difference Comments Cite regulation of compliance or difference

Federal Aviation Administration Global Transition to USOAP CMA United States is updating “compliance” During update and validation of EFOD we found 1,000s of SARPS that need to be notified to ICAO Assumed that with responses to State Letters and updating EFOD that ICAO had validated all differences United States is now validating all differences filed with ICAO EFOD

Federal Aviation Administration Global Transition to USOAP CMA EFOD Reports on Difference to be Notified to ICAO

Federal Aviation Administration Global Transition to USOAP CMA Corrective Action Plans The United States continuously updates the corrective action plans –Now found in the ICAO iSTARS If filing a new difference, the U.S. submits information on intent to comply, status of rulemaking, and timeframe of compliance

Federal Aviation Administration Global Transition to USOAP CMA State Safety Program United States has a mature SSP through policies, procedures and regulations –FAA Orders , , VS , , , , , , –AC A, AC 150/ , –Notice of Proposed Rulemaking Dockets , Currently formatting to comply with the ICAO framework for an SSP