Presentation on theme: "A Glimpse at Archie: The LOSA Archive"— Presentation transcript:
1 A Glimpse at Archie: The LOSA Archive Ashleigh Merritt, Ph.D.The University of Texas Human Factors Research Project (UT)Third ICAO/IATA LOSA/TEM ConferenceSeptember 13-14, 2005, Kuala Lumpur
2 What is Archie? “Archie” is the LOSA Archive A database of de-identified airline data which is maintained and updated by UTAirlines that do a LOSA with The LOSA Collaborative contribute their data to Archie for research purposes
3 How big is Archie? As of October 2004, Archie had data from 15 airlines3,309 flights11,000+ threats7,000+ errors1,500+ undesired aircraft states
4 How old is Archie? Five LOSAs in five years to develop the methodology Data in the Archive starts in 2000Had to wait for Archie to grow before doing any industry-wide analyses.If we think of Archie as a dog, he would be a young bloodhound
5 How big is Archie? As of August 2005, Archie has data from 20 airlines (including 3 repeat LOSAs)4800 flights4800 flight narratives written by trained observers4800 ratings of TEM countermeasure performance17,500+ threats12,500+ errors2,400+ undesired aircraft states
6 Archie’s Attributes 2004 Archie is loyal and faithful Archie alerts of dangerArchie is a trackerArchie plays well with others
7 2005 Update on ArchieArchie has remained loyal and faithful to its aviation masterNo airline has been publicly identifiedNo individual pilots can be or ever have been identified
8 Archie continues to play well with others 2004Queries from / data-sharing with:NOSS (ATC group)IATA/ICAO (ITA)BoeingAirlinesASAPATSB2005
9 2005: Archie is learning to track Airline threatsATC threatsIntentional Noncompliance
10 Airline threats: Simple Tracking Airline threats include aircraft malfunctions, time pressure, errors/distractions/interruptions from Cabin, Dispatch, Maintenance, Ground, Ramp.Airline threats occur on 2/3 of all flights, adding to overall workload.Range: 55% - 81% across different airlinesThree-quarters of airline threats occur before the aircraft has even left the gate (predeparture).TARGETS FOR ENHANCEMENT?
11 ATC threat chains: Complex tracking 10 LOSAs – 2426 Flights – 9450 threats2350 ATC threats= ¼ of all threats= about 1 per flight236 mismanaged ATC threats= 30% of all mismanaged threats10% of all ATC threats were mismanaged
15 236 mismanaged ATC threats ¾ occurred during descent/approach/land ATC threats -> UAS2426 Flights – 9450 threatsLateral deviation %Speed too high %Vertical deviation %Unstable Approach %Continued Landing %Incorrect Automation configuration %Taxiway/runway incursion %Speed too low %Incorrect Aircraft configuration % Other %280 errors236 mismanaged ATC threats106 UASBottom line:4% of flights had a UAS arising from an ATC threat that was mismanaged.¾ occurred during descent/approach/land
16 Archie tracks intentional noncompliance Across 22 LOSAs, the average is 40% of flights have one or more noncompliance errorsRange: 23% of flights at one airline to 90% (!!) at anotherMost common noncompliance errors:checklist performed from memory / nonstandard checklist usefailure to cross-verify MCP/FCU altitude alerter changesPF makes own MCP/FCU changes
17 Noncompliance correlates with.. Based on 22 LOSAs (4800 flts), airlines that have more flights with intentional noncompliance errors also have more flights with:Mismanaged threats (r = .7)Mismanaged handling errors (r = .9)Undesired aircraft states (r = .9)Mismanaged UASs (r =.8)Archie was shocked…
18 Archie’s FutureArchie is maturing and getting smarter – more LOSAs allow for more analyses at the airline level, which is where the greatest differences are emerging.Soon a sub-Archive for regional airlinesArchie is getting involved in more industry projectsIf LOSA and ASAP overlap, then focusing on LOSA targets should reduce ASAP incidents…ATC is a big threat to pilots, are pilots a big threat to ATC?
19 Archie is recognizing his strength LOSA is a macro approach for Safety Management SystemsLOSA detects “gross” effects – strengths and weaknesses in the systemManagement uses the informationSelf-corrections, training, procedural changes, …If and when certain problems persist, micro approaches can investigate more closely…
20 The University of Texas Human Factors Research Project
Your consent to our cookies if you continue to use this website.