1. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. System Performance and Convective Weather Kenneth Lamon, Ph.D. 15 March 2006 ©2006. All rights reserved. This is the copyright work of The MITRE Corporation and was produced for the U.S. Government under Contract Number DTFA01-01-C-00001 and is subject to Federal Aviation Administration Acquisition Management System Clause 3.5-13, Rights in Data-General, Alt. III and Alt. IV (Oct., 1996). No other use other than that granted to the U.S. Government, or to those acting on behalf of the U.S. Government, under that Clause is authorized without the express written permission of The MITRE Corporation. For further information, please contact The MITRE Corporation, Contracts Office, 7515 Colshire Drive, McLean, VA 22102, (703) 983-6000.

2. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 2 June, July and August are the Peak of the Convective Weather Season Source: NOAA, FSL; measures the average area of thunderstorms over the US at 19Z, 21Z, and 23Z, weekly average

3. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 3 Delays versus Scheduled Arrivals Delays = 500 + a*Weather*(Schedule- 16,500)

4. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 4 Minutes of Delay versus Scheduled Arrivals Minutes = 100,000 + b*Weather*(Schedule- 16,500)

5. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 5 An Airport-specific Convective Weather Metric Take an airport’s maximum storm intensity each hour Multiply by the number of scheduled arrivals that hour Sum over all hours of the day Sum over 45 airports (Divide by total number of scheduled arrivals)

6. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. Show Movies Here

7. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 7 ATL Delays Versus Weather Score

8. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 8

9. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 9 0 2000 4000 6000 8000 10000 12000 ABQ ATL BNA BOS BWI CLE CLT CVG DCA DEN DFW DTW EWR FLL HOU IAD IAH IND JFK LAS LGA MCI MCO MDW MEM MIA MSP MSY ORD PBI PDX PHL PHX PIT RDU SEA SLC STL TEB TPA 200406 200407 200408 YYYYMM Monthly Convective Weather Score by Major Airport

10. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 10 Number of Hours Having Thunderstorm Intensity>3 BROWN indicates locations where the frequency of thunderstorms increased from 2004 to 2005

11. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 11 SEA PDX TPA TEB STL SLC RDU PIT PHX PHL PBI ORD MSY MSP MIA MEM MDW MCO MCI LGA LAS JFK IND IAH IAD HOU FLL EWR DFW DEN DCA CVG CLT CLE BWI BOS BNA ATL ABQ - 2,000 4,000 6,000 8,000 10,000 12,000 14,000 16,000 -5,00010,00015,00020,000 Weather Score Delays (>1 Hour) DTW Delay and Convective Weather Score: June  August 2004

12. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 12 R-Squared Improves (a little) if Airports are Grouped

13. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 13 Delays Versus Weather Score: 45 Airports R 2 = 0.67 R 2 = 0.62 - 1,000 2,000 3,000 4,000 5,000 6,000 -1,0002,0003,0004,0005,0006,0007,0008,000 Weather*Schedule Delays (>1 Hour) 2003 2004

14. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 14 Regression Results 2003 and 2004 Delays = 507 + 1.8*Weather*(Schedule- 15,429) + 298*Year2004 R-squared = 0.65 Minutes = 106,000 + 174*Weather*(Schedule- 16,870) + 24,454*Year2004 R-squared = 0.67

15. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 15 Airborne Holds Versus Weather Score 2003 and 2004 45 Airports

16. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 16 Diversions Versus Weather Score 2003 and 2004 R 2 = 0.50 R 2 = 0.48 - 50 100 150 200 250 0100020003000400050006000700080009000 Weather*Schedule Diversions 2003 2004 45 Airports

17. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 17 Cancellations Versus Weather Score 2003 and 2004 45 Airports

18. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 18 Delays Versus Weather Score 2003, 2004, and 2005 45 Airports

19. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 19 Airborne Holding Up in Summer 2005 Year There were 28 additional holds per day in summer 2005 compared to 2004 45 Airports

20. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 20 Airborne Holding Up in Summer 2005 *June-August Year Holding was up sharply at ATL in summer 2005

21. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 21 Schedule Delays Lasting More Than One Hour Up 16% Compared to 2000 221,928 171,629 120,721 149,168 219,108 256,904 - 50,000 100,000 150,000 200,000 250,000 300,000 200020012002200320042005 Arrivals and Departures More than One Hour Late Relative to Schedule Source: ASPM, 45 Airports

22. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 22 Delays Due to GDPs Up in 2004 and 2005 Source: OPSNET, includes delays attributed to en route centers 0 10 20 30 40 50 60 70 80 90 200020012002200320042005 thousands GDP GS Departure OPSNET Delays by Type, 45 Airports, June-August

23. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 23 0 20 40 60 80 100 120 200020012002200320042005 thousands ATL, ORD, PHL, EWR, LGA, IAD, IAH, JFK 37 other airports Proportion of OPSNET Delays at the 8 Most Delayed Airports Has Grown Includes delays attributed to ARTCCs. Delays up 7% overall compared to 2000 Up 23% compared to 2000 Down 39% compared to 2000 OPSNET Delays, 45 Airports, June-August

24. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 24 0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 200020012002200320042005 millions ATL, ORD, PHL, EWR, LGA, IAD, IAH, JFK 37 other airports Operations, on Average, Up 9% at the 8 Most Delayed Hubs, and Down 9% Elsewhere Down 9% compared to 2000 Up 9% compared to 2000 Operations down 5% overall at OPSNET 45 airports compared to 2000 Operations June-August (OPSNET)

25. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 25 ATL Simulated Minutes of Arrival Delay Using Arrival Capacity from 8/7/05 - 10,000 20,000 30,000 40,000 50,000 60,000 115012001250 1300135014001450 Scheduled Arrivals Arrival Delay Minutes (Simulated) Aug 11 - 15, 2003 Aug 10, 2003 Aug 9, 2003 Schedule Dates 2003 Schedule Dates 2004 Aug 9 - 13, 2004 Aug 8, 2004 Aug 7, 2004 Aug 8 - 12, 2005 Aug 7, 2005 Schedule Dates 2005

26. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 26 Summary Introduced a convective weather metric defined as the product of an airport’s maximum hourly thunderstorm intensity and the number of flights scheduled to land that hour Metric has several advantages –Can be aggregated and disaggregated –Small, computationally simple dataset –Yields many insights about NAS performance

27. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 27 Other Findings Factoring out differences in weather and the total number of scheduled ops, hour-long delays increased substantially from 2003 to 2004 and from 2004 to 2005 –Increases caused by greater concentration of traffic at already delayed airports Airborne holding and diversions were unchanged from 2003 to 2004, however, holding increased from 2004 to 2005

28. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 28 And Lastly Similar approaches for measuring system performance based on delays, cancellations, diversions, holding, etc. ought to yield results similar to those presented here.

29. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. Appendix

30. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 30 Difference (Hours) Source: National Convective Weather Detection Number of Hours Having Thunderstorm Intensity>3 (June  August 2005 Minus June  August 2004)

31. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 31 OPSNET Delays by Type, 45 Airports, June-August OPSNET Delays Up 7% Compared to 2000 0 20 40 200020012002200320042005 145,919 138,312 94,087 92,543 127,111 136,715 60 80 100 120 140 160 thousands GS/GDP Arrival Departure Source: OPSNET, includes delays attributed to en route centers

32. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 32 Average Number of Seats per Departure has Decreased -8% -19% -15% -16% -1% -17% -10% 0 20 40 60 80 100 120 140 160 ATLEWRIADIAHLGAORDPHL Average Seats per Departure Jul-00 Jul-05 Average number of seats per scheduled departure down in July 2005 compared to July 2000 Source: OAG

33. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 33

34. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 34

35. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 35 Delays from GDPs: June  August 2005 In summer 2005 ATL accounted for 33% of all delays from GDPs The average duration of this type of delay was 74 minutes Source: OPSNET

36. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 36 PHL Simulated Minutes of Arrival Delay Using Arrival Capacity from 7/13/05 - 5,000 10,000 15,000 20,000 25,000 30,000 35,000 40,000 45,000 50,000 55,000 480 530580630680 730 Scheduled Arrivals Arrival Delay Minutes (Simulated) Jul 14 - 18, 2003 Jul 12, 2004 Schedule Dates 2003 Jul 12 - 16, 2004 Jul 11, 2004 Jul 10, 2004 Schedule Dates 2004 Jul 11 - 15, 2005 Jul 10, 2005 May 30, 2005 Schedule Dates 2005

37. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 37 PHL: Actual Minutes of Arrival Delay, June  August - 5,000 10,000 15,000 20,000 25,000 30,000 35,000 40,000 45,000 480530580630680730 Scheduled Arrivals Minutes of Arrival Delay (Actual) 2005 2004 2003 Actual Delay 2003 Actual Delay 2004 Actual Delay 2005 Source: ASPM, Each point represents one day, one outlier day excluded from 2003 and 2004

38. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 38 Ordered by busiest airport, includes delays attributed to en route centers OPSNET Delays for 22 Most Delayed Airports: June  August

39. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 39 ATL: Actual Minutes of Arrival Delay, June  August - 10,000 20,000 30,000 40,000 50,000 60,000 70,000 80,000 90,000 1150120012501300135014001450 Scheduled Arrivals Minutes of Arrival Delay (Actual) 2005 2004 2003 Source: ASPM, Each point represents one day, two outlier days excluded from 2003 and 2004 Actual Delay 2003 Actual Delay 2004 Actual Delay 2005

40. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 40 To Improve Airport Model Adding a variable representing amount of system- wide delay raises r-squared to 0.66 for ATL For ORD two-variable model has r-squared of 0.71

41. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 41 Three-Letter Airport Abbreviations ATL - Atlanta International MDW - Chicago Midway BOS - Boston/Logan International MEM - Memphis International BWI - Baltimore-Washington International MIA - Miami International CLE - Cleveland-Hopkins International MSP - Minneapolis St Paul International CVG - Covington/Cincinnati International MSY - New Orleans International DCA - Reagan National OAK - Metropolitan Oakland International DEN - Denver International ORD - Chicago O'Hare International DFW - Dallas-Ft Worth International PBI - Palm Beach International DTW - Detroit Metro Wayne Co PDX - Portland International EWR - Newark International PHL - Philadelphia International IAD - Washington Dulles International PHX - Phoenix Sky Harbor International IAH - Houston/G Bush Intercontinental PIT - Pittsburgh International IND - Indianapolis International RDU - Raleigh-Durham International JFK - John F Kennedy International SEA - Seattle Tacoma International LAS - Las Vegas/Mc Carran International SFO - San Francisco International LAX - Los Angeles International SJC - San Jose International LGA - La Guardia SLC - Salt Lake City International - STL - Lambert-St Louis International TEB - Teterboro ABQ - Albuquerque International Sunport BNA - Nashville International CLTCharlotte/Douglas Internationa MCIKansas City International MCO - Orlando International FLL- Fort Lauderdale/Hollywood International HOU - William P. Hobby Airport SAN - San Diego International TPA - Tampa International

42. F065-B06-007 © 2006 The MITRE Corporation. All rights reserved. 42 Glossary ASPMAviation System Performance Metrics FSLForecast Systems Laboratory GDPGround Delay Program NASNational Airspace System NOAANational Oceanic & Atmospheric Administration OAGOfficial Airline Guide OPSNETOperations Network USUnited States ZZulu Time