1. NAS Performance Metrics: Begin with the End in Mind Norm Fujisaki Metron Aviation AVIATION AND THE ENVIRONMENT: ISSUES & METHODS September 27-28, 2007 George Mason University First presented at NEXTOR NAS Performance Symposium Asilomar, September 2007

2. 2 Metrics Taxonomy Metrics Active Passive

3. 3 Metrics Space Accuracy Coverage, Data Ultimate Impact What is happening? How do we make things happen?

4. 4 Understanding Underlying Mechanisms InputOutput Service Provider Customers People Procedures Finances Technology Etc. People Procedures Finances Technology Etc. Must be willing to address complexity of stakeholder interests and behaviors

5. 5 Connecting Everybody’s Economics Airline Behaviors Pax Behaviors Fleet mix Schedules Fares Shop Buy Fly Pax Economics Airline Economics NAS Behaviors NAS Economics You folks in aviation are encouraging the inefficient consumption of valuable, limited resources. – Vernon Smith, 1 st NEXTOR Wye River Conf.

6. 6 Controllers and Throughput Behaviors Natural Interest in Higher Throughput Consequences of OEs Natural Interest in Not Working Too Hard Positive Incentives Output + + - - Need to address safety and efficiency – together. Consider adding incentives.

7. 7 Environmental Forces at Work Suppliers, Emitters Environmental Consequences Technology Public Policy Industry PR Politicians Public Perceptions & Behaviors Public Activism Market Economics Public Awareness Metrics Public perception and behaviors may be pivotal to our future

8. 8 Psychology of Change Behaviors Performance Outcomes Metrics Formulation of Change Actions Perception/ Interpretation of Metrics Taking Actions Motivation & Incentives People Metrics: could be much more than just measures

9. 9 Begin with the End in Mind  Think “active” metrics  Tackle complexity of stakeholder interests and motivations  Integrate metrics and everything else ultimately needed to achieve improved performance Close critical feedback loops; think “economic signaling.” Think “cash bar”; connect consumption and payment for consumption. Deliberately address safety, efficiency, environment -- together Reward desired behaviors; think “motivation” and “incentives” Include human perception, interpretation, action formulation, and action. Think “human element” and the psychology of metrics.