Complex Adaptive System of Systems (CASoS) Engineering Sandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation,

Slides:



Advertisements
Similar presentations
Community-Based Research Workshop Series CBR 206 Writing Effective Letters of Intent.
Advertisements

Designing Effective Action for Change
A 2030 framework for climate and energy policies Marten Westrup
Chapter 5 Transfer of Training
NIMS ICS All-Hazard Position Specific Training – A Way Forward A Special Presentation for the All Hazards IMT Conference Houston, Texas November 4.
international strategic management
Surveillance in a Pandemic: Situational Awareness
Chapter 6 Flowcharting.
ITRS Roadmap Design + System Drivers Makuhari, December 2007 Worldwide Design ITWG Good morning. Here we present the work that the ITRS Design TWG has.
The New Economy in Indianapolis The New Economy in Indianapolis Rob Atkinson Vice President and Director, Technology and New Economy Project Progressive.
The University of Texas at El Paso Building a National Reputation By Successfully Serving its Region The University of Texas at El Paso Building a National.
TABLE OF CONTENTS CHAPTER 1.0: Trends in the Overall Health Care Market Chart 1.1: Total National Health Expenditures, 1980 – 2010 Chart 1.2: Percent.
1 Assessing Health Needs Gilbert Burnham, MD, PhD Johns Hopkins University.
Technologys Role in Emergency Management 24 February 2012.
1. 2 Why are Result & Impact Indicators Needed? To better understand the positive/negative results of EC aid. The main questions are: 1.What change is.
Jan Rutkowski World Bank Sarajevo October
DSHS Immunization Activities to Raise Texas Vaccine Coverage Levels Jack Sims, Manager Immunization Branch September 19, 2006.
Mini-Grant Application: Quality Improvement in the Area of Immunizations Catherine Shoults, M.P.H., Kansas Health Institute Kansas Public Health Conference.
Leading for High Performance. PKR, Inc., for Cedar Rapids 10/04 2 Everythings Up-to-Date in Cedar Rapids! Working at classroom, building, and district.
National Academy of Engineering of the National Academies 1 Phase II: Educating the 2020 Engineer Phase II: Adapting Engineering Education to the New Century...
Bridging the Gap between Research and Policymaking in India Seminar, Delhi, 3 rd January 2004 Definitions Research: any systematic effort to increase the.
The H1N1 Influenza Pandemic Kentucky Optometric Association September 8, 2009 Kraig E. Humbaugh, M.D., M.P.H. Kentucky Department for Public Health.
March 2012 Ports and Cities Conference Newcastle Dorte Ekelund, Executive Director Major Cities Unit Department of Infrastructure and Transport
Understanding Multiyear Estimates from the American Community Survey Updated February 2013.
1 Understanding Multiyear Estimates from the American Community Survey.
1 Medicare Part D Implementation North Dakotas Efforts.
Engagement in Human Research & Multi-Site Studies K. Lynn Cates, M.D. Assistant Chief Research & Development Officer Director, PRIDE May 30, 2012.
Privacy Impact Assessment Future Directions TRICARE Management Activity HEALTH AFFAIRS 2009 Data Protection Seminar TMA Privacy Office.
1 Evaluating a Complex System of Systems Using State Modeling and Simulation National Defense Industrial Association Systems Engineering Conference San.
1 The OneGeology project IC GS Ian Jackson, February 2007.
The Federal Reserve System Chapter 14 Copyright © 2010 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
1 Quality Indicators for Device Demonstrations April 21, 2009 Lisa Kosh Diana Carl.
MARKETING INFORMATION AND RESEARCH
EU Market Situation for Eggs and Poultry Management Committee 21 June 2012.
1. 2 August Recommendation 9.1 of the Strategic Information Technology Advisory Committee (SITAC) report initiated the effort to create an Administrative.
Wrangling with Uncertainty in Complex Adaptive Systems of Systems (CASoS) Engineering Robert Glass with Arlo Ames, Walter Beyeler, and many others Sandia.
WHERE TRANSPORTATION IS GOING: Transportation in the CLIOS System Era
Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,
Complex Adaptive Systems of Systems Engineering (CASoSE) Robert Glass, John M. Linebarger, Arlo Ames, Theresa Brown, Walt Beyeler and many others Sandia.
Complex Adaptive System of Systems (CASoS) Engineering Initiative Sandia National Laboratories is a multi-program.
Reform and Innovation in Higher Education
VOORBLAD.
Research Department 1 Global Economic Crisis and the Israeli Economy Herzliya conference Dr. Karnit Flug Research Director, Bank of Israel February 2009.
2014 National Patient Safety Goals
Scale Free Networks.
Directions for this Template  Use the Slide Master to make universal changes to the presentation, including inserting your organization’s logo –“View”
Dave Chaffey, E-Business and E-Commerce Management, 4 th Edition, © Marketing Insights Limited 2009 Slide 1.1 Introduction to e-business and e-commerce.
Asthma in Minnesota Slide Set Asthma Program Minnesota Department of Health January 2013.
Global Analysis and Distributed Systems Software Architecture Lecture # 5-6.
MANAGEMENT RICHARD L. DAFT.
World Wide Web: Empowering All People Steve Bratt Chief Executive Officer World Wide Web Consortium (
EPT PREVENT Emerging Pandemic Threats - PREVENT AED, Global Viral Forecasting Initiative & Local partners.
1 Tracking Innovation in NC Patterns and Implications for NC's Eastern Region John Hardin, Executive Director NC Board of Science & Technology
1 ‘School Closing’ as a Potential Means to Counter Pandemic Influenza Table Top Exercise (TTX)
1 Phase III: Planning Action Developing Improvement Plans.
Principles of Marketing
U.S. Energy Information Administration Independent Statistics & Analysis Controlled Unclassified Information FCSM Conference Jacob Bournazian,
To Create and Sustain a Career Pathway. CTE Works! Summit November 13, 2014.
Weekly Attendance by Class w/e 6 th September 2013.
President’s Interfaith and Community Service Campus Challenge Webinar Co-sponsored by The White House, the Department of Education, the Corporation for.
DATA TRACKING AND EVALUATION 1. Goal of the STEP program: To increase the number of STEM graduates within the five-year period of the grant. You have.
1 What Counts: Measuring the Benefits of Early Intervention in Hawai’i Beppie Shapiro Teresa Vast Center for Disability Studies University of Hawai`i With.
Modeling Critical Infrastructures with Networked Agent-based Approaches Robert J Glass & Walter E Beyeler & colleagues Advanced Methods and Techniques.
Pandemic Influenza and Complex Adaptive System of Systems (CASoS) Engineering Robert J. Glass CASoS Engineering Sandia National Laboratories Twenty-seventh.
Designing Solutions in an Interdependent World: CASoS Engineering Robert J Glass Complex Adaptive Infrastructures and Behavioral Systems National Infrastructure.
EpiFast: A Fast Algorithm for Large Scale Realistic Epidemic Simulations on Distributed Memory Systems Keith R. Bisset, Jiangzhuo Chen, Xizhou Feng, V.S.
Sandia National Laboratories NISAC’s core partners are Sandia National Laboratories and Los Alamos National Laboratory. Sandia is a multiprogram laboratory.
Modeling and Simulation of Critical Infrastructure Interdependencies H.S. Jason Min, Walter Beyeler, and Theresa Brown Sandia National Laboratories Critical.
Presentation transcript:

Complex Adaptive System of Systems (CASoS) Engineering Sandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin Corporation, for the U.S. Department of Energys National Nuclear Security Administration under contract DE-AC04-94AL Complex Adaptive System of Systems (CASoS) Engineering Initiative Designing Influence in Complex Adaptive Systems of Systems: CASoS Engineering Robert J Glass Senior Scientist, Sandia National Laboratories and William J Perry Fellow in International Security Stanford University University of Vermont March 23, 2012 SAND P Slides selected from keynote presentation for: Association for Public Policy Analysis & Management (APPAM) 33rd Fall Research Conference, Washington, DC, November 2011 and other material available at: Association for Public Policy Analysis & Management (APPAM) 33rd Fall Research Conferencehttp://

Complex Adaptive System of Systems (CASoS) Engineering National Infrastructure Simulation and Analysis Center (NISAC) Established by the national laboratories in 2000, NISAC was incorporated into the USA Patriot Act of 2001 and became part of DHS upon its inception in May Congress mandated that NISAC serve as a source of national expertise to address critical infrastructure protection research and analysis. Infrastructures are the systems that provide the things we take for granted. 2

Complex Adaptive System of Systems (CASoS) Engineering EMERGENT STRUCTURE: Complex Region A NETWORKS within NETWORKS 3

Complex Adaptive System of Systems (CASoS) Engineering log(Size) log(Frequency) Big events are not rare in such systems EMERGENT BEHAVIOR: Complex Earthquakes: Guthenburg-Richter Wars, Extinctions, Forest fires Power Blackouts Telecom outages Traffic jams Market crashes … ??? heavy tail region normal Power law Cascades with power-laws & heavy tails 4

Complex Adaptive System of Systems (CASoS) Engineering Critical Infrastructures: Are Complex: composed of many parts whose interaction via local rules yields emergent structure (networks) and behavior (cascades) at larger scales Grow and adapt in response to local-to-global policy Contain people Are interdependent systems of systems Critical infrastructures are - Complex Adaptive Systems of Systems: CASoS 2002: Advanced Methods and Techniques Investigations (AMTI) 5

Complex Adaptive System of Systems (CASoS) Engineering Many Examples of CASoS Tropical Rain forest Agro-Eco system Cities, Megacities and Interdependent infrastructure (local to regional to national to global) Government and political systems, educational systems, health care systems, financial systems, economic systems and their supply networks (local to regional to national to global)… Global Energy System and Green House Gasses 6

Complex Adaptive System of Systems (CASoS) Engineering A Defining Example: The Pandemic Story Chickens being burned in Hanoi DHS asked NISAC to put together a briefing package to prepare DHS Sec Chertoff for a White House table top exercise the second week of December. On Halloween (2005) NISAC got a call from DHS. Public health officials worldwide were afraid that the H5NI avian flu virus would jump species and become a pandemic like the one in 1918 that killed 50M people worldwide. Pandemic NOW. No Vaccine, No antiviral. 7 Glass, R.J., Pandemic Influenza and Complex Adaptive System of Systems (CASoS) Engineering, International System Dynamics Conference, July, [

Complex Adaptive System of Systems (CASoS) Engineering Our CASoS Applications in NISAC at the time We were applying a generic CASoS approach to power grids, to the movement of funds from bank to bank within the FEDs Fedwire system (2+$T a day) and between the ECBs Target system and Fedwire, to the contagious transfer of ideas and action in settings of civil disobedience… In these systems we see cascades of activity, emergence of power-laws for distribution of event sizes vs event frequency, fractals, all the hallmarks of Complex Systems In context of these systems, we were interested in questions that had to do with keeping a system from cascading and if it did, defining the right corrective action to dissipate the cascade. USEURO FX 8

Complex Adaptive System of Systems (CASoS) Engineering Definition of the CASoS System: Global transmission network composed of person to person interactions beginning from the point of origin (within coughing distance, touching each other or surfaces…) System of Systems: People belong to and interact within many groups: Households, Schools, Workplaces, Transport (local to regional to global), etc., and health care systems, corporations and governments place controls on interactions at larger scales… Complex: many, many similar components (Billions of people on planet) and groups Adaptive: each culture has evolved different social interaction processes, each will react differently and adapt to the progress of the disease, this in turn causes the change in the pathway and even the genetic make-up of the virus HUGE UNCERTAINTY How could we avert the carnage? 9

Complex Adaptive System of Systems (CASoS) Engineering Analogy with other Complex Systems Simple analog: Forest fires: You can build fire breaks based on where people throw cigarettes… or you can thin the forest so no that matter where a cigarette is thrown, a percolating fire (like an epidemic) will not burn. Focus on Local Community Mitigation 10 Problem Definition: Could we target the social network within individual communities and thin it? Could we thin it intelligently so as to minimize impact and keep the economy rolling?

Complex Adaptive System of Systems (CASoS) Engineering Generic Networked Agent Approach Stylized Social Network (nodes, links, frequency of interaction) Disease manifestation based on data from the literature (node and link behavior) + 11

Complex Adaptive System of Systems (CASoS) Engineering 6 of 10 seeds developed secondary infections 1 seed created the epidemic Simulation We ran the model and it hit the numbers by age class from past pandemics when single overall infectivity of the disease tuned to yield the attack rate. We had representative node and link behavior and contact network; we had the right physics. 12

Complex Adaptive System of Systems (CASoS) Engineering Adults (black) Children (red) Teens (blue) Seniors (green) Network of Infectious Contacts Children and teens form the Backbone of the Epidemic 13 IEEE SoSE June 2011

Complex Adaptive System of Systems (CASoS) Engineering Closing Schools and Keeping the Kids Home 14

Complex Adaptive System of Systems (CASoS) Engineering The Clouds Thicken… Sec Chertoff briefed, open release SAND report written. White House table top: everyone several steps behind our thinking, fixated on closing borders, etc. Closing borders = building fire breaks. They dont solve the problem. Meanwhile, big names in epidemiology modeling the movement of the disease across the US with massive models at LANL and in Great Britain (published rapidly in Science and Nature) suggested there was little that could be done. The pandemic would wash over the US without antivirals. But their tools were not built to consider the intricacies of the underlying social network on which the pandemic would spread in a local community. 15

Complex Adaptive System of Systems (CASoS) Engineering Getting our results used… We needed to INFLUENCE PUBLIC POLICY and quickly. I submitted to Science… Rejected I tried to enlist the help of the big names in the field… they didnt reply. I then decided to use the informal social-influence network instead of the command and control hierarchy to get our work to the critical nodes with control. I sent our SAND report to a acquaintance at the VA who sent it to a colleague who was the VAs rep on the White House Homeland Security Council (HSC) Pandemic Implementation Plan Writing Team, who sent it to the team lead who sent it to the Senior Director for Biodefense Policy, HSC. Four Degrees of Separation! 16

Complex Adaptive System of Systems (CASoS) Engineering I got on a plane and after a 4 hour presentation- interrogation-brain storming session, the HSC team and I had changed the course of public policy and started an avalanche of activity. 17 Getting our results used…

Complex Adaptive System of Systems (CASoS) Engineering With the White House Pandemic Implementation Plan writing team and VA OPHEH Identified critical questions/issues and worked with us to answer/resolve them How sensitive were results to the social net? Disease manifestation? How sensitive to compliance? Implementation threshold? Disease infectivity? How did the model results compare to past epidemics and results from the models of others? Is there any evidence from past pandemics that these strategies worked? What about adding or layering additional strategies including home quarantine, antiviral treatment and prophylaxis, and pre- pandemic vaccine? ALL IN THREE WEEKS 18

Complex Adaptive System of Systems (CASoS) Engineering Systematic Evaluation of Choice We extended the model and put it on Sandias 10,000 node computational cluster… 10s of millions of runs later we had the answers to: – What is the best mitigation strategy combination? (choice) – How robust is the combination to model assumptions? (robustness of choice to model uncertainty) – What is required for the choice to be most effective? (critical enablers of system resilience) Davey, V.J., R.J. Glass, H.J. Min, W.E. Beyeler and L.M. Glass, Effective, Robust Design of Community Mitigation for Pandemic Influenza: A Systematic Examination of Proposed U.S. Guidance, PLoSOne, July 2008, 3(7): e2606. doi: /journal.pone Effective, Robust Design of Community Mitigation for Pandemic Influenza: A Systematic Examination of Proposed U.S. Guidance 19

Complex Adaptive System of Systems (CASoS) Engineering Meanwhile a set of parallel efforts were set in motion… Our original report expanded and published in Emerging Infectious Diseases (Glass et al., 2006). Targeted Layered Containment or TLC was socialized across a set of critical governmental departments and institutions by the HSC-PIP team. Our results were evaluated and corroborated by modelers within the Models of Infectious Disease Agents Study (MIDAS) group funded by NIH (Halloran et al., 2008). Triggers and whistles were systematically evaluated with the Deputy Chief Officer of OPHEH (Davey et al., 2008a). Epidemiological Forensics were applied to previous pandemics to determine if community mitigation measures were effective (Hatchett et al., 2007; Markel et al, 2007) A comprehensive survey-based method applied to characterize the social contact network of school aged children and teenagers (Glass and Glass, 2008). A comprehensive study of the influence of pandemics on critical infrastructure and the economy was conduced (NISAC, 2007). 20

Complex Adaptive System of Systems (CASoS) Engineering Culminating in… In October, 2006 the Institute of Medicine conducted a review (IOM 2006a,b). On February 1, 2007 issued Interim Pre-Pandemic Planning Guidance: Community Strategy for Pandemic Influenza Mitigation in the United States--Early, Targeted, Layered Use of Non-pharmaceutical Interventions 21 For Details see: Local Mitigation Strategies for Pandemic Influenza, RJ Glass, LM Glass, and WE Beyeler, SAND J (Dec, 2005). Targeted Social Distancing Design for Pandemic Influenza, RJ Glass, LM Glass, WE Beyeler, and HJ Min, Emerging Infectious Diseases November, Design of Community Containment for Pandemic Influenza with Loki-Infect, RJ Glass, HJ Min WE Beyeler, and LM Glass, SAND P (Jan, 2007). Social contact networks for the spread of pandemic influenza in children and teenagers, LM Glass, RJ Glass, BMC Public Health, February, Rescinding Community Mitigation Strategies in an Influenza Pandemic, VJ Davey and RJ Glass, Emerging Infectious Diseases, March, Effective, Robust Design of Community Mitigation for Pandemic Influenza: A Systematic Examination of Proposed U.S. Guidance, VJ Davey, RJ Glass, HJ Min, WE Beyeler and LM Glass, PLoSOne, July, Pandemic Influenza and Complex Adaptive System of Systems (CASoS) Engineering, Glass, R.J., Proceedings of the 2009 International System Dynamics Conference, Albuquerque, New Mexico, July, Health Outcomes and Costs of Community Mitigation Strategies for an Influenza Pandemic in the U.S, Perlroth, Daniella J., Robert J. Glass, Victoria J. Davey, Alan M. Garber, Douglas K. Owens, Clinical Infectious Diseases, January, 2010.

Complex Adaptive System of Systems (CASoS) Engineering Another Similar Example: Payment System Structure and Function USEURO FX Payment system network Networked Agent Based Model Global interdependencies For Details see: The Topology of Interbank Payment Flows, Soramäki, et al, PhysicaA, 1 June 2007; vol.379, no.1, p Congestion and Cascades in Payment Systems, Beyeler, et al, PhysicaA, 15 Oct. 2007; v.384, no.2, p Congestion and Cascades in Coupled Payment Systems, Renault, et al, Joint Bank of England/ECB Conference on Payments and monetary and financial stability, Nov,

Complex Adaptive System of Systems (CASoS) Engineering CASoS Engineering Harnessing the tools and understanding of Complex Systems, Complex Adaptive Systems, and Systems of Systems to Engineer solutions for some of the worlds biggest, toughest problems: The CASoS Engineering Initiative See: Sandia National Laboratories: A Roadmap for the Complex Adaptive Systems of Systems CASoS) Engineering Initiative, SAND , September 2008Sandia National Laboratories: A Roadmap for the Complex Adaptive Systems of Systems CASoS) Engineering Initiative And our Web site at: Current efforts span a wide variety of CASoS and Problem Owners: – DOE, DHS, DoD, DVA, HHS, FDA and others 23

Complex Adaptive System of Systems (CASoS) Engineering Aspirations 24 Images: The Economist magazine,

Complex Adaptive System of Systems (CASoS) Engineering Stanford-CISAC Perry Fellow: Implications of National Security Policy for National and Global Prosperity Nation A Nation C Nation B Explanation Food Consumer Goods Industrial Goods Minerals Oil Deposits Emission Credits Motor Fuel Interregional Broker Trading Blocks Global Model Within Sector Structure 25

Complex Adaptive System of Systems (CASoS) Engineering Challenge: Finding the Right Model There is no general-purpose model of any system A model describes a system for a purpose System What to we care about? What can we do? Additional structure and details are added as needed Model 26

Complex Adaptive System of Systems (CASoS) Engineering Challenge: Uncertainty Aspects of Complex systems can be unpredictable (e.g., Bak, Tang, and Wiesenfield [BTW] sandpile) Adaptation, Learning and Innovation Conceptual model or Structural uncertainty – Beyond parameters – Beyond ICs/BCs ·Initial Conditions ·Boundary Conditions 27

Complex Adaptive System of Systems (CASoS) Engineering Aspirations Define Analysis Evaluate Performance Define and Evaluate Alternatives Define Conceptual Model Satisfactory? Done Action A Performance Requirement Action B Performance Requirement Decision to refine the model Can be evaluated on the same Basis as other actions Model uncertainty permits distinctions Action A Performance Requirement Action B Performance Requirement Model uncertainty obscures important distinctions, and reducing uncertainty has value Approach: Model development as an iterative process that uses uncertainty 28

Complex Adaptive System of Systems (CASoS) Engineering Approach: Pragmatic Drive for Detail where More can be Less Model Detail Amount Coverage of Model Parameter Space 1.Recognize the tradeoff 2.Characterize the uncertainty with every model 3.Buy detail when and where its needed Chance of Error Cost Understanding 29

Complex Adaptive System of Systems (CASoS) Engineering Summarizing across many Applications: Model based Design of Influence can be quite effective but requires: Policy makers OWN the models of their systems Models be as SIMPLE as possible Models be CAUSAL and DYNAMIC Models be PROBLEM SPECIFIC and connect MEANS (policy) and ENDS (system health) UNCERTAINTY QUANTIFICATION be used to evaluate and build models that can RANK policy choices to find those whose choice is ROBUST TO UNCERTAINTY Recognition that systems are LIVING

Complex Adaptive System of Systems (CASoS) Engineering Robert J. Glass 31 SNL DVA DOE DOD DHS Stanford NIH DHHS APPAM 2011 November 3-5, 2011 Theresa J. Brown, Arlo L. Ames, John M. Linebarger, Walter E. Beyeler, S. Louise Maffitt, Nancy S. Brodsky, and Patrick D. Finley Stephen H. Conrad, Thomas F. Corbet, Jr., P. Sue Downes, Mark A. Ehlen, Paul G. Kaplan, Andjelka Kelic, Kirin Lakkaraju, Michael D. Mitchell, Roger A. Mitchell, Thomas W. Moore, Alexander V. Outkin, Janis L. Schubert, Vanessa N. Vargas, Stephen J. Verzi, Eric D. Vugrin, and Aldo A. Zagonel Thanks! Complex Adaptive System of Systems (CASoS) Engineering