Presentation on theme: "Complexity Theory and Decision Making in Health System"— Presentation transcript:
1 Complexity Theory and Decision Making in Health System
2 “ I never make predictions, especially about the future.” Sam Goldwyn Mayer
3 How Hazardous is Health Care DangerousSafe100KHealth CareDriving10K1KScheduledAirlinesTotal # of DeathsCharteredFlights100EuropeanRailroadsMtn Climbing10ChemicalManufacturingNuclearPowerBungee Jumping11101001K10K100K1M10M# Encounters / Death
4 Health Care as a Complex System Health care organizations can be viewed as complex systems (Institute of Medicine 2001; Plsek and Greenhalgh 2001; Sweeney and Griffiths 2002).
6 Simple Baking a cake is a simple problem. Simple problems lend themselves to a recipe approach.The process and results are generalizable; and while special skill at cooking is a plus, it is not essential for success.
11 K ~D M O P Z G S R Y T N C V ~G A C B J X G I P Z D X ~A A ~K D U H T QPLPZDX~AA~K
12 ComplicatedSending a rocket to the moon is an example of a complicated problem.Complicated problems are best dealt with using formulaic and expert-knowledge approaches.The overall problem can be mechanistically broken down into component parts (booster rocket, cabin environment, navigational equipment, etc.) and assigned to teams of experts who utilize the proven methodologies of their disciplines.
13 ComplicatedRockets are similar in important ways, meaning that success with one rocket provides reasonable assurance of success with future rockets.When surprising events do occur, we can study these, build improvements into the system, and thus raise the probability of future success.
15 ComplexIn contrast to simple and complicated issues, an example of a complex issue is that of raising a child.Success in raising one child is no guarantee of success in raising another.Past experience, coupled with advice from experts, can serve as a starting point; but we know that simply applying the formula that worked before may not lead to success, and may even lead directly to failure because of the second child’s resentment at being treated this way.
16 Across all disciplines, at all levels, and throughout the world, health care is becoming more complex.
17 Newton's “clockwork universe,” in which big problems can be broken down into smaller ones, analyzed, and solved by rational deduction, has strongly influenced both the practice of medicine and the leadership of organizations.
18 But the machine metaphor lets us down badly when no part of the equation is constant, independent, or predictable.
19 Complex Adaptive Systems: Definition A complex adaptive system is a collection of individual agents with freedom to act in ways that are not always totally predictable, and whose actions are interconnected so that one agent's actions changes the context for other agents.
20 Complex Adaptive Systems: Examples Examples include the immune system, a colony of termites, the financial market, and just about any collection of humans (for example, a family, a committee, or a primary healthcare team).
21 Complex Adaptive Systems Fuzzy, rather than rigid, boundariesAgents' actions are based on internalized rulesThe agents and the system are adaptiveSystems are embedded within other systems and coevolveTension and paradox are natural phenomena, not necessarily to be resolvedInteraction leads to continually emerging, novel behaviorInherent nonlinearityInherent unpredictabilityAttractor behaviorInherent self organization through simple locally applied rules
22 Fuzzy, rather than rigid, boundaries In mechanical systems boundaries are fixed and well defined; for example, knowing what is and is not a part of a car is no problem. Complex systems typically have fuzzy boundaries. Membership can change, and agents can simultaneously be members of several systems.
23 Agents' actions are based on internalized rules In a complex adaptive system, agents respond to their environment by using internalized rule sets that drive action.In a biochemical system, the “rules” are a series of chemical reactions.At a human level, the rules can be expressed as instincts, constructs, and mental models. “Explore the patient's ideas, concerns, and expectations” is an example of an internalized rule that might drive a doctor's actions.
24 These internal rules need not be shared, explicit, or even logical when viewed by another agent. The mental models and rules within which independent agents operate are not fixed.
25 The agents and the system are adaptive Because the agents within it can change, a complex system can adapt its behavior over time.At a biochemical level, adaptive microorganisms frequently develop antibiotic resistance.And adaptation within the system can be for better or for worse, depending on whose point of view is being considered.
26 Systems are embedded within other systems and coevolve The evolution of one system influences and is influenced by that of other systems.Our efforts to improve the formal system of medical care can be aided or thwarted by these other more informal “shadow systems.”Since each agent and each system is nested within other systems, all evolving together and interacting, we cannot fully understand any of the agents or systems without reference to the others.
27 Tension and paradox are natural phenomena, not necessarily to be resolved The fact that complex systems interact with other complex systems leads to tension and paradox that can never be fully resolved.In complex social systems, the seemingly opposing forces of competition and cooperation often work together in positive ways fierce competition within an industry can improve the collective performance of all participants.
28 Whereas conventional reductionist scientific thinking assumes that we shall eventually figure it all out and resolve all the unresolved issues, complexity theory is comfortable with and even values such inherent tension between different parts of the system.
29 Interaction leads to continually emerging, novel behavior The behavior of a complex system emerges from the interaction among the agents. The observable outcomes are more than merely the sum of the parts-the properties of hydrogen and oxygen atoms cannot be simply combined to account for the noise or shimmer of a babbling brook.The productive interaction of individuals can lead to novel approaches to issues. The inability to account for surprise, creativity, and emergent phenomena is the major shortcoming of reductionist thinking.
30 Inherent nonlinearity The behavior of a complex system is often nonlinear.For example, in weather forecasting the fundamental laws governing gases contain nonlinear terms that lead to what complexity scientists have called “sensitive dependence on initial conditions,” such that a small difference in the initial variables leads to huge differences in outcomes.
31 Inherent unpredictability Because the elements are changeable, the relationships nonlinear, and the behavior emergent and sensitive to small changes, the detailed behavior of any complex system is fundamentally unpredictable over time.Ultimately, the only way to know exactly what a complex system will do is to observe it: it is not a question of better understanding of the agents, of better models, or of more analysis.
32 Inherent patternDespite the lack of detailed predictability, it is often possible to make generally true and practically useful statements about the behavior of a complex system.There is often an overall pattern.
33 Attractor behaviorComplexity science notes a specific type of pattern called an attractor.Attractor patterns provide comparatively simple understanding of what at first seems to be extremely complex behavior.For example, in psychotherapy, clients are more likely to accept a counselor's advice when it is framed in ways that enhance their core sense of autonomy, integrity, and ideals.
34 Attractor behaviorThese are underlying attractors within the complex and ever changing system of a person's detailed behavior.Relatively simple attractor patterns have been shown in share prices in a financial market, biological systems (such as beat to beat variation in heart rate), human behavior, and social systems
35 Inherent self organization through simple locally applied rules Order, innovation, and progress can emerge naturally from the interactions within a complex system; they do not need to be imposed centrally or from outside.For example, termite colonies construct the highest structures on the planet relative to the size of the builders. Yet there is no chief executive termite, no architect termite, and no blueprint.Each individual termite acts locally, seemingly following only a few simple shared rules of behavior, within a context of other termites also acting locally. The termite mound emerges from a process of self organization.
36 In everyday life many complex behaviors emerge from relatively simple rules in such things as driving in traffic or interacting in meetings. While no one directs our detailed actions in such situations, we all know how to behave adaptively and end up getting to where we want to go.
37 Stacey Diagram Far from Agreement Level of Agreement Decisions will havevarying levels at which the entire system agree that a particular effect is desired.The Degree of CertaintyDecisions are more certainwhen the cause and effectlinkages are well known.Close toAgreementClose to certaintyFar from certainty
38 Stacey Diagram Far from Agreement Close to Agreement Where even enoughhard evidence is not enoughFar fromAgreementClose toAgreementWhere there is notenough hard evidenceClose to certaintyFar from certainty
39 Stacey Diagram Simple: Rational decision-making. Straightforward Far fromAgreementSimple:Straightforwarddecision-making.Rationalplanning & controlSimpleClose toAgreementClose to certaintyFar from certainty
40 Stacey Diagram Chaos Chaos: No discernible patterns. Disintegration Far fromAgreementChaosChaos:Disintegrationpatterns.No discernible& anarchySimpleClose toAgreementClose to certaintyFar from certainty
41 Stacey Diagram Chaos Complicated Simple Far from Agreement Close to Close to certaintyFar from certainty
42 Stacey Diagram Chaos Complicated Simple Complicated Far from Agreement Close toAgreementClose to certaintyFar from certainty
43 Stacey Diagram Zone of Complexity Far from Agreement Close to Close to certaintyFar from certainty
44 The zone of complexityLangton has termed the set of circumstances that call for adaptive behaviors “the edge of chaos.”This zone has insufficient agreement and certainty to make the choice of the next step obvious (as it is in simple linear systems), but not so much disagreement and uncertainty that the system is thrown into chaos.The development and application of clinical guidelines, the care of a patient with multiple clinical and social needs, and the coordination of educational and development initiatives throughout a practice or department are all issues that lie in the zone of complexity.
45 Our learnt instinct with such issues, based on reductionist thinking, is to troubleshoot and fix things—in essence to break down the ambiguity, resolve any paradox, achieve more certainty and agreement, and move into the simple system zone.
46 But complexity science suggests that it is often better to try multiple approaches and let direction arise by gradually shifting time and attention towards those things that seem to be working best.Schön's reflective practitioner, Kolb's experiential learning model, and the plandocheckact cycle of quality improvement are examples of activities that explore new possibilities through experimentation, autonomy, and working at the edge of knowledge and experience.
47 Not all problems lie in the zone of complexity. Where there is a high level of certainty about what is required and agreement among agents (for example, the actions of a surgical theatre team in a routine operation) it is appropriate for individuals to think in somewhat mechanistic terms and to fall into their pre-agreed role.In such situations the individuals relinquish some autonomy in order to accomplish a common and undisputed goal; the system displays less emergent behaviour but the job gets done efficiently. Few situations in modern health care, however, have such a high degree of certainty and agreement, and rigid protocols are often rightly abandoned.
48 Some principles to assist decision making in the complex zone Use intuition and muddle through—Doctors frequently make what would be the best but not definitively the “right” decision on the basis of experience, evidence, and knowledge of the patient's storyExperiment—Try different management options with patients, using an empirical trial of treatment or a plandocheckact cycleMinimum specification—Offer patients general goals, suggestions, and examples but do not attempt to work everything out for them—your tidy solution is unlikely to be compatible with all aspects of their lifestyle and valuesChunking—Instead of trying to sort out every problem, try solving one or two; other solutions may follow naturally once a new pattern has emergedUse metaphors—Communication can be difficult when issues are complex. Using metaphors can often create a shared understanding—for example, “you seem like a tree bowed over by the wind” or “what does that last hypo remind you of?”Provocative questions—Ask questions that might throw light on basic assumptions, especially when the patient is “stuck”—for example, “if you got better, might this cause some problems for you?”
49 Examples of CAS The immune system, A colony of insects, The stock market,FamiliesA flock of birdsThe InternetThe weatherThe economyAn ecosystemHealth care organizations.
50 ComplexityAn emerging science which analyzes organizations from multiple dimensions, including biological models, rather than simple machinistic perspectives.Organizations act as complex adaptive systems and are therefore less predictable.
51 Complex Adaptive Systems (CAS) A collection of individuals, each of which is autonomous and free to act in unpredictable ways, and whose actions are interconnected such that one's actions change the context of the other individuals.
52 CAS Attributes Each element can change themselves; i.e., they can adapt.Systems are embedded within systems & their interdependency matters.System is nonlinear –small events may trigger huge effects.large events can have negligible effects.Complex behavior can emerge from a few simple rules.
53 CAS AttributesNot predictable in detail; forecasting is an inexact, yet boundable, art.Future is not just unknown, but unknowable.System co-evolves through constant tension and balance.Emergence of novelty and creativity is a natural state.Order can emerge without central control.CAS are history-dependent.
54 Adaptive Components Individual components can change/adapt. change will occur in response to alterations in the environment.behavioral adaptation is rapid-cycle learning from local experience.dependent upon the presence of diversity.necessary to maintain existence in an unpredictable environment.allows the entire system to adapt.
55 Complex Imbedded Systems Systems are imbedded within systems.complex systems are parts of larger complex systems, and are made up of smaller complex systems.no component, including leaders, can act as though they are outside the systemit is not the specific individuals that are the most critical, but the relationships between individuals
56 Non-linearity System is nonlinear. effects of small or large changes are not necessarily related to size or predictablelarge interventions may not achieve desired outcomes and may yield nothing or possibly the opposite outcome.there is a sensitive dependence to initial conditions - the "butterfly effect."
57 Non-linear SystemsInverse power law: the frequency of occurrence of a phenomenon is in inverse relation to its size.small waves are common, large waves are less frequentCommon generative mechanismsboth small and large waves are causes by the same generative mechanisms
58 Non-linear SystemsSelf-organized criticality - there is interdependence of agents in the system which creates tension over timePer Bak's classic sand pile experimentAs grains of sand self-organize into a pile, a single new grain of sand can cause:nothing at alla small shifta large landslide
59 Non-linear Systems Confluence and concatenation BIG events, such as severe errors, often occur as a result of triggering events.these triggering events are the generative mechanisms leading to small events.BIG events are impossible to predictanalyzing the cause of small events is the first step in preventing big events.
60 Non-linear Systems Tension and criticality - When there is sufficient tension and criticality in the system, a seemingly trivial event can serve as a powder keg
61 Simple Rules Complex behavior emerge from a few simple rules. complex plans are not needed, and may be detrimentalsimple rules are frequently unspoken, yet self-perpetuating within the systemsimple rules can be clarified by searching for subtle patterns and asking "Why?" five times.
62 Limited Predictability Not predictable in detail; forecasting is an inexact, yet boundable, art.Future is unknown and unknowable.need to analyze - trying to identify recurring patterns, the underlying simple rules and attractorsforecasting tries to foretell how these patterns will yield outcomes into perceived future environment/conditions
63 Tension & ParadoxSystem co-evolves through constant tension and paradox.in CAS, tension and paradox are natural.both sides of apparent contradictions are true and necessary.we may not need to resolve all the dilemmas of organizations.resolution of these dilemmas may be detrimental to long-term survival.
64 Emergence Novelty and creativity naturally emerge. CAS exist and thrive at the edge of chaosin an environment of uncertainty and rapid change, novelty and creativity are necessary for survivalCAS have the adaptability which allow for the emergence of novelty and creativity.Dependent upon the presence of diversityStandardization smothers creativity.
65 Emergence Order can emerge without central control. CAS achieve order by reaching equilibrium, not stability.attempts to impose central control can have undesirable consequences.equilibrium is determined by the simple rules & attractors and the environment.changing the rules, attractors or environment may yield a new equilibrium.
66 Stacey Diagram Far from Agreement Close to Agreement Good enough planning–minimumspecification, simple rulesMultiple actionsExperiment and tune systemplan-do-check-actScan forpatternsPolitical decision makingNegotiation andconsensus buildingCompromiseListen to the shadow systemUse intuition, muddle throughMetaphorsUse complex thoughtsfor complex systemsJudgmental decisionmakingMission and visionbased decision makingClose toAgreementPlan and controlRegulateClose to certaintyFar from certainty
67 What is the fate of a complex system of decisions ? Far fromAgreementFinding more cause componentsfrom already known cause clustersand discovering unknown causeclusters**Close toAgreementClose to certaintyFar from certainty
68 What is the fate of a complex system of decisions ? Far fromAgreement**Consensus building around sharedValues and beliefsClose toAgreementClose to certaintyFar from certainty
69 What is the fate of a complex system of decisions ? Far fromAgreement**Falling into chaos :Organizational Collapse,Revolutions, DeathClose toAgreementClose to certaintyFar from certainty
70 Stacey DiagramMany organizations are existing in all areas of the matrix at different times.Traditional management methods are effective in the Simple area.Management methods needs to be altered in the Complicated areas -negotiation / compromisemission & values based
71 Stacey DiagramIf you try to use traditional management methods (plan & control) in the Zone of Complexity, you usually get unintended and unpredictable consequences.Complex Adaptive Systems can exist and thrive in the Zone of Complexity.PDCA cycle is an example of management in the complex zone allowing tuning, experimenting, and good-enough planning.
72 System DesignThe distinction between these systems is obvious, but frequently not taken into account when system is designed.When the human components respond in an unpredictable manner, they are labeled as being unreasonable or “resistant to change.”The designer then specifies behavior in greater detail via rules, guidelines, etc.