Need to clarify what is possible.... Variables  settable  measurable  inferrable  observable  estimable  aspirational  hypothetical Relationships.

Slides:



Advertisements
Similar presentations
Diversity in Management Research
Advertisements

Building Community Capacity to Put People First A project to support social care transformation.
Hard or Soft: Does it matter? Michael Lyons Manager, Strategic Analysis and Research.
EVALUATION as an instrument of governance for a regional social plan Dr. Annamaria Casini (sociopolitical management expert) SULMONA - 22nd October 2012.
Lesson 3 ODOT Analysis & Assessment. Analysis & Assessment Learning Outcomes As part of a small group, apply the two- part analysis by generating exposure-
Principal Professional Development project
Starting an Innovation Process Life of any business is finite. For companies to endure, the drive for efficiency must be combined with excellence in.
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
The Modeling Process Esmaeil Khedmati Morasae Center for Community-Based Participatory Research in Health Tehran University of Medical Sciences Winter.
Systems Engineering in a System of Systems Context
Program framework 1.Articulate program goals 2.Develop system level model for goal attainment 3.Assess current management efforts – identify gaps 4.Develop.
IT Governance and Management
ISYS 3015 Research Methods ISYS3015 Analytical Methods for Information systems professionals Week 2 Lecture 1: The Research Process.
PPA 502 – Program Evaluation
PPA 502 – Program Evaluation
Why we need Adaptation Things are getting tougher for defence – we face increasing...: diversity of defence roles & security challenges ..  more to deal.
Analytical methods for Information Systems Professionals Week 13 Lecture 1 CONCLUSION.
© Cranfield University 2009 Towards a Framework of Sales Performance Measurement Effectiveness Peter Kerr, Javier Marcos-Cuevas Cranfield School of Management.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 1 The Relationship between.
Impact Measurement and You Understanding Impact Measurement, Practical Tools, Key Questions.
Systems Dynamics and Equilibrium
Sustaining Change in Higher Education J. Douglas Toma Associate Professor Institute of Higher Education University of Georgia May 28, 2004.
SCIENTIFIC INVESTIGATION
Evidence based research in education Cathy Gunn University of Auckland.
The conceptual framework WP 8 SCENARIOS What is needed for planning is not a set of isolated trends, but multidimensional models that interrelate social,
Chapter 1 Introduction to Simulation
How to conduct good investigation in social sciences Albu Iulian Alexandru.
Canadian Cancer Society Manitoba Division: Knowledge Exchange Network (KEN) & CancerCare Manitoba Manitoba Integrated Chronic Disease Primary Prevention.
Prediction in Human Presented by: Rezvan Kianifar January 2009.
Implementation and process evaluation: developing our approach Ann Lendrum University of Manchester Neil Humphrey University of Manchester Gemma Moss Institute.
Criteria and methodology for the evaluation of minority policies Informal International Consultative Meeting in the Area of Minority Issues, European Centre.
Active Learning Curriculum for Excellence Moira Lawson.
GSSR Research Methodology and Methods of Social Inquiry socialinquiry.wordpress.com January 17, 2012 I. Mixed Methods Research II. Evaluation Research.
Principles, Practices and Dynamics of Research Management LECTURE-4 Research Design Kazi Nurmohammad Hossainul Haque Senior Lecturer, Civil Service College.
MBA7025_01.ppt/Jan 13, 2015/Page 1 Georgia State University - Confidential MBA 7025 Statistical Business Analysis Introduction - Why Business Analysis.
Integrated Risk Management Charles Yoe, PhD Institute for Water Resources 2009.
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
MGS3100_01.ppt/Aug 25, 2015/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Introduction - Why Business Analysis Aug 25 and 26,
1 Introduction to Software Engineering Lecture 1.
A Curriculum for Excellence At the heart of an active learning approach is the creative, adaptable professional who can enjoy developing the ideas that.
For ABA Importance of Individual Subjects Enables applied behavior analysts to discover and refine effective interventions for socially significant behaviors.
MBA7020_01.ppt/June 13, 2005/Page 1 Georgia State University - Confidential MBA 7020 Business Analysis Foundations Introduction - Why Business Analysis.
1 CHAPTER 2 Decision Making, Systems, Modeling, and Support.
Approach to GEF IW SCS Impact Evaluation Aaron Zazueta Reference Group Meeting Bangkok, Thailand September 27, 2010.
1) Establish & Identify Scheme 5) Evolve Scheme 4) Review & Modify Scheme Deliverables 3) Operate the Framework 2) Manage Performance Assurance Scheme.
Screen 1 of 20 Vulnerability Vulnerability Assessment LEARNING OBJECTIVES Define the purpose and scope of vulnerability assessment. Understand how vulnerability.
Research Design. Selecting the Appropriate Research Design A research design is basically a plan or strategy for conducting one’s research. It serves.
Global Environmental Change and Food Systems Scenarios Research up to date Monika Zurek FAO April 2005.
Early PhaseImplementation PhaseInnovation Phase Reflection and Revision Teacher makes time and space for student to reflect on what they have learned and.
MODELING AND ANALYSIS Pertemuan-4
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
The Risk Management Process
Part III: Strategy in Action
Kathy Corbiere Service Delivery and Performance Commission
0 ©2015 U.S. Education Delivery Institute While there is no prescribed format for a good delivery plan, it should answer 10 questions What a good delivery.
Systems Architectures System Integration & Architecture.
Organizations of all types and sizes face a range of risks that can affect the achievement of their objectives. Organization's activities Strategic initiatives.
December 3, 2014AISC-CODISCO 2014, revised Nov From Agent-based models to network analysis (and return): the policy-making perspective Magda Fontana.
WORKSHOP ON PROJECT CYCLE MANAGEMENT (PCM) Bruxelles 22 – 24 May 2013 Workshop supported by TAIEX.
CAN EFFECTIVE PERFORMANCE MANAGEMENT SYSTEM ALONE HELPS IMPROVE SERVICE DELIVERY? Institute of Municipal Finance Officers & Related Professions Cherèl.
Module 8 Guidelines for evaluating the SDGs through an equity focused and gender responsive lens: Overview Technical Assistance on Evaluating SDGs: Leave.
Introduction to ISO 9000:2015 Quality Management Principles
Workshop to develop theories of change
Measuring Outcomes of GEO and GEOSS: A Proposed Framework for Performance Measurement and Evaluation Ed Washburn, US EPA.
THEORY IN EDUCATIONAL RESEARCH
program framework Articulate program goals
Somalia NGO Consortium
Building Changes’ Strategic Business Planning Process
The Adaptive use of Networks to Generate an Adaptive Task Force
5.3 Using the Theory of Change Throughout the Project Cycle
Presentation transcript:

need to clarify what is possible.... Variables  settable  measurable  inferrable  observable  estimable  aspirational  hypothetical Relationships  simple causal  causal (with hysteresis)  ‘goldilocks’ – need tuning  ‘more is better’ – drive tuning  conditional... independent, settable ‘in principle’  possible interventions independent but unsettable  uncontrollables, contingent deterministically dependent  simple causality holds, predictable outcome of interventions and uncontrollable factors ( but need to know them and the causal relations ) emergent  causal and influence network operates, still dependent, but not computably so Overall Effectiveness articulate value success/failure measures Intermediate emergent properties observe, set targets, use to understand intervention opportunities too many interrelated influences, too many factors, some not measurable,...

can we make these choices so as to ensure success??? new org’n policy doctrine TTPs etc for 20xx + new stuff to be delivered by 20xx + what we retain or modify of what we have in staff, equipt, extant org’n policy doctrine TTPs etc Force Effectiveness measures of success and failure for the force intervention opportunities How it all fits together

new org’n policy doctrine TTPs etc for 20xx + new stuff to be delivered by 20xx + what we retain or modify of what we have in staff, equipt, extant org’n policy doctrine TTPs etc Emergent properties #$ ^&... elements of adaptivity - resilience - agility - responsiveness - flexibiility Force Effectiveness measures of success and failure for the force complex causal and influence networks contingencies intervention opportunities Observables can support adaptive approach How it all fits together complex causal and influence networks contingencies formulate hypotheses about what goes on in here i.e. how sets of emergent properties might arise in 20xx from choices of settable and possible uncontrollable factors formulate hypotheses about how the 20xx force and its emergent properties might interact with the context to produce outcomes

can we make these choices so as to ensure success??? new org’n policy doctrine TTPs etc for 20xx + new stuff to be delivered by 20xx + what we retain or modify of what we have in staff, equipt, extant org’n policy doctrine TTPs etc Emergent properties #$ ^&... elements of adaptivity - resilience - agility - responsiveness - flexibiility Force Effectiveness measures of success and failure for the force complex causal and influence networks contingencies intervention opportunities Observables can support adaptive approach How it all fits together complex causal and influence networks contingencies formulate hypotheses about what goes on in here i.e. how sets of emergent properties might arise in 20xx from choices of settable and possible uncontrollable factors formulate hypotheses about how the 20xx force and its emergent properties might interact with the context to produce outcomes Contain many interacting feedback and adaptive processes Contain many interacting feedback and adaptive processes

can we make these choices so as to ensure success??? new org’n policy doctrine TTPs etc for 20xx + new stuff to be delivered by 20xx + what we retain or modify of what we have in staff, equipt, extant org’n policy doctrine TTPs etc Emergent properties #$ ^&... elements of adaptivity - resilience - agility - responsiveness - flexibiility Force Effectiveness measures of success and failure for the force complex causal and influence networks contingencies intervention opportunities Observables can support adaptive approach How it all fits together complex causal and influence networks contingencies formulate hypotheses about what goes on in here i.e. how sets of emergent properties might arise in 20xx from choices of settable and possible uncontrollable factors formulate hypotheses about how the 20xx force and its emergent properties might interact with the context to produce outcomes set targets for these based on growing understanding of how they enable effectiveness Can use adaptive process to develop models of these networks

Linking operations and capability development – the CAS perspective close parallel between problem of operational design (creating effective interventions in complex operations), and problem of system design (creating effective interventions in our own complex systems). In both cases there are: –a large number of possible interventions, –complex interdependent multi-dimensional and multi-scale measures of success and failure, –our interventions play out through a complex causal and influence network (C&IN) of people, contextual elements, systems, processes and relationships, and interact with a large number of contingent and uncontrollable factors to produce outcomes in the measures of success and failure, and –this C&IN is opaque, ever-changing, and can never be grasped in its entirety. Therefore in both cases we have to take an adaptive approach to our interventions, i.e. –seek to learn about the dynamics of the C&IN, in order to build some confidence in developing a strategy for intervention, and then within the context of that strategy, –undertake an iterative process of generating, evolving and evaluating specific intervention options, selecting those for actual employment in the real system (or a representation of it), observing relevant feedback from their employment and using that feedback to review and evolve the understanding of the C&IN, the strategy and the specific interventions themselves.

Methodology - Conceptual and Analytical Framework C&IN explore conceptual model  develop conjectures, questions  refine collection plan Observe C&IN and develop conceptual model Collection plan 1 2 explore conceptual model  develop intervention strategy  identify critical uncertainties  develop probes to inform  refine collection plan actions Analytical framework Indicators Contingent factors Analytical framework Indicators Contingent factors MoS/F Proxies Develop specific intervention options to implement strategy  Implement them and  refine collection plan 3 Observe results of probes and further develop conceptual model and intervention strategy Analytical framework Indicators Contingent factors MoS/F Proxies MoP time

Methodology: Conceptual and Analytical Framework relates intervention options through the conceptual model to the proxies and ultimate MoS/F captures the rationale for the stratagem being pursued, exposes the conjectures and assumptions underpinning them, and explicitly supports their ongoing testing and refinement. captures the rationale for what is being measured (the collection plan) and what adaptive processes those measures are supporting, and therefore where the information has to go and what has to be done with it. supports the identification of problems and the creative generation of solution options. supports two different kinds of investigation: what stratagem to use, and how to execute it. Intervention options (settable parameters) Contingent factors Emergent properties Proxies Indicators Unintended consequences MoS/F other consequences Conceptual Framework Analytical framework MoS/F Proxies Indicators Contingent factors MoP observations Analytical Framework