Needs Assessment: Collecting information, making decisions, and accomplishing results Ryan Watkins, Ph.D. George Washington University Maurya West Meiers WBI Evaluation Group Presentation to the Knowledge and Learning Board Dec. 11, 2007

2 Needs Assessments Help Us… Collect useful information that can inform our decisions Link the results we want to accomplish to our decisions about “what to do” Consider our alternatives and options Verify that our activities will lead to desired results Create consistency in decision making by implementing systematic processes

3 Needs Assessments Help Us Avoid… “What we really need is training on XYZ.” “But that is the way we have always done it here.” Training that isn’t aligned with World Bank priorities Solutions in search of problems Answers that are simple, straightforward, acceptable, understandable… and yet wrong

4 Why Needs Assessment Provides a systematic process to guide decisions. Provides justification for decisions before they are made. It is scalable for any size project, time frame, or budget. Offers a replicable model that can be applied by novices or experts. Provides a systemic perspective for decision makers. Allows for interdisciplinary solutions for complex problems.

5 Many Needs Assessments Disciplines – Medical (Health) Needs Assessments – Community Needs Assessments – Organizational Needs Assessments – Individual-Decision Needs Assessments

6 Three Types of Organizational Needs Assessments Strategic Needs Assessment – Focus on needs of those external to the organizational (e.g., clients, communities, countries) – Alignment of societal goals with organizational objectives Tactical Needs Assessments – Focus on organizational performance and contributions – Alignment of organizational objectives with programs and projects Operational Needs Assessments – Focus on individual or team performance – Alignment of program and projects with individual or team performance objectives – Guide the development of pragmatic learning plans

7 Needs Assessments and Results Chains Gap The Results We Should Be Accomplishing The Results We Are Accomplishing Current Results Desired Results Impacts Outcomes Activities Outputs Inputs Impacts Outcomes Activities Outputs Inputs Gap Strategic Needs Assessment Tactical Needs Assessment Operational Needs Assessment

8 Needs Assessments and Results Chains Performance Expectations (Individual or Team) Developing Learning Plans Calendar of Learning Events Performance Expectations (Organization) Performance Expectations (Societal) Impacts Outcomes Activities Outputs Inputs Plan Measure

9 No more starting with… We need to train them on… You need to buy the latest release of… We need a course on… They need a new attitude about… We really need do be doing…

10 Aren’t we already doing this? Maybe – Example, “My team should go to training X this year because they will have to be able to do Y next year.” Systematic and consistent needs assessments are, nevertheless, better since they… – Systematically align desired results with plans and activities – Use performance expectations to guide decisions – Examine training and non-training alternatives – Provide consistent processes from manager to manager

11 Where to Begin Phases of Needs Assessment Pre-Assessment – Planning for success Assessment – Collecting data – Turning data into information and knowledge Post-Assessment – Making decisions

12 Continuum of Assessments Not every needs assessment has to be complex Scope of the assessment should be based on the scope of the project Small needs assessment Large needs assessment Small Project Large Project

13 Tools for Collecting Information and Making Decisions Focus Groups - DACUM Focus Groups - Delphi Focus Groups - Nominal Focus Groups – Straw Votes Interviewing Task Analysis Cognitive Task Analysis Card Sorts Tabletop analysis SWOT + Causal Utility Dual-response surveys Johari Window Concept mapping Fault Tree Diagrams Fishbone Diagrams Multi-attribute Utility Analysis Force Field Analysis Risk and Resilience Analysis Scenarios Systematic Document Review Performance Observation Guided Expert Review

14 Performance System WHAT WHYWHATHOW WHAT Required Results Current Results Needs Assessments Analysis Performance Examples: Program, Project, Learning Plan, Learning Activity, Mentor, Recruitment Plan Objectives

15 Training Sessions: Principles and Practice Knowledge Base Consulting Services & Team Support Training Sessions: Practical Application Needs Assessment Series: Multi-Method Approach

16 Training Sessions Basics of conducting needs assessment Framework for conducting a needs assessment Aligning needs assessment with program logic Managing the process of needs assessment Multiple strategies for using needs assessment to accomplish intended results Principles and Practice

17 Training Sessions Focus: Practice with data collection and analytical tools for decision-making – SWOT with Causal Utility Analysis – Dual-Response Surveys – JOHARI Window – Task Analysis – Qualitative Data Analysis Practical Application

18 Support for Implementation Materials posted for just-in-time learning Readings: tools and techniques FAQ and Discussion Boards Coming attractions (e.g., sample surveys, question database, etc.) Online Knowledge Base

19 Support for Implementation WBI Evaluation Group team, first stop for advice Consultant available for advisory services With HRSLB, support to teams on learning plans Consulting Services & Team Support