We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byIsaiah Rollins
Modified over 2 years ago
Informal Learning Measurement John R. Mattox, II, Ph.D. Director of Research KnowledgeAdvisors
Our Promise to You November 13, 20132© 2011, KnowledgeAdvisors KnowledgeAdvisors will improve learning effectiveness within your organization.
KnowledgeAdvisors 3 Experts in metrics that matter KnowledgeAdvisors is a human capital analytics firm. We are the worlds largest provider of learning and talent measurement solutions. November 13, 2013© 2010, KnowledgeAdvisors
Features and Benefits November 13, 20134© 2011, KnowledgeAdvisors
KnowledgeAdvisors Clients 5November 13, 2013© 2011, KnowledgeAdvisors
Human Capital Process Model 6November 13, 2013© 2011, KnowledgeAdvisors
Informal Learning Measurement Approaches 7November 13, 2013© 2010, KnowledgeAdvisors What is Informal Learning Research on Informal Learning tactics Measurement in Informal Learning
Informal Learning 8November 13, 2013© 2010, KnowledgeAdvisors Informal Learning: Knowledge transfer that occurs without the assistance of structured curriculum. Source: KnowledgeAdvisors
What Informal Learning is Supported? 9November 13, 2013© 2010, KnowledgeAdvisors 73%56%54%46%13% % of respondents supporting each type of informal learning # of respondents Source: KnowledgeAdvisors Informal Learning Research, 2009
How Much is Spent on Informal Learning? 10November 13, 2013© 2010, KnowledgeAdvisors % supporting each method $70K$85K$170K$110K Avg spend Source: KnowledgeAdvisors Informal Learning Research, % of L&D budget on Informal Learning
Informal Learning Measurement 11November 13, 2013© 2010, KnowledgeAdvisors Are your Execs asking for quantitative measures? Are you measuring business benefits? While only 21% of respondents indicated that their Executives are asking for quantitative measures, twice that number expect to be asked soon. Source: KnowledgeAdvisors Informal Learning Research, 2009
Measurement Correlates to Budget 12November 13, 2013© 2010, KnowledgeAdvisors Measurement discipline L&D Spend / person COPsM&CVKSEPSS Those who measure $958$168,000$84,000$250,000 Those who dont measure$1004$68,929$82,679$97,917$129,286 Overall$996$71,042$83,026$109,615$167,750 % delta ( over ) -5%143%6%155%93% The group measuring Informal Learning spends less per person on L&D annually. However, their Informal Learning spend is notably higher than the non- measurement group in most areas. We might conclude that measuring impact of Informal Learning enables organizations to demonstrate outcomes and justify greater allocation of L&D $ to these critical areas. Source: KnowledgeAdvisors Informal Learning Research, 2009
Informal Learning Measurement : When? 13November 13, 2013© 2010, KnowledgeAdvisors 1. Become aware / consider 3. Engage 4. Use, learn, practice, contribute 5. Complete and/or recommit At each interaction Periodically At the conclusion 2. Search, access, sign in or join Source: KnowledgeAdvisors Informal Learning Measurement White Paper, 2010
Informal Learning Measurement : How? 14November 13, 2013© 2010, KnowledgeAdvisors Systems Based Web analytics Supporting system statistics Performance data Tools Based Needs analysis Usability studies Feedback links Content ratings Surveys Assessment People Based Observation Interviews Focus groups Case studies High TechHigh Touch Source: KnowledgeAdvisors Informal Learning Measurement White Paper, 2010
Match Method to Timing 15November 13, 2013© 2010, KnowledgeAdvisors MethodAt interaction points PeriodicallyAt conclusion Web analytics X Web feedback X Supporting system data XX Surveys XX Content ratings (or single question) X Usability studies X Interviews (1-1) XX Focus groups X Source: KnowledgeAdvisors
Informal Learning in Metrics that Matter® 16November 13, 2013© 2009, KnowledgeAdvisors Leverage Micropolls and Pop-up surveys for point of interaction on-demand resources performance support systemsc virtual knowledge networks Poll as learners consume the content just in time Utilize thought leading standard surveys for mentoring, performance support, on-demand resource, and community of practice programs Report results by filtering by program, delivery method, and content
Metrics that Matter Easy wizard for administration of informal learning measurement
Metrics that Matter Micro Poll Experience
Metrics that Matter Pop Up Experience
Metrics that Matter Standard Report on Informal Learning
Metrics that Matter Standard Report on Informal Learning
Take-away Information Informal learning is complex Measure successfully by embracing three factors November 13, © 2009, KnowledgeAdvisors Program Components Measurement Tools Appropriate Timing
Take-away Information Evaluating Informal Learning is not simple Multiple components Web content, CoPs, Coaching Multiple measurement tools Micropolls, pop-up surveys, end-of- program evaluations, formal survey Many points in time point of interaction, periodically, end-of- study November 13, © 2009, KnowledgeAdvisors
Recommendations Define the scope of the informal learning that needs to be measured Select the right data collection tools Determine appropriate timing Leverage available systems (e.g., MTM) Seek guidance (e.g., from KnowledgeAdvisors) November 13, © 2009, KnowledgeAdvisors
Contact Information For further information on the information contact: John R. Mattox, II, Ph.D. Director of Research
1 Elements of Compelling Evaluation Reporting Jon K. Price K-12 Evaluation Research Manager.
Dr. John Dzimba Best Practices in Training and Development.
1 Results Based Monitoring (RBM) It is better to be approximately right than precisely wrong - John Maynard Keynes -
Android 11: Google Play for Education Kirk Scott 1.
Program Evaluation: What is it? Brad Rose, PhD. Program Development & Funding Data Collection & Outcome Measurement Feedback & Continuous Improvement Impact.
Kentucky Teacher Internship Program (KTIP) Teacher Performance Assessment Training (TPA)
1 Draft. Not for public distribution – November 2012 Ann-Claire Anderson Susan Finn Miller November 2, 2012.
Quarterly Network Meeting AUGUST 2014 MEASUREMENT & IMPROVEMENT IN LOCAL GOVERNMENT CUSTOMER SERVICE Mystery Shopping Program for Network Members.
BME Teacher Rubric Orientation Thank you to Craven County District Leadership for this powerpoint 8/26/
Copyright © 2006 Bersin & Associates. All rights reserved. Best Practices at John Hancock Financial Services Improving Customer Service through E-Learning.
Database Application Lifecycle Lecture Lectures Objectives Put all the previous lectures into context (Conceptual and Logical Design, Normalisation.
A Career Ladder for Early Education and Out of School Time: A resource for our workforce A Joint Initiative of EEC and BTWIC.
1 Welcome to Module 7 Assessment and Evaluation. 2 Getting Started “From their earliest school experience, students draw life- shaping conclusions about.
Introduction to Performance Measurement for AmeriCorps*VISTA Washington Dulles Hilton September 12-14, 2005.
Capacity development & learning in evaluation Uganda Evaluation Week 19 th to 223 rd May 2014.
Teacher Evaluation in Newark: Evaluator Training August 21 or 22,
Georgia Alternate Assessment Fall Training for the Administration of the GAA.
Customer Assessment Office of Quality Management Office of Research Services National Institutes of Health October 2005.
School Based Assessment and Reporting Unit Curriculum Directorate Assessment.
Best Practices Briefing in Purchase-to-Pay Kurt Albertson, The Hackett Group Jim Anthony, The Hackett Group Bryan DeGraw, The Hackett Group Bill Kilmartin,
Understanding and Using Your Executive View 360 Report Kenneth M. Nowack, Ph.D Ocean Park Blvd, Suite 203 Santa Monica, CA (310) (310)
Notes accompany this presentation. Please select Notes Page view. These materials can be reproduced only with written approval from Gartner. Such approvals.
Dr. Chen, Electronic Commerce Pearson/Prentice Hall & Dr. Chen, Electronic Commerce Chapter 14 E-Commerce Strategy and Global EC.
Understanding and Interpreting Manager View 360 Kenneth M. Nowack, Ph.D Ocean Park Blvd, Suite 203 Santa Monica, CA (310) (310)
PISA OECD Programme for International Student Assessment Science Competencies for Tomorrows World Science competencies for tomorrows world Seeing school.
Annual Professional Performance Reviews - An Overview - David Rothfuss NYSUT Research & Educational Services 1.
BUILD AND GROW YOUR SHAREPOINT BUSINESS INTELLIGENCE (BI) PRACTICE BUSINESS BUILDER BUILD AND GROW YOUR SHAREPOINT BUSINESS INTELLIGENCE (BI) PRACTICE.
Building Better LEAs: Working to improve student outcomes First Nations Education Steering Committee v5 1.
1 Columbus County Leadership Academy Summer 2009 Welcome Introduction Agenda.
1 Best Value Business Model W W W. P B S R G. C O M 2 Who we are: PBSRG Overview Established in 1994 to assist clients in improving the.
© 2016 SlidePlayer.com Inc. All rights reserved.