We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byIsaiah Rollins
Modified over 3 years ago
Informal Learning Measurement John R. Mattox, II, Ph.D. Director of Research KnowledgeAdvisors
Our Promise to You November 13, 20132© 2011, KnowledgeAdvisors KnowledgeAdvisors will improve learning effectiveness within your organization.
KnowledgeAdvisors 3 Experts in metrics that matter KnowledgeAdvisors is a human capital analytics firm. We are the worlds largest provider of learning and talent measurement solutions. November 13, 2013© 2010, KnowledgeAdvisors
Features and Benefits November 13, 20134© 2011, KnowledgeAdvisors
KnowledgeAdvisors Clients 5November 13, 2013© 2011, KnowledgeAdvisors
Human Capital Process Model 6November 13, 2013© 2011, KnowledgeAdvisors
Informal Learning Measurement Approaches 7November 13, 2013© 2010, KnowledgeAdvisors What is Informal Learning Research on Informal Learning tactics Measurement in Informal Learning
Informal Learning 8November 13, 2013© 2010, KnowledgeAdvisors Informal Learning: Knowledge transfer that occurs without the assistance of structured curriculum. Source: KnowledgeAdvisors
What Informal Learning is Supported? 9November 13, 2013© 2010, KnowledgeAdvisors 73%56%54%46%13% % of respondents supporting each type of informal learning # of respondents Source: KnowledgeAdvisors Informal Learning Research, 2009
How Much is Spent on Informal Learning? 10November 13, 2013© 2010, KnowledgeAdvisors % supporting each method $70K$85K$170K$110K Avg spend Source: KnowledgeAdvisors Informal Learning Research, 2009 9% of L&D budget on Informal Learning
Informal Learning Measurement 11November 13, 2013© 2010, KnowledgeAdvisors Are your Execs asking for quantitative measures? Are you measuring business benefits? While only 21% of respondents indicated that their Executives are asking for quantitative measures, twice that number expect to be asked soon. Source: KnowledgeAdvisors Informal Learning Research, 2009
Measurement Correlates to Budget 12November 13, 2013© 2010, KnowledgeAdvisors Measurement discipline L&D Spend / person COPsM&CVKSEPSS Those who measure $958$168,000$84,000$250,000 Those who dont measure$1004$68,929$82,679$97,917$129,286 Overall$996$71,042$83,026$109,615$167,750 % delta ( over ) -5%143%6%155%93% The group measuring Informal Learning spends less per person on L&D annually. However, their Informal Learning spend is notably higher than the non- measurement group in most areas. We might conclude that measuring impact of Informal Learning enables organizations to demonstrate outcomes and justify greater allocation of L&D $ to these critical areas. Source: KnowledgeAdvisors Informal Learning Research, 2009
Informal Learning Measurement : When? 13November 13, 2013© 2010, KnowledgeAdvisors 1. Become aware / consider 3. Engage 4. Use, learn, practice, contribute 5. Complete and/or recommit At each interaction Periodically At the conclusion 2. Search, access, sign in or join Source: KnowledgeAdvisors Informal Learning Measurement White Paper, 2010
Informal Learning Measurement : How? 14November 13, 2013© 2010, KnowledgeAdvisors Systems Based Web analytics Supporting system statistics Performance data Tools Based Needs analysis Usability studies Feedback links Content ratings Surveys Assessment People Based Observation Interviews Focus groups Case studies High TechHigh Touch Source: KnowledgeAdvisors Informal Learning Measurement White Paper, 2010
Match Method to Timing 15November 13, 2013© 2010, KnowledgeAdvisors MethodAt interaction points PeriodicallyAt conclusion Web analytics X Web feedback X Supporting system data XX Surveys XX Content ratings (or single question) X Usability studies X Interviews (1-1) XX Focus groups X Source: KnowledgeAdvisors
Informal Learning in Metrics that Matter® 16November 13, 2013© 2009, KnowledgeAdvisors Leverage Micropolls and Pop-up surveys for point of interaction on-demand resources performance support systemsc virtual knowledge networks Poll as learners consume the content just in time Utilize thought leading standard surveys for mentoring, performance support, on-demand resource, and community of practice programs Report results by filtering by program, delivery method, and content
Metrics that Matter Easy wizard for administration of informal learning measurement
Metrics that Matter Micro Poll Experience
Metrics that Matter Pop Up Experience
Metrics that Matter Standard Report on Informal Learning
Metrics that Matter Standard Report on Informal Learning
Take-away Information Informal learning is complex Measure successfully by embracing three factors November 13, 201322© 2009, KnowledgeAdvisors Program Components Measurement Tools Appropriate Timing
Take-away Information Evaluating Informal Learning is not simple Multiple components Web content, CoPs, Coaching Multiple measurement tools Micropolls, pop-up surveys, end-of- program evaluations, formal survey Many points in time point of interaction, periodically, end-of- study November 13, 201323© 2009, KnowledgeAdvisors
Recommendations Define the scope of the informal learning that needs to be measured Select the right data collection tools Determine appropriate timing Leverage available systems (e.g., MTM) Seek guidance (e.g., from KnowledgeAdvisors) November 13, 201324© 2009, KnowledgeAdvisors
Contact Information For further information on the information contact: John R. Mattox, II, Ph.D. Director of Research +1 615 591 1032 email@example.com www.knowledgeadvisors.com
9th Northumbria International Conference on Performance Measurement in Libraries and Information Services York, UK. Aug. 22 nd – 26th, 2011 Leifang HeLeifang.
©2005, Harris Interactive Inc. All rights reserved. Cedar Rapids Community School District Results - Key Overall District Findings.
Introduction to Executive Reporting for CLOs Tamar Elkeles Vice President of QUALCOMMs Corporate Learning Center Version: 26-Feb-11.
County of Fairfax, Virginia Department of Transportation Proposed Transportation Funding Policy Changes Fairfax County Department of Transportation March.
Who volunteers? Volunteering trends based on government data: A briefing from nfpSynergy February 2011 Telephone: (020)
The Open University A Case Study
Copyright © 2002 by The McGraw-Hill Companies, Inc. All rights reserved Chapter The Future of Training and Development.
Board Self-Assessment: May 2013 Benchmark Report NCMA Governance Committee Penny White, Chair.
Probation Reporting Contact Center (PRCC)
0 - 0.
Family Learning 1st February 2011 Katy Burns Katy Burns - FL Feb 1 11 CQFW.
1 Independent Public Schools. 2 The Independent Public Schools initiative honours the State Government’s commitment to hand greater control to schools.
Technical Assistance Workshop Business Services July 22, :00 a.m. July 26, :00 p.m.
The use of Business Mentoring by Small and Medium Sized Enterprises A Summary of Data and Policy Development 21 December 2011.
ICP 7-th Regional Coordinators Meeting World Bank, Washington D.C.
Educator Evaluation Reform in New Jersey November 16, 2012.
Settlement Program Logic Model
CS4026 Formal Models of Computation Running Haskell Programs – power.
© 2017 SlidePlayer.com Inc. All rights reserved.