We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byIsaiah Rollins
Modified over 3 years ago
Informal Learning Measurement John R. Mattox, II, Ph.D. Director of Research KnowledgeAdvisors
Our Promise to You November 13, 20132© 2011, KnowledgeAdvisors KnowledgeAdvisors will improve learning effectiveness within your organization.
KnowledgeAdvisors 3 Experts in metrics that matter KnowledgeAdvisors is a human capital analytics firm. We are the worlds largest provider of learning and talent measurement solutions. November 13, 2013© 2010, KnowledgeAdvisors
Features and Benefits November 13, 20134© 2011, KnowledgeAdvisors
KnowledgeAdvisors Clients 5November 13, 2013© 2011, KnowledgeAdvisors
Human Capital Process Model 6November 13, 2013© 2011, KnowledgeAdvisors
Informal Learning Measurement Approaches 7November 13, 2013© 2010, KnowledgeAdvisors What is Informal Learning Research on Informal Learning tactics Measurement in Informal Learning
Informal Learning 8November 13, 2013© 2010, KnowledgeAdvisors Informal Learning: Knowledge transfer that occurs without the assistance of structured curriculum. Source: KnowledgeAdvisors
What Informal Learning is Supported? 9November 13, 2013© 2010, KnowledgeAdvisors 73%56%54%46%13% % of respondents supporting each type of informal learning # of respondents Source: KnowledgeAdvisors Informal Learning Research, 2009
How Much is Spent on Informal Learning? 10November 13, 2013© 2010, KnowledgeAdvisors % supporting each method $70K$85K$170K$110K Avg spend Source: KnowledgeAdvisors Informal Learning Research, 2009 9% of L&D budget on Informal Learning
Informal Learning Measurement 11November 13, 2013© 2010, KnowledgeAdvisors Are your Execs asking for quantitative measures? Are you measuring business benefits? While only 21% of respondents indicated that their Executives are asking for quantitative measures, twice that number expect to be asked soon. Source: KnowledgeAdvisors Informal Learning Research, 2009
Measurement Correlates to Budget 12November 13, 2013© 2010, KnowledgeAdvisors Measurement discipline L&D Spend / person COPsM&CVKSEPSS Those who measure $958$168,000$84,000$250,000 Those who dont measure$1004$68,929$82,679$97,917$129,286 Overall$996$71,042$83,026$109,615$167,750 % delta ( over ) -5%143%6%155%93% The group measuring Informal Learning spends less per person on L&D annually. However, their Informal Learning spend is notably higher than the non- measurement group in most areas. We might conclude that measuring impact of Informal Learning enables organizations to demonstrate outcomes and justify greater allocation of L&D $ to these critical areas. Source: KnowledgeAdvisors Informal Learning Research, 2009
Informal Learning Measurement : When? 13November 13, 2013© 2010, KnowledgeAdvisors 1. Become aware / consider 3. Engage 4. Use, learn, practice, contribute 5. Complete and/or recommit At each interaction Periodically At the conclusion 2. Search, access, sign in or join Source: KnowledgeAdvisors Informal Learning Measurement White Paper, 2010
Informal Learning Measurement : How? 14November 13, 2013© 2010, KnowledgeAdvisors Systems Based Web analytics Supporting system statistics Performance data Tools Based Needs analysis Usability studies Feedback links Content ratings Surveys Assessment People Based Observation Interviews Focus groups Case studies High TechHigh Touch Source: KnowledgeAdvisors Informal Learning Measurement White Paper, 2010
Match Method to Timing 15November 13, 2013© 2010, KnowledgeAdvisors MethodAt interaction points PeriodicallyAt conclusion Web analytics X Web feedback X Supporting system data XX Surveys XX Content ratings (or single question) X Usability studies X Interviews (1-1) XX Focus groups X Source: KnowledgeAdvisors
Informal Learning in Metrics that Matter® 16November 13, 2013© 2009, KnowledgeAdvisors Leverage Micropolls and Pop-up surveys for point of interaction on-demand resources performance support systemsc virtual knowledge networks Poll as learners consume the content just in time Utilize thought leading standard surveys for mentoring, performance support, on-demand resource, and community of practice programs Report results by filtering by program, delivery method, and content
Metrics that Matter Easy wizard for administration of informal learning measurement
Metrics that Matter Micro Poll Experience
Metrics that Matter Pop Up Experience
Metrics that Matter Standard Report on Informal Learning
Metrics that Matter Standard Report on Informal Learning
Take-away Information Informal learning is complex Measure successfully by embracing three factors November 13, 201322© 2009, KnowledgeAdvisors Program Components Measurement Tools Appropriate Timing
Take-away Information Evaluating Informal Learning is not simple Multiple components Web content, CoPs, Coaching Multiple measurement tools Micropolls, pop-up surveys, end-of- program evaluations, formal survey Many points in time point of interaction, periodically, end-of- study November 13, 201323© 2009, KnowledgeAdvisors
Recommendations Define the scope of the informal learning that needs to be measured Select the right data collection tools Determine appropriate timing Leverage available systems (e.g., MTM) Seek guidance (e.g., from KnowledgeAdvisors) November 13, 201324© 2009, KnowledgeAdvisors
Contact Information For further information on the information contact: John R. Mattox, II, Ph.D. Director of Research +1 615 591 1032 email@example.com www.knowledgeadvisors.com
9th Northumbria International Conference on Performance Measurement in Libraries and Information Services York, UK. Aug. 22 nd – 26th, 2011 Leifang HeLeifang.
©2005, Harris Interactive Inc. All rights reserved. Cedar Rapids Community School District Results - Key Overall District Findings.
Introduction to Executive Reporting for CLOs Tamar Elkeles Vice President of QUALCOMMs Corporate Learning Center Version: 26-Feb-11.
County of Fairfax, Virginia Department of Transportation Proposed Transportation Funding Policy Changes Fairfax County Department of Transportation March.
Who volunteers? Volunteering trends based on government data: A briefing from nfpSynergy February 2011 Telephone: (020)
The Open University A Case Study Veronica Barnes & Charlotte Bruce-Foulds The Open University The OCM 1.
Copyright © 2002 by The McGraw-Hill Companies, Inc. All rights reserved Chapter The Future of Training and Development.
Board Self-Assessment: May 2013 Benchmark Report NCMA Governance Committee Penny White, Chair.
Probation Operations Department of Corrections GEORGIA Georgia Department of Corrections Probation Reporting Contact Center (PRCC) Presented to: Council.
Family Learning 1st February 2011 Katy Burns Katy Burns - FL Feb 1 11 CQFW.
1 Independent Public Schools. 2 The Independent Public Schools initiative honours the State Government’s commitment to hand greater control to schools.
Technical Assistance Workshop Business Services July 22, :00 a.m. July 26, :00 p.m.
Interstate Statistical Committee of the Commonwealth of Independent States (CIS-STAT) CIS ICP – September 2012 Status Report Andrey KOSAREV ICP 7-th Regional.
The use of Business Mentoring by Small and Medium Sized Enterprises A Summary of Data and Policy Development 21 December 2011.
Educator Evaluation Reform in New Jersey November 16, 2012.
1 Ultimate Outcomes Settlement Program Logic Model Immediate Outcomes Program Components CIC Strategic Outcome 3 Outputs Intermediate Outcomes Policy Development,
CS4026 Formal Models of Computation Running Haskell Programs – power.
Slide 1 Insert your own content. Slide 2 Insert your own content.
1 Welcome to Module 7 Assessment and Evaluation. 2 Getting Started “From their earliest school experience, students draw life- shaping conclusions about.
Welcome School Improvement Advisory Committee Members We are happy youre here!
1 Elevators, Airbags & FM Radio Communication Planning Innovation and Next Practice Division (DEECD) Design Teams Professional Development Workshop February.
Copyright © Jigsaw 1 Marketing Cloud Manifesto First Draft Submitted by Kevin Akeroyd COO/CMO JigsawOctober 21, 2009.
© 2009 GVM Solutions Enterprise Learning Diagnostic (ELD) High Level Overview 1.0 Alignment and Governance 1.1 Learning Governance 1.2 Curriculum Alignment.
Nurulquran.com nurulquran.com 11.
Copyright 2003 Cuyahoga Community College District Knowledge Management: Making it Fly in Higher Education Presenter: Amy C. Eugene Director, Knowledge.
OCCC AtD Meeting, September 16, 2009 Mr. Stuart Harvey 1.
Coordinated Veterans Care (CVC) Program Social Assistance and its delivery through the Veterans Home Care Program 1.
About Certiport Worldwide administrator of the Microsoft Business Certification program: –Microsoft Business Certification Credentials Microsoft Office.
EXIT INTERVIEW & SURVEY SOLUTIONS INFORMATION ABSTRACT TTMS-PEOPLEPROFIT TTMS-PEOPLEPROFIT.
2011 FRANKLIN COMMUNITY SURVEY YOUTH RISK BEHAVIOR GRADES 9-12 STUDENTS=332.
A Roadmap to Successful Implementation Management Plans.
1 GIS for Water Maximizing the Benefits of GIS Susan Ancel - Director Water Distribution and Transmission EPCOR Water Services Inc. Geospatial World Forum.
Program Evaluation: What is it? Brad Rose, PhD. Program Development & Funding Data Collection & Outcome Measurement Feedback & Continuous Improvement Impact.
1 Leading the Learning Function September 14, 2009 Dr. Gretchen Van der Veer Director, Office of Leadership Development and Training Corporation for National.
2011 WINNISQUAM COMMUNITY SURVEY YOUTH RISK BEHAVIOR GRADES 9-12 STUDENTS=1021.
Goals of Workshop District Education Technology Plan Goals 8 goals aligned to State/National Education Technology Plans Strategies to meet challenges.
1 LEGAL SERVICES CORPORATION Technology Initiative Grant Program Developing and Submitting TIG Project Evaluation Plans Bristow Hardin, LSC,
Dr. Deirdre Hughes Founding Director of iCeGS & Institute of Career Guidance: Vice-President 25 th March 2009 Building the UK evidence- base for careers.
WEEK 1 You have 10 seconds to name…
School Based Assessment and Reporting Unit Curriculum Directorate Assessment.
©2011 1www.id-book.com Evaluation studies: From controlled to natural settings Chapter 14.
Tennessee Higher Education Commission Higher Education Recommendations & Finance Overview November 15, 2012.
1 Prolix Innovation: Learning Environment Assessment for Performance Improvement Bernd Simon With Contributions from: Barbara Huber Claudia Röthlin Clemens.
Learning from the Individual Budgets for Families with Disabled Children Pilots and looking to the SEND Pathfinders Graham Thom and Meera Prabhakar 7 th.
An Evaluation of Economic and Non-economic Techniques for Assessing the Importance of Biodiversity and associated Ecosystem Services to People in Developing.
1 January 8, The mission of the County of Santa Clara is to plan for the needs of a dynamic community, provide quality services, and promote.
TCCI Barometer March “Establishing a reliable tool for monitoring the financial, business and social activity in the Prefecture of Thessaloniki”
© 2017 SlidePlayer.com Inc. All rights reserved.