Presentation on theme: "Learning Analytics. How are we doing in leadership training?"— Presentation transcript:
How are we doing in leadership training?
Training’s Impact Good News & Bad News
First the Good News 1. Top Training 100 companies Training investment = 4% of payroll (Industry Average 2%) 92% Evaluate business impact to Level 4 (Industry Average 11%) ( Training magazine, March 2003)
Good News (…continued) 2. ASTD 3-year Study (576 Companies) Impact of Training Investment on Total Shareholder Return (TSR) IMPACT ON TOTAL SHAREHOLDER RETURN (TSR) FIRMS IN TOP HALF OF RANKING: - TSR 86% higher than firms in bottom half of ranking - TSR 45% higher than S&P 500 firms
Now the Bad News… Most of your training investment is wasted
International Perspectives on Learning and Performance ASTD, Robinson & Robinson 1996 “On average, less than 30 % percent of what people learn (in training) actually gets used on the job.”
Transfer of Training Broad and Newstrom, 1992 "Most of the investment in organizational training...is wasted because most of the knowledge and skills gained...(well over 80 percent by some estimates) is not fully applied by those employees on the job.”
Baldwin & Ford, 1988 Reconfirmed by Ford & Weinstein, 1997 “American industries annually spend more than $100 billion on training…not more than 10% of the expenditures actually result in transfer to the job."
Why? Did learner understand management’s expectations? Was it the training? Was it the instructor? Lack of support on the job? Lack of incentives to apply new skills?
We don’t know what we don’t know. EVALUATION TRENDS Level 1 > 80% Level 2 < 50% Level 3 9 – 17% Level 4 7% Level % 2002 ASTD State of the Industry
Why don’t organizations evaluate more? “Its not a lack of interest or importance —but rather a lack of tools and expertise.” The Time is Now Josh Bersin, 2003
Training Analytics Part of the trend to Enterprise-wide HR technologies
Top Reasons for LMS Purchase 2001 Managing Classroom Logistics 2002 Migration to eLearning
Why did you purchase your Learning Management System (LMS)? Survey, July ,000 Respondents Learning & Training Innovations (LTI) &- Bersin & Associates % % % %
Leverage Technology Data Collection Data is collect evaluation data over the Web or via Stakeholders get realtime, online access to meaningful reports Cost of learning measurement becomes pennies per learner Time is saved in collection, processing and reporting to allow for diagnostics and continuous improvement Use baseline measures from the system to determine where more detailed data analysis and learning measurement is needed
The Evaluation Flow Data Reporting Post Event Survey Follow Up Survey Manager Survey Phillips ROI Input Templates Paper, web, LMS Integration’ ‘Hosted’ solution Database creation Central storage Data security Raw data access Standard reports Push alerts Phillips ROI report Custom query Custom reports Analytical tools Data Processing Aggregating of data Filtering of data Convert to metrics Because data collection, processing and reporting is automated, you have more time to analyze the data and turn it into actionable business intelligence to: 1) Improve your learning programs 2) Demonstrate value to your stakeholders Data StorageData Collection
Data can be Collected at all Levels Level 1 Level 2 Level 3 Level 4 Level 5 Did they like it? Did they learn? Do they use it? What were the results? What’s the ROI?
Data Collection Tools Post Test Follow up Lykert Scale Learner Comments
Learning Levels Scorecard Benchmark across the key performance indicators on your evaluation forms that link back to the 5 levels of learning measurement. Compare the actual performance to goals and to internal or external benchmarks so you properly monitor using a balanced scorecard approach.
Performance to Goals
Slice & Dice View Reaction, Learning, Application, Business Results, ROI By Learning Event By Location or Region By Training Program By Internal Client By Training Provider
Drill Down by Course, Vendor, Instructor, Location…
Which Vendors Provide Value?
Who Passed the Test?
Which Customers are Getting the Best Value?
Is Training Aligned to Business goals?
What Impact did the course have on the job?
What do managers think? Managers can provide feedback on how the training is impacting their employees.
Learner Comments by Course/Event
Learner Comments by Instructor
Phillips ROI Tool Set
What is ROI on My Training Investment? The scorecard is a management tool to showcase value to key stakeholders. This report shows you each level of learning and the Key Performance Indicators within each level. At level five you actually produce quantitative ROI metrics including: Benefit to Cost Ratio Payback Period ROI%
Track Critical Measures Ensure Regulatory Compliance Professional Certifications Safety Training
The Real Value Proposition Fact-based, data driven insight into the impact of your learning investments on business goals.
“You can’t manage what you don’t measure” Peter Drucker
“If you’re not keeping score, it’s just practice.” DPR Construction (Ranked # 60) Training’s Top 100 For More Information: (905)