Return on Learning Metrics
APRIL 5, 2016
Measuring Learning” has been plagued by this issue since decades. And as for traditional methods of learning: well, they rarely, if ever, got measured! In this whole maze of RoI calculation, one critical component of measurement got forgotten – the individual (who was learning) and how that learning was influencing business outcomes favorably.
Top 10 Training Metrics
Your Training Edge
NOVEMBER 1, 2012
If you’re not sure where to start, these Top Ten Training Metrics can help. If you are a training manager or company stakeholder looking for ways to measure the effectiveness of your programs, these ten metrics are a great place to start. Dollar figures and unit sales make good metrics, but be sure to balance any metric with other factors that can influence sales numbers. If your training programs teach skills, look to management’s efficiency metrics, as a baseline, before and after the training intervention. One: Increased retention.
JUNE 4, 2014
Years ago, when we built an adaptive learning system (it would profile you versus me, and then even if we took the same course we’d be likely to have a different experience), we realized we’d need to profile learning a priori. The underlying mission given us by my CEO was to help learners understand themselves as learners, and use that to their advantage. So, in addition to asking the questions, we’d share with them what we’d learned about them as learners. Like others, I have been seduced by the “what X are you” quizzes on FaceBook.
Mobile learning and personal metrics
Learning with e's
OCTOBER 11, 2013
The rise is also due to people''s desire to develop their learning informally. There are formal contexts for mobile learning, but it is in the leisure time/travelling/down time that mobile learning still comes to the fore. Photo by Steve Wheeler Mobile learning and personal metrics by Steve Wheeler is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0
Move Beyond Learning to Applying: A Modern Management Development Program
1 kineo.com firstname.lastname@example.org 312-846-6656 Hard to believe that it’s been almost 20 years since the term “eLearning” entered the corpo- rate learning lexicon. learning nuggets. or “very ready” in learning and development in. metrics in the workplace? Learning. just on learning but on learning and doing. Instead, they judge value by hard metrics.
Caution Slippery When Metrics
JUNE 4, 2015
Mark Twain’s popularized phrase, “There are three kinds of lies: lies, damned lies and statistics,” may seem like an odd way to lead into something that supports the use of metrics, but it highlights the fact that just because there’s a bar graph, trend line or something else having to do with numbers, that doesn’t mean a set of metrics is infallible. Not to suggest that metrics are a bad idea and emails that mention them can be happily deleted from your inbox, but they do have pitfalls that consumers of these statistics need to be aware of.
How Does Your LMS Metrics Measure Up?
OCTOBER 15, 2014
It’s a sad statistic: LMS are not measuring metrics as expected! Intelligent metrics are needed for intelligent systems. Online training providers and schools are now looking into external metric measuring tools to integrate in their existing LMS infrastructure. If you are a TalentLMS user you don’t have to look for external metric measuring tools! Opinion metrics roi
Social Media Metrics
FEBRUARY 1, 2011
I continue to get asked about social learning metrics. Until we get around to a whitepaper or something on metrics, here’re some thoughts: Frankly, the problem with Kirkpatrick (sort of like with LMS’ and ADDIE, *drink*) is not in the concept, but in the execution. As he would say, stopping at level 1 or 2 is worthless. This is true whether you’re talking about formal learning, informal learning, or whatever. Metrics for informal learning aren’t rocket science, but instead mapping of best principles into specific contexts.
ROI and Metrics in eLearning
OCTOBER 16, 2007
I'm working on an article around the use of ROI and metrics in eLearning. I did a quick search for resources and here's what I found. Kirkpatrick's Level 3: Improving the Evaluation of E-Learning Level 3 evaluations measure whether the there was an actual transfer of learning to the actual work setting. This level of evaluation will increase the visibility of learning and development efforts, because successful implementation of Level 3 evaluation Internet Time Blog: ROI is toast. There are hard and soft cost savings associated with e-learning. ROI is toast.
3 Important Video Metrics to Improve ROI
FEBRUARY 4, 2015
If you’re using video in hopes of pushing your business forward, you need to spend your time measuring the right metrics. Here are 3 important metrics you should be measuring in order to leverage your business with video. 1. Rewatches. This metric can be used to create targeted email lists or to assist in making a sale. 2. Engagement Rate. This metric is a good time-saver because it indicates which leads are most interested; so, you can focus solely on honing those relationships. Contact us today and learn how your company can improve ROI! .
Training Mojo: How to Align Training Metrics with Company Metrics
Your Training Edge
SEPTEMBER 13, 2012
Summary: Training metrics are vital to your department’s operations, but if they aren’t aligned with the company, you’re creating confusion and an inability to measure. Follow five steps to help you align your department’s metrics with the company’s metrics. But, if your metrics do not align with the company’s overall metrics, how can you measure your department’s actual contribution? Here are a few simple steps to help you align your metrics with the company. First you have to know what the company metrics are.
Hours of Glower: The Increasing Obsolescence of the Metric of Training Hours
JUNE 8, 2016
The availability and accessibility of training content is greater than it ever has been, thanks to the use of technology, and we have e-learning, virtual classrooms, videos and mobile learning that can either supplant, augment, or support traditional instructor-led training (ILT). While L&D functions have adapted some training evaluation metrics to account for new learning technologies, the common metrics we rely on were largely developed in the era of ILT and may be increasingly subject to interpretive problems.
5 Unknown Ways You're Wasting Your Training Budget
Research shows that adults learn. According to the Learning to Lead study of over 1,000 employees by Oxford. Strategic Consulting and CMI, 80% of managers say their company is failing to use digital learning. 7Solution: Incorporate digital learning for improved results According to the Deloitte University Press Global Human. According to that same Learning to Lead.
MOOCs for Corporate E-learning
APRIL 10, 2015
What started as an initiative by the Stanford University in 2011 has quickly found its applications as a learning medium in educational institutions and corporates alike. Here’s why MOOCs work well for e-learning in these organizations –. Continuity of learning – One of the biggest advantages of MOOCs is that they make the learning process continuous. Similarly, Yahoo!
The Top 5 Things Organizations need for Mobile Learning
Your Training Edge
APRIL 12, 2016
My previous articles, you must have gone through surely depicted the emergence and penetration of mobile learning in learning and development industry, as one of the means of achieving an advanced leaning experience. Like me, if you have also been engaged in this industry, you would always have immense understanding and recognition for the direction where the learning is led.
New MOOC Research: What the Findings Mean for Corporate Training
Your Training Edge
MAY 7, 2015
MOOCs generate a huge amount of data, which can be collected and analyzed to gain insights into how people learn, what teaching methods are most effective, and many other areas related to learning. Here we’ll review some of the new research that has come out of MOOCs and other technology-enabled learning environments and explore what the findings mean for corporate training.
What Are Your Training Metrics Actually Measuring?
Your Training Edge
JULY 10, 2015
Much has been written on the subject and many experts have weighed in on what they consider to be the most crucial training metrics ( here are my top 10 ). The skills and knowledge learned during the training “are not applied on the job and thus have no impact.”. Still others have argued for separating behavior metrics from performance metrics, and other modifications.
The nature of digital influence
MAY 13, 2012
Earlier this year I was honoured to scrape into Bob Little’s Asia-Pacific’s list of e-learning movers and shakers. This list “is compiled on the basis of a person’s perceived current influence on the e-learning industry – as a practitioner, commentator, facilitator and/or thought leader.” All this got me thinking, what is the nature of influence?
Microlearning Whitepaper: Small Bites, Big Impact
corporate Learning & Development inside out. employee learning challenge is ensuring that what is taught is actually understood and. In the next 12 to 24 months, many businesses plan to increase their spending on learning. corporate Learning & Development. Microlearning is a technique of delivering learning content in short, bite-sized bursts (from. learning path.
A conversation on measurement and metrics (#ASTDLN)
APRIL 24, 2012
These are my notes from the final workshop session at ASTD Learn Now in. conversation on metrics and measurement. The things that we currently measure about learning are things that the learner doesn't really care about. (% of course completions, pass/fail rate, # student days, etc.). When we measure the first two moments of learning need (new and more) we can measure with knowledge & skills gain -- certification, demonstrable skills, compliance. perception of critical business actions – these aren’t the learning team’s. San Francisco. link]. impact?
Viplav Baxi Meanderings
JANUARY 16, 2011
My observations were: Organizations use LMS metrics to measure employees’ learning and development and derive RoI from training initiatives. The fundamental question asked is “did employees learn? or in predictive terms “can employees perform? – whether it is to demonstrate compliance to legal requirements, track whether an individual is progressing as per the development plan or to certify them for skills. There is a choice involved that, on a larger scale, impact the metrics that the LMS collects. Let us look at time spent.
The numbers game
Learning with e's
APRIL 15, 2015
But not all teachers do, and I should point out that there is a big difference between assessment of learning and assessment for learning. Assessment of learning focuses largely on the student''s work and offers metrics - awarding a grade with a numerical value - that reflect how the work is measured against specific criteria. Both, do I hear you say? Unported License.
Measuring Client Performance is Key Metric for Training
AUGUST 6, 2013
What we’ve learned over several years of studying what makes a great training organization, is that the single most important metric for how well a training department is performing does not come from within, but rather from the client. The single most important reason corporate training organizations exist is to improve the performance of the business. Training departments are highly competent at measuring a student’s performance during a class or after going back to work. Okay, so the message sounds straightforward. think the training industry is at a crossroads.
4 Ways to Close the Learning-Doing Gap for Front-Line Managers [GUIDE]
LEARNING-DOING GAP FOR. learning-doing gap. We puzzled over the learning-doing gap and this led us to define a. hope is relevant in many other situations where there’s a learning- doing gap). their learning and development. OF FORTUNE 500 CEOS WANT TO KNOW THE BUSINESS IMPACT OF THEIR LEARNING. transfer what they learn to the job –. learning program.
The nature of digital influence
MAY 13, 2012
Earlier this year I was honoured to scrape into Bob Little’s Asia-Pacific’s list of e-learning movers and shakers. This list “is compiled on the basis of a person’s perceived current influence on the e-learning industry – as a practitioner, commentator, facilitator and/or thought leader.” Some readers will scoff at my line of reasoning and will instead promote the use of objective metrics to measure influence. Nonetheless, 90% of Bob’s e-learning movers and shakers have a Klout Score of 40 or more. Maybe, indirectly.
Do You Know How Successful Your eLearning Program Really Is?
JANUARY 15, 2015
In the end, I was left unsatiated, with the feeling that while the attendees had all had a good time, no real learning had actually taken place. We must remember that the ultimate goal of a training course is to learn. There are many different approaches to evaluating the effectiveness of an eLearning course, but they all share a common first step: identifying success metrics.
Getting Serious About Measurement: Metrics for Social Learning Communities
AUGUST 16, 2011
The first rule of social learning: Learning will occur whether or not you’re tending to learners’ every need. The second rule of social learning: You can, however, add value by connecting people, organizing information and adding content. For How Tos, read our series on How to Create a Social Learning Environment.). Social Learning
What Gets Measured Gets Done.Revisited
The Peformance Improvement
NOVEMBER 1, 2012
An organization has to do something with those metrics in order to “get done” what needs to get done, i.e., organizational learning, performance improvement, and change. The act of measuring things like sales, customer service, product quality, teamwork, employee engagement, or learning, does not necessarily mean that anything will be done differently. Are they managed well?
7 Secrets for Measuring Training Program ROI with People Analytics
Recruitment Employee Retention Employee Performance Employee Insights Measure And Suggest Training Manager Effectiveness Enable Managerial Coaching People Analytics Insights How To Get Started With People Analytics Engage Learning & Development + Managers To Use. Analytics software has enabled us to track it, store it, and learn from it. Machine Learning describes a. Measuring.
Interesting Gamification Infographic
NOVEMBER 5, 2013
The Business of Gamification Infographic; The Business of Gamification Infographic Powered by Demand Metric. Powered by Demand Metric – See more at: [link]. To learn more about gamification, check out these two books – See more at: [link].
The New Metric: Compound Learning Rate
DECEMBER 14, 2011
told him it was a person who knew a lot about something and learned more everyday. Brain Corporate Learning Education future of learning Learning Social LearningA few weeks ago, my nephew asked me what the word “expert” means. When I answered, he nodded and asked “so am I an expert about superheroes yet?” It made me think about how that question would translate [.].
Why We Should Stop Talking About ROI in Training
APRIL 4, 2012
For as long as Return on Investment, or ROI , has been prevalent concept in business, it’s also been a fixture of workplace learning and performance. Here’s a look at the reasons why, and how training and learning in the workplace truly ought to be measured. Level 2: Learning. We Don’t Need New Metrics. Reaction and learning are training department terms.
Useless vs. Useful Learning Data
JANUARY 29, 2016
An Interview with Learning & Performance Consultant JD Dillon on metrics L&D should value to prove learning success in business. recently had the pleasure of speaking with JD Dillon (pictured right), an experienced, active and well-respected proponent for improving corporate learning and development. Learning MeasurementLevel 1 survey feedback.
Boost your L&D visibility & credibility – The Annual Learning Report
NOVEMBER 18, 2015
Both desk research and recent interviews with 50+ CLOs underline that even today, many of the biggest corporate learning functions struggle to show their added value. This article enables you to create your own Annual Learning Report, offering an opportunity to boost your credibility and visibility for key business stakeholders. Credible metrics for L&D’s performance.
Measure what’s important
JUNE 10, 2013
Because they’ve learned a narrow view of Return on Investment, namely ROI as seen through the eyes of a bank loan officer. Just Jay Metrics of organizational learning In the last twenty years of the twentieth century, investors shifted from Industrial Age thinking to Knowledge Era thinking. The shift changed how owners value businesses. Take Google as an example.
Playing by numbers
APRIL 22, 2012
The theme of last week’s Learning Cafe in Sydney was How to Win Friends and Influence Learning Stakeholders. There’s no shortage of advice out there telling us to learn the language of finance, because that’s what the CEO speaks. And that makes sense to me. Show me the money. – but it’s not what motivates them day to day.
Checklist for Online Courses
SEPTEMBER 22, 2014
5-10 learning objectives , and per learning objective: 500-750 words (¾ – 1½ typed pages) 4-6 minutes of spoken audio 2-4 presentation slides + 1-3 context-rich interactive exercises or examples. CONTENT & WRITING STYLE. Content is accurate. Content is complete and appropriate , given the target audience, learning objectives, and stated regulatory requirements. Thought progression is logical and organized. Writing level is appropriate for the audience. How To Strategies Tips and Tricks authoring checklists elearning Laura metrics planning
Return on Intangibles
OCTOBER 6, 2013
This article appears in the October 2013 issue of Chief Learning Officer. Understanding learning’s value depends on measuring what can’t be touched. . That’s why Return on Intangibles is the most important metric in the CLO’s toolkit. Because they’ve learned a narrow view of Return on Investment, namely ROI as seen through the eyes of a bank loan officer. Management Innovation Metrics of organizational learning Profit In his marvelous book Intellectual Capital , Tom Stewart asked, “ What’s new? Intellectual capital comes in several forms.
Reputation in Social Learning Technologies
SEPTEMBER 27, 2011
Reputation in social learning technologies is what people use as an indicator of trust, value and usefulness. When a person is in search of an answer to a question, it is reasonable for them to ask who created the answer or the content, yet many learning technologies fail to quickly answer this basic question. With these implicit reputation systems , reputation is based only on the analysis of a collective set of behaviors and metrics without regard to a voting process by others in the community. Exposing reputation: Helps individuals decide who to trust.
5 Critical Needs Met By Blended Learning
MARCH 23, 2015
As is often on this site, I have written about the benefits of using a blended learning approach when delivering course content. While it is quite apparent that blended learning initiatives work (when implemented correctly), perhaps you are curious as to why they are so effective? The folks at Origin Learning attempt to provide us with this reason – actually five reasons.
Special Report 2013: Metrics and Measurement
AUGUST 20, 2013
Learning evaluation, metrics and measurement are not where they need to be, but some companies have made progress. Learning Measurement: A Work in Progress. Learning evaluation, metrics and measurement are not where they need to be, but some companies have made progress. The framework for learning evaluation and measurement embraced by most in the industry starts with Kirkpatrick. Still, questions remain on how a learning leader should report evaluation metrics to senior leaders Frank Kalman. Frank Kalman. Frank Kalman. Frank Kalman.
New Mobile Learning Research
JUNE 5, 2012
ASTD last week released its new research report, titled ‘ Mobile Learning – Delivering Learning in a Connected World ‘, which we are very pleased to have sponsored. Mobile learning enhances the learning function through performance support. Chief barriers to adopting mobile learning include budget, integration with legacy systems, and security.
Another Way of Looking at Learning Metrics
In the Middle of the Curve
MAY 19, 2011
Key topic: How to get and present metrics the senior execs understand. Compliance regulations - Tracking demographics - Why employees don’t take/complete - More efficient data collection Performance.gov - Government trying to get standards and consistency Bersin – 4 dynamics in gov’t sector - Budget cuts – need to demonstrate value and articulate impact - Aging workforce – knowledge management to maintain institutional memory - Low retention of new hires - Federal mandates / shifting politics During this turning point, learning investments have been proven to accelerate performance.
Invisibilizing Workplace Learning
FEBRUARY 5, 2015
Many learning executives are concerned about visibility. They Many seek appreciation and recognition for the learning enterprise, their learning enterprise. measure the learning enterprise against the metrics that matter most to the organization and leaders. communicate with leadership through dashboards and stories riveted to high value metrics.
Measuring Learning Delivery
FEBRUARY 7, 2011
Last week we talked about the need to invest in instructors to maximize your investment in learning delivery. This was the norm until e-learning came along, where an electronic survey, which the students had to complete to get credit for the class, could easily be appended to the end of the class. Electronic surveys can be used in classroom-based learning as well. The Business Of Learning learning delivery metrics and measurementThis week we’ll talk about measurement. All in all, there may be 10 to 15 questions. But I would make one important exception.
#OER #MOOC online learning papers from Open CourseWare conference
APRIL 24, 2014
The most interesting for my research and online learning interests was the one from Cohen, Omollo and Malicke which was an article on " a Framework to Integrate Public, Dynamic Metrics Into an OER Platform ". find this of interest, as it is part of something I want to investigate in relationship to peer/expert knowledge creation, MOOC, mobile learning.