What Are Your Training Metrics Actually Measuring?

Your Training Edge

Much has been written on the subject and many experts have weighed in on what they consider to be the most crucial training metrics ( here are my top 10 ). Other people have suggested implementation, application, business impact, and ROI. business impact).

Social Media Metrics

Clark Quinn

I continue to get asked about social learning metrics. Until we get around to a whitepaper or something on metrics, here’re some thoughts: Frankly, the problem with Kirkpatrick (sort of like with LMS’ and ADDIE, *drink*) is not in the concept, but in the execution. Frankly, even activity is a metric. Metrics for informal learning aren’t rocket science, but instead mapping of best principles into specific contexts.

ROI and Metrics in eLearning

Tony Karrer

I'm working on an article around the use of ROI and metrics in eLearning. Kirkpatrick's Level 3: Improving the Evaluation of E-Learning Level 3 evaluations measure whether the there was an actual transfer of learning to the actual work setting. Support - ROI Calculator Training & Support Return on Investment Calculator Investing in Learning: Consider Value, Not Just ROI ROI, or return on investment, is king in today's business world.

To “Kirkpatrick” or not to “Kirkpatrick”, that is the Question (or is it?)

Learning Rebels

To “Kirkpatrick” or not to “Kirkpatrick”, that is the question. Many a person has debated the Kirkpatrick evaluation taxonomy. To name a few: Dan Pontefract: Dear Kirkpatrick’s: You Still Don’t Get It (a personal favorite).

Training Evaluation Beyond Kirkpatrick

Training Industry

Because showing the return on investment from training involves many components and metrics that are not readily measurable, such as the behavioral changes in the learner’s day-to-day work as a result of the training they attended. Today, when we discuss training evaluation, we likely reference Kirkpatrick’s model with the familiar four levels: reaction, learning, behavior and results.

Kirkpatrick Revisited | Social Learning Blog

Dashe & Thomson

I have included Kirkpatrick’s Four Levels of Evaluation in every proposal I have ever written, and I wanted to hear from Kirkpatrick himself regarding his take on the current state of evaluation and whether his four levels are still viable.

Alternative to the Kirkpatrick Model of Training Evaluation


If you have been in the elearning (or training) industry for any amount of time, then you are most likely aware of the Kirkpatrick model of learning evaluation. One could write an entire book on the Kirkpatrick model and the different levels, but I am not going to get into too much detail.

Kirkpatrick Model Good or Bad? The Epic Mega Battle!

Will at Work Learning

In this third installment of the series, we''ve engaged in an epic battle about the worth of the 4-Level Kirkpatrick Model. Will: I want to pick on the second-most renowned model in instructional design, the 4-Level Kirkpatrick Model. A business person’s dream!

How Employee Performance determines the Success of Your Training Program


It’s also an excellent way to gauge how employees are able to contribute to the business. And its best benefit – it is an avenue for rewards and recognition of the business’ top employee performance and thus, also an instrument for augmenting both employee morale and productivity.

50 Years of the Kirkpatrick Model

Upside Learning

In the fifty years since, his thoughts (Reaction, Learning, Behavior, and Results) have gone on to evolve into the legendary Kirkpatrick’s Four Level Evaluation Model and become the basis on which learning & development departments can show the value of training to the business.

Measurement, Meet Management

CLO Magazine

Usually and apparently falsely attributed to management guru Peter Drucker, it nonetheless pops up in management speak and business circles far and wide. That disconnect between measurement efforts and business outcomes may help explain learning professionals’ general dissatisfaction.

How to Measure Online Course Effectiveness


Kirkpatrick’s Four-Level Approach to Assessing Training Outcomes. The first order of business is to assess how learners react to the course by asking… What did participants think about the course?

How to Evaluate Learning: The Kirkpatrick Model for the 21st Century

Dashe & Thomson

Kirkpatrick’s revised “Four Levels of Evaluation” model, what we need to do is find out what success looks like in the eyes of these senior managers and stakeholders and let them define their expectations for the training program.

Conducting Post-Course Evaluations


The industry standard Kirkpatrick model measures training based on the four levels of analysis: Level 1: Did the learners enjoy training? Level 4: What business results can be attributed to the training? Determining the metrics of success before course development is the first step.

Avoid and Correct Employee Evaluation Pitfalls

CLO Magazine

Unfortunately, Alan didn’t have data to link the revamped training program to those key sales metrics. Developing metrics that tie directly to desired business outcomes has been critical to not only our training but to our performance support success as well,” said Joanne S.

New Year L&D Resolution? Align L&D with the Business

CLO Magazine

One of the most difficult challenges facing CLOs is aligning learning and development with the organization’s business goals. Homepage Commentary & Opinion Strategy alignment business goalsTags: alignment , business goals. By Marina Theodotou.

Why We Should Stop Talking About ROI in Training


For as long as Return on Investment, or ROI , has been prevalent concept in business, it’s also been a fixture of workplace learning and performance. Many people look at Don Kirkpatrick ’s work from as early as 1959 as the beginning of ROI in learning and development.

ROI 73

Measuring Success (ROI) of a Training MOOC, Part 1

Your Training Edge

The first metric to be considered was the number of students completing the courses with passing grades (usually defined as 70 percent or better). Depending how you look at it, this metric leads to either an excellent or a terrible conclusion. The most widely used (at least in theory) method of evaluating training programs is the four-level model developed by Donald Kirkpatrick. Second, decide how each metric will be determined.

ROI 107

Measuring Success (ROI) of a Training MOOC, Part 2

Your Training Edge

In the previous post, I outlined the four-level model of evaluation developed by Donald Kirkpatrick. See here for a more in-depth look at how some companies are using MOOCs to solve real business problems. CPD Featured Posts LMS MOOC Talent Management Training Kirkpatrick model MOOCs

ROI 130

Boost your L&D visibility & credibility – The Annual Learning Report

Learning Wire

This article enables you to create your own Annual Learning Report, offering an opportunity to boost your credibility and visibility for key business stakeholders. Critical remarks have been placed at commonly used models to capture the added value of L&D, as Kirkpatrick’s model.

Report 136

In Defense of the Four Levels

Integrated Learnings

Over the past year or so, I’ve noticed several comments about how Kirkpatrick’s model of four levels of evaluation is outdated. An initial gap analysis should identify specific business needs (level 4) and what is required to fulfill those needs (level 3). Though it’s common to track “butts in seats” and other attendance-related metrics not accounted for in the model, these measures seem more related to staffing and forecasting as opposed to training results. By Shelley A.

Measuring Learning Delivery

CLO Magazine

Most practitioners measure delivery and other aspects of a course using Kirkpatrick’s level 1, typically via a short survey asking about content, delivery and the environment, as well as relevance to the job. Kirkpatrick, who invented the four levels, recommends the survey be administered at the end of the class to get immediate feedback and to ensure a 100 percent response rate. The Business Of Learning learning delivery metrics and measurement

How to Measure the Impact of Training on Your Bottom Line


This is why business entities need a different way to justify their investments in training and continuing education. Each of the above benefits — and several others — are quantifiable metrics that can be used, separately or in tandem, as part of any ROI calculation.

More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I have been blogging a lot about Training Evaluation this year—mostly Kirkpatrick , but also Brinkerhoff and Scriven. I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation.

Measuring Training Program ROI


At McKinsey & Company, only 25% of managers surveyed believed that the training programs measurably improved business results. Associating these metrics to key business outcomes allows you to better measure the true impact of a training.

ROI 145

How Can You Measure The Learning Effectiveness Of Online Courses And Create A Positive ROI?

Adobe Captivate

Most of us are familiar with Kirkpatrick’s model of evaluation as shown here: Level 1 – Learner Reaction – Was the course relevant, useful, and worth my time? Level 4 – Business impact – Was there a tangible and demonstrable value after the training?

ROI 56

Looking Within: How To Gather And Analyze Actionable Learning Insights


Learning insights are often referred to by other names, like learning analytics, or learning metrics. Data includes the raw figures, responses and statistics gathered from a Learning Management System’s (LMS) reporting and the metrics we set. Beware the vanity metric.

The Only Person Who Behaves Sensibly Is My Tailor

Performance Learning Productivity

Effective Metrics for Learning and Development I wonder what Shaw would think if he saw the way learning and development is predominantly measured in organisations today. These time-honoured metrics developed for an industrial age are not the answer. A parallel path to learning metrics.

Starting from the end

Clark Quinn

Week before last, Will Thalheimer and I had another one of our ‘debates’, this time on the Kirkpatrick model (read the comments, too!). The reason I like the Kirkpatrick model is it emphasizes one thing that I see the industry failing to do. The important point is starting with a business metric. The problems with Kirkpatrick are several. And the impact is what the Kirkpatrick model properly is about, as I opined in the blog debate.

You Suck at Instructional Design

eLearning Alchemy

They’re too busy. There is only one right definition of instructional design: The use of instructional theory, systems and techniques to solve business problems and drive business results (substitute “business” as you require). Length: 1329 words.

5 time-saving tips for your next learner survey

Sponge UK

On a basic level, you need to know their reaction to the experience (known as Level 1 in the Kirkpatrick model). Finding out whether the audience found the elearning user-friendly, relevant and engaging are useful metrics to add to the evaluation mix.

Calculating the ROI of training – ensuring the L&D budget


The Kirkpatrick model of training evaluation has the fourth level that is aiming to measure the results but it only takes things as far as checking if the information taught is being transferred on the job.

Training Evaluation: Why You Can’t Ignore It

Growth Engineering

In our blog on the Kirkpatrick model we overview the four steps that make up a comprehensive evaluation. But, these metrics don’t always translate directly into the financial language that senior business people often use.

Why Learning Measurement Matters

CLO Magazine

Without metrics, it is not clear that change is going in the right direction. In metrics, the “what” of our work is about what we measure. Well known in learning and development work are levels 1 through 4 by Donald Kirkpatrick. In the Bellevue University Human Capital Lab work with Verizon Wireless, the what consists of business outcomes. The operations management team’s alignment, for instance, is a critical component of business impact.

Level of ‘levels’

Clark Quinn

I was defending Kirkpatrick’s levels the other day, and after being excoriated by my ITA colleagues, I realized there was not only a discrepancy between principle and practice, but between my interpretation and as it’s espoused. Both of these fail to understand the intention: Kirkpatrick (rightly) said you have to start at level 4. As a standalone metric, it ranks right up there with measuring learning effectiveness by the pound of learners served.

Learning Measurement: A Work in Progress

CLO Magazine

Learning evaluation, metrics and measurement are not where they need to be, but some companies have made progress. Learning evaluation and measurement have come a long way since Donald Kirkpatrick, widely credited as a trailblazer in the field, first introduced his four levels of learning evaluation in 1959. But the industry’s pace in modernizing the practice to fit evolving business needs has lagged.

Deeper eLearning Design: Part 1 – The Starting Point: Good Objectives


It should be an organizational performance gap that is demonstrated by an available metric. Our successes should be business successes! Follow Kirkpatrick backwards from ‘business problem’ to ‘change in workplace behavior’ to ‘learning needed to accomplish that behavior’, and make sure that your learning objective is going to lead to new behaviors that will address the measure that’s lagging. This is the first post in a series of six that covers Deeper eLearning.