How to Evaluate Learning: Kirkpatrick Model for the 21st Century—A Revision

Dashe & Thomson

I was asked by Wendy Kirkpatrick to remove the copyrighted Kirkpatrick diagrammatic model from my original blog post, How to Evaluate Learning: Kirkpatrick Model for the 21st Century. Kirkpatrick calls this Return on Expectations, or ROE.

To “Kirkpatrick” or not to “Kirkpatrick”, that is the Question (or is it?)

Learning Rebels

To “Kirkpatrick” or not to “Kirkpatrick”, that is the question. Many a person has debated the Kirkpatrick evaluation taxonomy. To name a few: Dan Pontefract: Dear Kirkpatrick’s: You Still Don’t Get It (a personal favorite).

Kirkpatrick Revisited | Social Learning Blog

Dashe & Thomson

I have included Kirkpatrick’s Four Levels of Evaluation in every proposal I have ever written, and I wanted to hear from Kirkpatrick himself regarding his take on the current state of evaluation and whether his four levels are still viable.

Evaluating ELearning ROI with Kirkpatrick

LearnDash

Most business make decisions based on how it will impact their bottom-line. Businesses that do this well stay in business. Using The Kirkpatrick Model. One of the more well known ways to measure elearning and training initiatives is with the Kirkpatrick evaluation model.

Kirkpatrick’s Four Levels of Evaluation

Learnnovators

It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs. The four-level model developed by Kirkpatrick is now universally used in gauging training effectiveness.

Donald Kirkpatrick’s four levels of training: Lessons from a Legend

Origin Learning

Kirkpatrick , Professor Emeritus, University Of Wisconsin first gave his ideas for a series of articles to be published in the Journal of American Society of Training Directors in the year 1959, hardly had anyone anticipated that this was to be the stuff of legend. When Donald L.

Vale Don Kirkpatrick

Clark Quinn

Last week, Don Kirkpatrick passed away. He numbered his steps so that step 1 was seeing what learners thought, 2 was that learners could demonstrate a change, 3 was that the change was showing up in the workplace post intervention, and 4 was it impacting business measures. Rather than measuring the cost of hour of seat time or some other measure of efficiency, or, worse, not measuring at all, here was a plan that was designed to focus on meaningful change that the business needed.

Training Evaluation Beyond Kirkpatrick

Training Industry

Today, when we discuss training evaluation, we likely reference Kirkpatrick’s model with the familiar four levels: reaction, learning, behavior and results. Most of the models expand upon the Kirkpatrick model and try to address some of its limitations, including criticisms by researchers that the interdependence and implied causality of each of the four levels has not been proven by empirical research.

Measuring eLearning ROI With Kirkpatrick’s Model of Training Evaluation

Adobe Captivate

In this blog, I outline how you can use the Kirkpatrick’s model of training evaluation as a model to measure training effectiveness and impact. What is Kirkpatrick’s model of training evaluation? How can you use Kirkpatrick’s model of training evaluation to measure ROI?

Alternative to the Kirkpatrick Model of Training Evaluation

LearnDash

If you have been in the elearning (or training) industry for any amount of time, then you are most likely aware of the Kirkpatrick model of learning evaluation. One could write an entire book on the Kirkpatrick model and the different levels, but I am not going to get into too much detail.

Kirkpatrick’s Model: How to Calculate eLearning ROI

LearnUpon

Calculating eLearning ROI using Kirkpatrick’s Evaluation Model. To do this, you’ll need to use Kirkpatrick’s Model of Training Evaluation for the ROI calculation. What is Kirkpatrick’s Model of Training Evaluation? For most organizations, the value of training is clear-cut.

The Kirkpatrick-Phillips Model – Part 4

CommLab India

In the third part of this series, we looked at the advantages and disadvantages of the Kirkpatrick Model of Evaluating a training program. I mentioned the Kirkpatrick-Phillips Model of Evaluation in passing, and promised you more on this “ evolved ” model. Kirkpatrick Model.

50 Years of the Kirkpatrick Model

Upside Learning

In the fifty years since, his thoughts (Reaction, Learning, Behavior, and Results) have gone on to evolve into the legendary Kirkpatrick’s Four Level Evaluation Model and become the basis on which learning & development departments can show the value of training to the business.

Kirkpatrick's Four Levels of Training Evaluation: A Critique

The Performance Improvement Blog

At the end of Dan McCarthy’s blog post , “How to Evaluate a Training Program”, in which he explains his pre-post, survey approach to applying the Kirkpatrick four levels of training evaluation , he asks: Has anyone used a system like this, or something better?

How to Evaluate Learning: The Kirkpatrick Model for the 21st Century

Dashe & Thomson

Kirkpatrick’s revised “Four Levels of Evaluation” model, what we need to do is find out what success looks like in the eyes of these senior managers and stakeholders and let them define their expectations for the training program.

Measuring training effectiveness — the Kirkpatrick model

Matrix

So it is only natural for businesses to want be able to quantify the value that training sessions bring to the organization. Luckily, Donald Kirkpatrick created a training evaluation model that gives this process a clear structure.

Become a Strategic Partner Through Effective Training Evaluation #ASTD2014 @Jim_Kirkpatrick

Learning Visions

James Kirkpatrick, Senior Consultant Kirkpatrick Partners Sometimes we have to do the politically incorrect thing. We have to choose to take the disruptive, high road of business partnership instead of the easy road. What are the business reasons?

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. Assessing the gain for business. What Is Kirkpatrick’s Model Of Training Evaluation?

Time to retire Kirkpatrick?

From the Coleface

When you first turned your thoughts to evaluating training, it’s odds-on that a colleague or consultant recommended you to have a look at the Kirkpatrick model. There is a commonly held misconception that you need to do Kirkpatrick Level 1 first and then Level 2 etc. If you are aiming to improve the business development effectiveness of your client facing staff, does it matter that 40% rather than 30% of the incremental success related to the training course?

Kirkpatrick’s Model of Evaluation – Making Maximum Use of Evaluation: Part 1

CommLab India

Kirkpatrick’s Model of Learning Evaluation. Of these four models of evaluation, the most successful one is the Kirkpatrick’s Model of Learning Evaluation (In fact, the Anderson’s Value of Learning Model is based on Kirkpatrick’s Model of Learning Evaluation).

Is Kirkpatrick’s Model of Evaluating a Training Program The Best? – Part 3

CommLab India

This is the third blog in the Kirkpatrick Model of Instruction series. In the first part of the series, I covered the need to evaluate any training program and the basics of the Kirkpatrick model of evaluating a training program.

What is the Kirkpatrick Model of Learning Evaluation?

Growth Engineering

But, evaluating the ROI of learning can be a fickle business. So, learn from the sagely wisdom of Donald Kirkpatrick – a hero of learning evaluation. If you do, you need Kirkpatrick’s model. Do you evaluate your learning’s return on investment?

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

Adobe Captivate

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business. Assessing the gain for business. What Is Kirkpatrick’s Model Of Training Evaluation?

ROI 56

Kirkpatrick’s Model of Evaluation – the Very Basics of the Model: Part 2

CommLab India

According to Dr. Don Kirkpatrick, there are three reasons to evaluate a training program: To know how to improve future training programs. In my previous blog, I presented a brief introduction to the Kirkpatrick’s Model of Evaluation and its impact on training 1.

Kirkpatrick's Revised Four Level Evaluation Model

Big Dog, Little Dog

I had an interesting discussion with Clark Quinn on using Kirkpatrick's model in learning processes other than courses. Clark argues that use of Kirkpatrick’s model is only for courses because training is the dominant discussion on their web site.

Alternatives to Kirkpatrick

bozarthzone

While the Kirkpatrick taxonomy is something of a sacred cow in training circles—and much credit goes to Donald Kirkpatrick for being the first to attempt to apply intentional evaluation to workplace training efforts—it is not the only approach. Apart from being largely atheoretical and ascientific (hence, 'taxonomy', not 'model' or 'theory'), several critics find the Kirkpatrick taxonomy seriously flawed. More later on alternatives to the Kirkpatrick taxonomy.

Flipping Kirkpatrick

Big Dog, Little Dog

And I think the reason why is that because Kirkpatrick basically nailed it, but presented it wrong.

Free Webinar: The New World Kirkpatrick Four

Take an e-Learning Break

Think you "know Kirkpatrick"? Attend this session and be among the first to see the latest adaptation of the Kirkpatrick Four Levels TM. Thursday, February 17, 2011 Speakers: Donald Kirkpatrick, Ph.D., Author, Speaker, Thought Leader, Kirkpatrick Partners James Kirkpatrick, Ph.D.,

Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

This free eBook, Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation, provides practical tips that you can use to measure the effectiveness of online training, leading to the ROI on your training spend. Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation. What is Kirkpatrick’s model of training evaluation?

Business Impact of Learning: What is Customer Experience Worth to You?

Talented Learning

For years, I’ve said that connecting employee learning with business impact doesn’t have to be a mind-bending challenge. In both cases, learning also affected business outcomes, but not in the same way. Winery Visit 1: Near-Term Business Impact.

Maximize the Business Impact of your Learning & Development Strategy

Docebo

But now there is a new challenge, to optimize and maximize the impact learning has on business. In this whitepaper by Fosway Group, you can learn how to maximize the business impact of your learning and development strategy. Why measure the business impact of your L&D strategy.

How to Prove Training ROI for Your Business

Appsembler

The reality, however, is that increased training opportunities can create substantial opportunities for the business as a whole. Not only does offering training increase the odds that your business will be able to keep competent employees, but it also increases the capability of existing employees, allowing them to take on new tasks and challenges and better manage the company’s position within the industry. The Kirkpatrick Model.

ROI 50

Can you attribute business results directly to training?

Axonify

Yes, it is possible to directly attribute changes in business results to specific training activities. We can all recite the four levels of the Kirkpatrick Model (reaction, learning, behavior, results), but we still can’t prove the impact of training on business results.

Don Kirkpatrick’s Contribution to Learning & Development

CLO Magazine

The Business Of LearningI just saw an announcement that Don will retire from the speaking circuit this year. Few people have single-handedly made such an impact on our profession. I have known Don for years and his story is very interesting. Don got his start in learning when he was working on his Ph.D. dissertation at the University of Wisconsin and needed some good measures to evaluate the impact of a training program for supervisors.

Online Courses Are Golden: Can an LMS Help Your Business Cash In?

Talented Learning

And if you already offer online courses, you’re probably looking for ways to expand this line of business. In the past, LMS vendors were staffed primarily with instructional experts who focused on challenges like the possibility of achieving Kirkpatrick Level 4 capabilities.

How to Measure Online Course Effectiveness

CourseArc

Kirkpatrick’s Four-Level Approach to Assessing Training Outcomes. The first order of business is to assess how learners react to the course by asking… What did participants think about the course?

Kirkpatrick - misunderstood again

Learning Rocks

Acres of screen and print pages have been given over to the relevance or otherwise of Kirkpatrick's model of evaluation. Today a colleague received a request to make sure the course he was working on featured Kirkpatrick analysis. The client wanted a survey at the end of the course that addressed all four levels of Kirkpatrick in one go: what do you think of this training course? Still, being an elearning guy now does have its benefit - no more bloody business hotels.