How to Evaluate Learning: Kirkpatrick Model for the 21st Century—A Revision

Dashe & Thomson

I was asked by Wendy Kirkpatrick to remove the copyrighted Kirkpatrick diagrammatic model from my original blog post, How to Evaluate Learning: Kirkpatrick Model for the 21st Century. Kirkpatrick’s Revised “Four Levels of Evaluation” model , what we need to do is find out what success looks like in the eyes of these senior managers and stakeholders and let them define their expectations for the training program. Kirkpatrick calls this Return on Expectations, or ROE.

To “Kirkpatrick” or not to “Kirkpatrick”, that is the Question (or is it?)

Learning Rebels

To “Kirkpatrick” or not to “Kirkpatrick”, that is the question. Many a person has debated the Kirkpatrick evaluation taxonomy. To name a few: Dan Pontefract: Dear Kirkpatrick’s: You Still Don’t Get It (a personal favorite). Jane Bozarth: Alternatives to Kirkpatrick . Donald Clark: Using Kirkpatrick’s Four Levels to Create and Evaluate Informal and Social Learning Process . Here we go again.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Kirkpatrick Revisited | Social Learning Blog

Dashe & Thomson

I have included Kirkpatrick’s Four Levels of Evaluation in every proposal I have ever written, and I wanted to hear from Kirkpatrick himself regarding his take on the current state of evaluation and whether his four levels are still viable.

Vale Don Kirkpatrick

Clark Quinn

Last week, Don Kirkpatrick passed away. He numbered his steps so that step 1 was seeing what learners thought, 2 was that learners could demonstrate a change, 3 was that the change was showing up in the workplace post intervention, and 4 was it impacting business measures. Rather than measuring the cost of hour of seat time or some other measure of efficiency, or, worse, not measuring at all, here was a plan that was designed to focus on meaningful change that the business needed.

50% Off the Latest Kirkpatrick Certification

Kirkpatrick Partners

When you reach out to the business about training-related topics, do you often get no response? Are you still struggling to get a seat at the table? Is it difficult to get cooperation from managers and supervisors of your training graduates?

Evaluating ELearning ROI with Kirkpatrick

LearnDash

Most business make decisions based on how it will impact their bottom-line. Businesses that do this well stay in business. Using The Kirkpatrick Model. One of the more well known ways to measure elearning and training initiatives is with the Kirkpatrick evaluation model. The point here is that Kirkpatrick emphasizes five different evaluation methods. This is why business leaders get frustrated with the idea of elearning.

Donald Kirkpatrick’s four levels of training: Lessons from a Legend

Origin Learning

Kirkpatrick , Professor Emeritus, University Of Wisconsin first gave his ideas for a series of articles to be published in the Journal of American Society of Training Directors in the year 1959, hardly had anyone anticipated that this was to be the stuff of legend. This is the ultimate test of the usefulness of the training because it evaluates the effect on the business or environment resulting from the improved performance of the trainee. When Donald L.

Only 6 Seats Remain in the Next Kirkpatrick Certification Program

Kirkpatrick Partners

Only 6 seats remain in the next Kirkpatrick certification program! This program is the fast track to showing training’s value to the business Don’t miss your chance to learn how to show the value of any training – leadership development, onboarding, diversity & inclusion; you name it.

Training Evaluation Beyond Kirkpatrick

Training Industry

Today, when we discuss training evaluation, we likely reference Kirkpatrick’s model with the familiar four levels: reaction, learning, behavior and results. Most of the models expand upon the Kirkpatrick model and try to address some of its limitations, including criticisms by researchers that the interdependence and implied causality of each of the four levels has not been proven by empirical research.

Kirkpatrick's Four Levels of Training Evaluation: A Critique

The Performance Improvement Blog

At the end of Dan McCarthy’s blog post , “How to Evaluate a Training Program”, in which he explains his pre-post, survey approach to applying the Kirkpatrick four levels of training evaluation , he asks: Has anyone used a system like this, or something better?

KIRKPATRICK’S FOUR LEVELS OF EVALUATION

Learnnovators

It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs. According to Kirkpatrick, evaluating training programs is necessary for the following reasons: 1. The four-level model developed by Kirkpatrick is now universally used in gauging training effectiveness. From a business point of view, this is the overall reason for providing executives with a training program.

MTA: Why the Kirkpatrick Model Works for Us

CLO Magazine

As he settled into his new job, Wiedecker read Jim and Wendy Kirkpatrick’s book, “Training on Trial,” which inspired him to implement the Kirkpatrick training evaluation model at the MTA. The book provided a blueprint to build a chain of evidence so he could link the training team’s efforts to business results. The four levels of training evaluation Don Kirkpatrick put forth first in the 1950s are well known to learning leaders. Implementing the Kirkpatrick Model.

Alternative to the Kirkpatrick Model of Training Evaluation

LearnDash

If you have been in the elearning (or training) industry for any amount of time, then you are most likely aware of the Kirkpatrick model of learning evaluation. One could write an entire book on the Kirkpatrick model and the different levels, but I am not going to get into too much detail. This includes outcomes that you or your organization have determined to be good for business, good for the employees, or good for the bottom line.

Measuring eLearning ROI With Kirkpatrick’s Model of Training Evaluation

Adobe Captivate

In this blog, I outline how you can use the Kirkpatrick’s model of training evaluation as a model to measure training effectiveness and impact. What is Kirkpatrick’s model of training evaluation? This model was created by Donald Kirkpatrick in 1959, and is one of the most commonly used training evaluation models in the world. Featuring four levels, it covers the entire spectrum of parameters from learner reaction to the desired business impact.

50 Years of the Kirkpatrick Model

Upside Learning

In the fifty years since, his thoughts (Reaction, Learning, Behavior, and Results) have gone on to evolve into the legendary Kirkpatrick’s Four Level Evaluation Model and become the basis on which learning & development departments can show the value of training to the business.

The Kirkpatrick-Phillips Model – Part 4

CommLab India

In the third part of this series, we looked at the advantages and disadvantages of the Kirkpatrick Model of Evaluating a training program. I mentioned the Kirkpatrick-Phillips Model of Evaluation in passing, and promised you more on this “ evolved ” model. I call this an “ evolved ” model because, the Kirkpatrick-Phillips Model of Evaluating a training program is based on the Kirkpatrick Model of Evaluation. Kirkpatrick Model. Business impact.

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. Assessing the gain for business. What Is Kirkpatrick’s Model Of Training Evaluation?

Kirkpatrick’s Model: How to Calculate eLearning ROI

LearnUpon

Calculating eLearning ROI using Kirkpatrick’s Evaluation Model. To do this, you’ll need to use Kirkpatrick’s Model of Training Evaluation for the ROI calculation. What is Kirkpatrick’s Model of Training Evaluation? The Kirkpatrick Model was developed in the 1950s by Donald Kirkpatrick, a professor, and training specialist. Following the 4 levels of Kirkpatrick’s evaluation model, you’ll be able to measure your eLearning ROI.

How to Evaluate Learning: The Kirkpatrick Model for the 21st Century

Dashe & Thomson

Even though many Learning and Development organizations find it a challenge to prove training’s effect beyond how learners react to the training and whether they have learned the training content, senior management and business stakeholders are more and more interested in metrics that show the impact on the organization. The “chain of evidence” supports the results, showing the value learning and reinforcement has provided to the business.

Solutions to Today’s Training Crisis – An Intimate Conversation with Jim and Wendy Kirkpatrick

Kirkpatrick Partners

We hope you can join us for a half-day of Jim and Wendy Kirkpatrick unplugged and off the “script.” ” Recharge your batteries and prepare for the return to “business as (better than) usual” during this personal conversation. I don’t know about you, but we’re looking for some positive news. So we made our own!

Is Kirkpatrick’s Model of Evaluating a Training Program The Best? – Part 3

CommLab India

This is the third blog in the Kirkpatrick Model of Instruction series. In the first part of the series, I covered the need to evaluate any training program and the basics of the Kirkpatrick model of evaluating a training program. In the second part of this series, I delved into each level of the Kirkpatrick model. Level 4: Advantages: This level measures the success of the training program based on its overall impact on business.

Free Webinar: The New World Kirkpatrick Four

Take an e-Learning Break

Think you "know Kirkpatrick"? Attend this session and be among the first to see the latest adaptation of the Kirkpatrick Four Levels TM. Thursday, February 17, 2011 Speakers: Donald Kirkpatrick, Ph.D., Author, Speaker, Thought Leader, Kirkpatrick Partners James Kirkpatrick, Ph.D.,

Flipping Kirkpatrick

Big Dog, Little Dog

And I think the reason why is that because Kirkpatrick basically nailed it, but presented it wrong.

Time to retire Kirkpatrick?

From the Coleface

When you first turned your thoughts to evaluating training, it’s odds-on that a colleague or consultant recommended you to have a look at the Kirkpatrick model. There is a commonly held misconception that you need to do Kirkpatrick Level 1 first and then Level 2 etc. If you are aiming to improve the business development effectiveness of your client facing staff, does it matter that 40% rather than 30% of the incremental success related to the training course?

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

Adobe Captivate

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business. Assessing the gain for business. What Is Kirkpatrick’s Model Of Training Evaluation?

ROI 56

Business-aligned strategies for Leadership Development: An Interview with Dr. Yvonne Catino, VP, Leadership and OD, Infopro Learning

InfoPro Learning

Empowering leaders is the key for organizational success in the cut-throat competitive business environment of today. For modern businesses, the key to successful leadership development is achieving an appropriate balance between knowledge-exchange, action and reflection. Organizations now rely on leadership models that encourage leaders to engage more with employees and achieve higher levels of motivation for the common purpose of business success.

Measuring training effectiveness — the Kirkpatrick model

Matrix

So it is only natural for businesses to want be able to quantify the value that training sessions bring to the organization. Luckily, Donald Kirkpatrick created a training evaluation model that gives this process a clear structure. As Kirkpatrick explains, every program should at least have this degree of evaluation in order to gather some information that will lead to the improvement of the learning experience.

Kirkpatrick’s Model of Evaluation – the Very Basics of the Model: Part 2

CommLab India

According to Dr. Don Kirkpatrick, there are three reasons to evaluate a training program: To know how to improve future training programs. In my previous blog, I presented a brief introduction to the Kirkpatrick’s Model of Evaluation and its impact on training 1. According to Dr. Don Kirkpatrick, there are four levels of evaluation of any training program. At the end of the day, the final goal of any training program is to provide healthy business benefits and results.

What is the Kirkpatrick Model of Learning Evaluation?

Growth Engineering

But, evaluating the ROI of learning can be a fickle business. So, learn from the sagely wisdom of Donald Kirkpatrick – a hero of learning evaluation. If you do, you need Kirkpatrick’s model. Do you evaluate your learning’s return on investment? Most learning managers agree that they spend too much time on delivery and nowhere near enough time on learning evaluation. In fact, only 16% of learning managers think they put enough effort into evaluation.

Kirkpatrick's Revised Four Level Evaluation Model

Big Dog, Little Dog

I had an interesting discussion with Clark Quinn on using Kirkpatrick's model in learning processes other than courses. Clark argues that use of Kirkpatrick’s model is only for courses because training is the dominant discussion on their web site. So after some heavy reflection I did a rewrite on my Kirkpatrick web page and have listed some of the highlights below. I go into more detail on my web page on Kirkpatrick is you would like more information or full references.

Become a Strategic Partner Through Effective Training Evaluation #ASTD2014 @Jim_Kirkpatrick

Learning Visions

James Kirkpatrick, Senior Consultant Kirkpatrick Partners Sometimes we have to do the politically incorrect thing. We have to choose to take the disruptive, high road of business partnership instead of the easy road. What will be the ultimate business criteria for program success? What will they need to see from a business point of view that will allow them to say "job well done". (We What are the business reasons? How will we impact the business.

Alternatives to Kirkpatrick

bozarthzone

While the Kirkpatrick taxonomy is something of a sacred cow in training circles—and much credit goes to Donald Kirkpatrick for being the first to attempt to apply intentional evaluation to workplace training efforts—it is not the only approach. Apart from being largely atheoretical and ascientific (hence, 'taxonomy', not 'model' or 'theory'), several critics find the Kirkpatrick taxonomy seriously flawed. More later on alternatives to the Kirkpatrick taxonomy.

Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

This free eBook, Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation, provides practical tips that you can use to measure the effectiveness of online training, leading to the ROI on your training spend. Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation. What is Kirkpatrick’s model of training evaluation?

Grow multicultural leaders with coaching, not just business English

CLO Magazine

As workforces continue to grow more diverse, human resources and learning and development teams have embraced language training programs, such as Business English and ESL, for multicultural employees. As they advance in their careers and seek roles requiring leadership and higher-level communications skills, their development needs will likely not be met by ESL or Business English programs. Leadership Development business english multicultural leadership

Business Impact of Learning: What is Customer Experience Worth to You?

Talented Learning

For years, I’ve said that connecting employee learning with business impact doesn’t have to be a mind-bending challenge. In both cases, learning also affected business outcomes, but not in the same way. Winery Visit 1: Near-Term Business Impact.

The Learning Alliance and the Four Levels of Training Evaluation

The Performance Improvement Blog

In response to my blog post titled, “Kirkpatrick’s Four Levels of Training Evaluation: A Critique” , Wendy Kirkpatrick wrote a comment directing me to a white paper that she co-authored with Jim Kirkpatrick, "The Kirkpatrick Four Levels: A Fresh Look After 50 Years 1959 - 2009." That document describes updated thinking that the Kirkpatrick’s call “The Kirkpatrick Model”.

Don Kirkpatrick’s Contribution to Learning & Development

CLO Magazine

The Business Of LearningI just saw an announcement that Don will retire from the speaking circuit this year. Few people have single-handedly made such an impact on our profession. I have known Don for years and his story is very interesting. Don got his start in learning when he was working on his Ph.D. dissertation at the University of Wisconsin and needed some good measures to evaluate the impact of a training program for supervisors.