February 26, 2018
Measuring eLearning ROI With Kirkpatrick’s Model of Training Evaluation
Comments
(1)
February 26, 2018
Measuring eLearning ROI With Kirkpatrick’s Model of Training Evaluation
Asha Pandey is a seasoned entrepreneur with over 36 years of experience. After a successful transition to MPSi, which acquired EI Design in May ’22, she retired in Aug’22. Prior to her retirement, Asha was the Founder and Chief Learning Strategist at EI Design.
Legend 317 posts
Followers: 158 people
(1)

Those responsible for training delivery understand the value of measuring training effectiveness. Without a formal assessment of training effectiveness, you cannot ascertain the return on investment of your training spend. In this blog, I outline how you can use the Kirkpatrick’s model of training evaluation as a model to measure training effectiveness and impact. I will also show you how this can be further used to determine your Return On Investment (ROI).

What is Kirkpatrick’s model of training evaluation?

This model was created by Donald Kirkpatrick in 1959, and is one of the most commonly used training evaluation models in the world. Featuring four levels, it covers the entire spectrum of parameters from learner reaction to the desired business impact.

The model underwent two revisions, first in 1975 and again in 1994, and now features the following four levels:

Level 1: Reaction

Level 2: Learning

Level 3: Behaviour

Level 4: Impact

The traditional view of the model was as a pyramid as shown here.

Kirkpatrick’s model

This is now changing to a “chain of evidence” format where the four levels connect sequentially.

Kirkpatrick’s chain of evidence

We will look at each level in further detail and focus on:

  1. What is being measured, and;
  2. How the evaluation outcome can be used to improve the training and its impact.

Level 1: Reaction

Objective: This level is used to determine the baseline or learner reaction. It is vital to understand if learners liked the training, and found it relevant, useful and easy to apply.

From an evaluation perspective, this feedback allows L&D teams to assess if further improvements are warranted and if any gaps needed filling.

Level 2: Learning

Objective: This level is used to determine what was learned. The key focus is to see results (knowledge gain) that are directly attributable to the training.

L&D teams begin the exercise with a Training Needs Analysis (TNA) and then arrive at the learning objectives. The required gain would be an increase in knowledge, skills or a specific behavioural change.

From an evaluation perspective, this feedback allows L&D teams to measure how close they are to meeting their mandate (knowledge gain, new skill acquisition, higher proficiency in a skill or a required behavioural change).

Pointers from this evaluation determine the future course, signposting further training necessity or the need for performance support intervention (through the use of Performance Support Tools or job-aids that offer just-in-time training within the learner’s workflow.)

Sometimes there may be a need to provide non-training-based support like mentoring or coaching to achieve the mandate.

Level 3: Behaviour

Objective: This level is used to evaluate how learner behaviour has changed because of the training.

From an evaluation perspective, we are now validating how learners “apply” the learning they’ve absorbed from the training.

This is a tricky one, and you will often find that while learners may have learnt, there is no remarkable change in behaviour as the acquired knowledge is not yet applied. It is important to ascertain why is this not happening and then proceed with creating the right environment for learners to apply their learning.

Again, a reassessment to identify the necessity of any reinforcement or remediation support is necessary. Sometimes, polling learner performance after a certain period may provide the required insight on the change in behaviour.

Level 4: Impact

Objective: This level is used to evaluate the result or impact of the training.

From an evaluation perspective, this should map to the desired gain that business had sought.

How can you use Kirkpatrick’s model of training evaluation to measure ROI?

ROI determination (or Level 5)

ROI determination helps assess if the gain from the training (business impact) is more than the cost incurred (including training development, delivery and measurement costs).

  • This is often labelled as Level 5 of the Kirkpatrick model of training evaluation.
  • You will see a positive ROI when your impact is higher than the cost incurred.
  • ROI can be calculated by monetising the gain and dividing this by the cost.

Kirkpatrick’s model New

Summary

I hope this blog gives you a good overview of how you can use Kirkpatrick’s model of training evaluation to assess the effectiveness of your training. More significantly, I hope it gives you the pointers you need on how the results of measurement at each level can enhance your strategy till you reach your program and business goals.

Do contact me if you have any queries.

Need More?

Want more insights on how you can you measure the effectiveness of your corporate training and determine its ROI?

Schedule a call with our Solutions Architecting Team.

Source: https://www.eidesign.net/measuring-elearning-roi-with-kirkpatricks-model-of-training-evaluation/

1 Comment
2018-03-02 19:28:48
2018-03-02 19:28:48

Good, simple, and to the point. Thanks for sharing.

Like
Add Comment