More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I have been blogging a lot about Training Evaluation this year—mostly Kirkpatrick , but also Brinkerhoff and Scriven. I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to PhillipsROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels.

Extend Your Training Evaluation To Include The Phillips ROI Model

Dan Keckan

Including the Phillips ROI model within your training evaluation will serve to quantitatively justify the investment into your training programs. Training ROI eLearning ROI Measure Training Online Training Training EvaluationThis post was first published on eLearning Industry.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The Kirkpatrick-Phillips Model – Part 4

CommLab India

In the third part of this series, we looked at the advantages and disadvantages of the Kirkpatrick Model of Evaluating a training program. I mentioned the Kirkpatrick-Phillips Model of Evaluation in passing, and promised you more on this “ evolved ” model. I call this an “ evolved ” model because, the Kirkpatrick-Phillips Model of Evaluating a training program is based on the Kirkpatrick Model of Evaluation. Phillip ROI Methodology TM.

An Overview: Phillips' Model for Learning Evaluation

Watershed

When we originally published our Learning Evaluation eBook and blog series, we covered four learning evaluation models representing a range of approaches and perspectives: Kirkpatrick, Kaufman, Brinkerhoff, and Anderson. While there are many other learning models we’ve yet to cover, the one we’re asked about most often that’s not mentioned in our original series is Phillips' Learning Evaluation Model. Meet the fifth level of learning evaluation.

Evaluating Training Effectiveness and ROI

Geenio

To evaluate the effectiveness of education and its practicability from the financial standpoint, it is necessary to calculate the expenses connected with creating and conducting the trainings, gauge the results achieved by the employees who have taken part in them, and decide whether the increase in the employees’ efficiency and company profits was sufficient to recoup the associated costs. The Donald Kirkpatrick’s Learning Evaluation Model consists of four levels: Level 1.

ROI 100

Showing the ROI of key programs on a budget

CLO Magazine

At the same time, you don’t necessarily have the resources to devote to a comprehensive evaluation. Here are 7 ways to minimize resources and still show the value of a major program at the impact and ROI levels. It’s important for every member of the team to share the responsibilities for designing, developing and delivering impact and ROI. Also, estimates can be used to arrive at the monetary value of a particular data item for the ROI analysis.

ROI 59

An Overview: Phillips Model for Learning Evaluation

Watershed

Find out more about how ROI is factored into Phillips Model for Learning Evaluation and what challenges it presents if done incorrectly

The Phillips ROI MethodologyTM – Measuring Data at All Levels – Part 5

CommLab India

Part 1 , Part 2 , and Part 3 of this series dealt with the Kirkpatrick Model of evaluating a training program. In the fourth part of the series, we saw how the Phillips ROI Methodology TM suggests that measurements be taken at every level. Level 5: ROI. Methods to measure: Several ROI calculating tools are available. Related Posts The Kirkpatrick-Phillips Model – Part 4 Is Kirkpatrick’s Model of Evaluating a Training Program The Best?

What’s the ROI on Disengaged Employees?

Dashe & Thomson

Training evaluation appears to be the Holy Grail of the L&D world. It’s one of the hottest topics in the blogosphere and at conferences (see Barbara Camm’s highly trafficked posts on evaluation), and yet it remains extremely elusive. From Kirkpatrick’s Four Levels of Evaluation, to Michael Scriven to Jack Phillips [.] The post What’s the ROI on Disengaged Employees? social learning evaluation millenials ROI social media social technology

ROI 154

Evaluating Training – Capturing the Benefits Aspect of ROI

Obsidian Learning

New post Evaluating Training – Capturing the Benefits Aspect of ROI on Obsidian Learning. Training evaluation is necessary and, in many ways, critical to the success of a business. And even if training evaluation is undertaken, it is usually at the easiest and lowest level: the measurement of student reactions through simple surveys or happy sheets. Calculating ROI. The formula to calculate ROI in this way is: ROI (%) = Benefit – Cost x 100 Cost.

The Phillips Model and How to Use It for Evaluating Employee Learning

Designing Digitally

If you're in the business of…well, any business, really…your strongest method of gauging success is by looking at your Return on Investment (ROI). The same principles apply when discussing learning evaluation In other words, your bottom line should be a good indicator of whether your company is growing, at a stand-still, or on a downward slope.

ROI Goes to School and Church

CLO Magazine

When you think about ROI, you likely think of businesses and service organizations. In recent years, however, there has been a rise of ROI use among nonprofits, non-governmental organizations, governments and healthcare. How are these organizations using the ROI Methodology to show the value of their projects and programs? The Phillips ROI Methodology is a 10-step process organizations can use to show the value of programs and initiatives. Phillips, Ph.D.,

ROI 39

Evaluation and ROI in Compliance Training

Interactive Services

But what about evaluation and return on investment (ROI)? . How have you planned to measure the effectiveness ROI of your initiative? Evaluation and ROI are important indicators of how well a program is working and how much risk is mitigated. Measuring ROI. Organizations that implement compliance training programs typically want to measure return on investment (ROI). But compliance training ROI can be hard to measure.

Training Evaluation – 5 Best Ways to Evaluate Training Effectiveness and Impact

Kitaboo

Training evaluation refers to an attempt to obtain relevant information on the effects of a training program. The primary objective of evaluating any training program is to develop an understanding of whether it has achieved its stated objectives. There are several types of training evaluation methods and tools available that enterprises can use to evaluate and significantly improve the outcome of future training as well. The Phillips ROI Model.

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

Adobe Captivate

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. How To Determine The ROI Of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business.

ROI 56

Impact and ROI of Learning: Worth Pursuing or Not?

CLO Magazine

Instead, they call for showing the alignment of learning to business goals, focusing on easier-to-measure participant reaction, amount learned and application (levels 1, 2 and 3, respectively, of the Kirkpatrick Model/Phillips ROI Methodology) and finally focusing on employee engagement with learning (consumption of learning and completion rates). However, for certain types of learning there is still a need to measure impact and ROI (levels 4 and 5 of the ROI Methodology).

ROI 47

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. How To Determine The ROI Of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business.

Learning to Learn from Evaluation of Learning

The Performance Improvement Blog

The Kirkpatricks have four levels, the Phillips have ROI, and Brinkerhoff has the Success Case Method. Each approach to evaluation of training has something to contribute to assessing the impact of formal training on employee learning. However, the value of evaluation is not in the data. The real value is in organizational learning from evaluation. Learning from evaluation depends on asking the right questions.

Short Course on Evaluation of Training and Learning in Knowledge Economy

The Performance Improvement Blog

LAD Global , in partnership with the Singapore Training and Development Association , has made my short course on evaluation of training and learning available for free online. My emphasis in this course is on using measurement and evaluation for learning. Much of evaluation in organizations today is still focused on formal training programs and limited to Kirkpatrick’s “level one”.

Kirkpatrick’s Four Levels of Evaluation

Learnnovators

It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs. In a series of articles published in 1959, he prescribed a four-stage model for evaluating training programs, but it was not until 1994, that he published “ Evaluating Training Programs: The Four Levels “ According to Kirkpatrick, evaluating training programs is necessary for the following reasons: 1.

Training Evaluation Beyond Kirkpatrick

Training Industry

Today, when we discuss training evaluation, we likely reference Kirkpatrick’s model with the familiar four levels: reaction, learning, behavior and results. However, several other models have been developed throughout the past 50 years that delve into training evaluation. Understanding and articulating these two concepts will give you an edge in your training evaluation efforts.

Three Superheroes of Training Evaluation

Growth Engineering

Well, let’s look at the heroes of training evaluation and how they helped make sense of training evaluation! Followed by Roger Kaufman and then Jack Phillips. This trio laid the foundations that help you evaluate your training. KNOWN FOR: The four levels of learning evaluation. Now, his simple and effective model helps training managers to evaluate how much has been learned, how behaviour has changed and what the result of training is.

Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

This free eBook, Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation, provides practical tips that you can use to measure the effectiveness of online training, leading to the ROI on your training spend. Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation. Then, I outline what methodology can be used to determine the ROI.

5 Tips To Maximize The ROI Of Online Training

Adobe Captivate

Determination of the ROI of online training is a hot topic today. In this article, I outline a popular ROI methodology (using Kirkpatrick’s model of evaluation), and 5 tips that you can use to maximize ROI in corporate training. Maximize The ROI Of Online Training In 5 Ways. Let me begin with a few basic definitions related to ROI of online training first: What Is Return On Investment (ROI) In Corporate Training? Which ROI Methodology Can Be Used?

ROI 55

[Free Webinar] How to measure and maximize the ROI of eLearning

Adobe Captivate

As new and innovative approaches are gaining momentum, the focus is also shifting on determining the impact and Return on Investment or ROI of online training. So how can you effectively measure the ROI of your online training? Join us for a free webinar hosted by Asha Pandey, the Chief Learning Strategist at EI Design, where she will showcases EI Design’s integrated approach with a focus on what is the right action at each stage that will impact the ROI of eLearning positively.

KIRKPATRICK’S FOUR LEVELS OF EVALUATION

Learnnovators

It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs. In a series of articles published in 1959, he prescribed a four-stage model for evaluating training programs, but it was not until 1994, that he published “ Evaluating Training Programs: The Four Levels “. According to Kirkpatrick, evaluating training programs is necessary for the following reasons: 1.

Predicting Learning Success

CLO Magazine

Phillips is chairman and Patti P. Phillips is president and CEO of the ROI Institute. Part of the evaluation mix should be the predictions of success. Think about the logical chain of value from any learning program: level 1, reaction; level 2, learning; level 3, application; level 4, impact; and level 5, ROI. We know from experience that programs are evaluated infrequently at level 3, less often at level 4 and rarely at level 5. Jack J.

ROI of continuous training: HR Directors’ unsolvable problem?

Coorpacademy

For many years, calculating ROI (return on investment) of continuous training has been difficult, especially with the pressure of Direction Committees and stakeholders, with expenses sometimes hard to justify with actual and tangible results. ‘The main issue for Human Resources is the calculation of its return on investment.’ How do we calculate the ROI of continuous training? But there is a summary at the end of the page, for people in a rush Which ROI?

Workplace Learning 2025 – What is the ROI of learning and development?

Learning Pool

Part 4: While the benefits of workplace learning are wide-ranging, measuring the return on investment (ROI) remains a challenge for many organisations. Meanwhile, the ROI Institute found at least 80 per cent of chief executives want to know the ROI of learning and development (L&D), yet few get the figures. ROI of L&D is critical to ensure money is invested wisely and the programme is open to scrutiny. Six Part Series: Workplace Learning 2025.

ROI 59

How To Measure The ROI Of Online Training?

EI Design

However, the focus is now shifting to determining its impact and the Return On Investment or ROI of online training. Measuring The ROI Of Online Training. In this article, I will begin with a quick summary of the benefits that eLearning offers, what ROI is, and how you can measure it. I will also outline the ROI methodology we use. I am quoting extensively from my earlier article Return Of Investment (ROI): Are You In? What Is ROI?

ROI 62

The Training Evaluation Framework of the Future: The GEvaluation Framework

Growth Engineering

When Donald Kirkpatrick first formed his training evaluation framework, it was 1964 and the world was a very different place. Even though a lot has changed in half a century, the models we use to evaluate our learning haven’t. So, it’s time we brought our evaluative frameworks up to date. What is it: These aspects of evaluation are built into the learning content. How do you measure it: An effective macro evaluation relies on careful pre-planning.

How To Measure The ROI Of Online Training?

Adobe Captivate

However, the focus is now shifting to determining its impact and the Return On Investment or ROI of online training. Measuring The ROI Of Online Training. In this article, I will begin with a quick summary of the benefits that eLearning offers, what ROI is, and how you can measure it. I will also outline the ROI methodology we use. I am quoting extensively from my earlier article Return Of Investment (ROI): Are You In? What Is ROI?

ROI 65

Why We Should Stop Talking About ROI in Training

Mindflash

For as long as Return on Investment, or ROI , has been prevalent concept in business, it’s also been a fixture of workplace learning and performance. A Brief History of ROI in Training. Many people look at Don Kirkpatrick ’s work from as early as 1959 as the beginning of ROI in learning and development. Another model and methodology from Jack Phillips includes a fifth level – ROI – which adds an added financial metric to the mix. Where Does ROI Fail?

ROI 81

ROI: Determine the Impact of Your Training Programs

Mindflash

Calculating Return on Investment (ROI) is no easy feat for most any project. And, measuring the ROI for your training programs is no exception. What Is ROI? Return on Investment is a popular financial metric for evaluating the financial consequences of investments. In simplest terms, ROI is the gain that results from an investment. Executive teams evaluate training programs based on the costs and outcomes of your investments.

ROI 40

What’s LEO’s Chain of Evidence Learning Evaluation Model?

Watershed

It roughly maps to Kirkpatrick’s learning evaluation levels one to four; however, LEO’s model has been developed through practical experience to be more pragmatic in a blended learning context. Actually, we’ve called on a lot of the learning evaluation models you may be familiar with—Kirkpatrick, Kaufman, Phillips, Anderson, and the like. There are two approaches you can take: The evaluative approach: start small with one learning initiative and apply the model.

eLearning ROI Case Study: How To Maximize Your Returns

EI Design

I share an eLearning ROI case study that demonstrates how L&D teams can improve and maximize the ROI of corporate training. This demonstrates how you can maximize the ROI by adopting our approach, based on Kirkpatrick’s model of training evaluation. How To Maximize ROI In Corporate Training: A Case Study. What Is ROI On Corporate Training, And Why Is This Measurement Critical Gor L&D Teams? eLearning ROI Case Study.

Commonly Used Training Evaluations Models: A Discussion with Dr. Will Thalheimer

Convergence Training

And that’s especially true when it comes to issues regarding learning evaluation. We were excited to be able to talk with Dr. Thalheimer about four common learning evaluation models, and we’ve got the recorded video for you below. If you prefer your learning evaluation information in written form, just scroll down for the transcript of our discussion. Many thank to Will for participating in this discussion on learning evaluation and for everything he does.