More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Years later, I realized that she had skipped Kirkpatrick’s Level 4: Results and substituted Phillips’ ROI.

Unlocked Learning—Training analytics made easy


Unlocked Learning is here to resolve that issue by removing the friction caused by traditional training assessment tools. Instead of hunting down metrics, imagine being able to receive every training metric in one dashboard? Why is easily accessible training assessment important?


Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Workplace Learning 2025 – What is the ROI of learning and development?

Learning Pool

Time, costs, and measurement metrics are among drivers of this mismatch. While ROI can be elusive, organisations that do it well are starting with the business metric and examining performance outcomes,” says CIPD head of L&D Andy Lancaster. Six Part Series: Workplace Learning 2025.

ROI 77

The Essential Guide to Learning Analytics in the Age of Big Data

Lambda Solutions

What metrics and sources to use in implementing learning analytics. Before the rise of big data, instructors had to rely on periodic tests and assessments to judge the progress of their learners. Assessing the usefulness of learning materials. Performance Metrics Needed.

Why Don’t Businesses Measure Training ROI?


We wanted to know what is blocking today’s training leaders from assessing the return on investment of their programs. This makes it difficult to pinpoint key metrics, leaving you and your team with a lack of understanding of what’s important across the organization. .

ROI 52

Unlocked Learning—Training analytics made easy


Unlocked Learning is here to resolve that issue by removing the friction caused by traditional training assessment tools. Instead of hunting down metrics, imagine being able to receive every training metric in one dashboard? This makes training assessment difficult because the data can be skewed by engagement as well as training quality. Why is easily accessible training assessment important?

Evaluation and ROI in Compliance Training

Interactive Services

While ROI is an important metric, it shouldn’t be the sole focus of a comprehensive compliance training initiative. Learning management systems (LMSs) can provide metrics and generate reports that give you data pointing to the effectiveness of training, like time spent on each module, assessment scores, number of times an assessment was attempted, and course completion rates.

Should Loyalty Be the New Measure of Training ROI

Training Industry

Jack and Patti Phillips of the ROI Institute argue that training organizations that don't have an extensive measurement and evaluation system are likely to see a reduction or elimination of their budget. Spyridon Arvanitis of Geniki Bank-Societe Generale Group, Hellas, refers to loyalty as a business metric accepted by executives. Loyalty is also a metric that can be easily measured and reported using net promoter score (NPS).

ROI 51

ROI: It’s All About Proximity

CLO Magazine

I’m not saying training does not contribute to a learner’s on-the-job performance, but in the sense of measuring a Kirkpatrick or Phillips level 4/5 impact, we all know “contributing” is not a strong word. In the classic Kirkpatrick levels 1-4 model, training is best assessed at levels one and two. The next fair metric related to training is knowledge gain. Only then can we truly assess the business impact for which we’re all held accountable

ROI 66

Weighing the Options: Different Schools of Thought

CLO Magazine

Jack Phillips, chairman of ROI Institute Inc., a learning metrics and measurement consultancy, is a proponent of this approach. Phillips, who started the ROI Institute in 1993 and has written a number of books on the subject, adds a fifth level, return on investment, to the taxonomy. Then measure level 3, behavior, likely through participants’ self-assessments. To measure level 4, or impact, Phillips said learning leaders take the predetermined outcome measure.

Is this thing on? Tips for measuring course effectiveness and return on investment

Obsidian Learning

This checklist is a tool for assessing the quality of the course before it is deployed. In other words, it’s the final assessment you’re probably already doing in your courses – a series of questions, one or more simulations, instructor observation of learner actions, and so forth. Most of us require learners to correctly answer at least a certain percentage (perhaps 85% or 90%) of the Level 2 assessment questions. Phillips, J. New post Is this thing on?

Free learning & development webinars for June 2021

Limestone Learning

And we have so much to be optimistic about these days… As things open up and we contemplate a return to normal — or a close facsimile — many people are re-assessing how they work. How do organizations know which skills to assess?

Free 65

Instructional Design Basics: What Is ADDIE?

Convergence Training

The analysis phase of ADDIE is sometimes also called the training needs analysis and/or the training needs assessment. Create the actual assessments (tests) based on those criteria–yes, before you develop the training itself (!). The Phillips “ROI” Model.


What is stopping companies from measuring learning: Skillsets, datasets, toolsets or mindsets?


At the risk of sounding hyperbolic, it''s probably a more fair assessment to replace the rock with a series of boulders, which are best viewed through the lens of skillsets, datasets, toolsets and mindsets. Yet, L&D professionals continue to herald formal evaluation - Kirkpatrick and Phillips - as industry standards, essentially disregarding new tools at their disposal. . Is your company''s learning and development strategy wedged between a rock and hard place?

Free L&D webinars for April 2020

Limestone Learning

Identify, assess and close skill gaps. Join Patti Phillips, CEO of ROI Institute, and Katharine Aldana, Learning Design Manager at Verizon, as they describe four simple ways to forecast ROI for your programs. “ Flower, Yellow, Daffodil ” by Pixelia is licensed by Pixabay.

Free 77

Free L&D webinars for May 2018

Limestone Learning

Discuss how to correlate learner engagement with other critical organization metrics to tell an important story about the value of L&D investments. Show you how to leverage Kirkpatrick’s model of assessment and create a targeted strategy around level three and four assessments. What metrics for training ROI do you use? What metrics to set up, how to install, and how to follow them up to get results.

Free L&D webinars for October 2019

Limestone Learning

Join Patti Phillips, CEO of ROI Institute, and Katharine Aldana, Learning and Development Design Manager for Verizon, as they demonstrate how you can show the impact and ROI of your leadership development programs. The fundamental problem with both approaches is that the metrics are historical views and do not help workers impact work. What are some best practices we have learned so far for assessing existing courses and converting to HTML5?

Free 55

Free L&D webinars for March 2018

Limestone Learning

Our discussion will cover a range of topics, including identifying sales enablement’s unique purpose for your company; building consensus on goals and objectives; navigating the mandate for interlock with contributors in sales leadership, sales operations, and product marketing; and mastering the metrics that matter to your most important KPIs. The critical metrics for linking sales enablement to desired business outcomes, and growing your budget over time.