Interview with Jack Phillips on ROI for eLearning

Mindflash

Jack Phillips is founder and CEO of the ROI Institute, Inc., Phillips developed the ROI Methodology™, a critical tool he has used for measuring and evaluating programs such as training, human resources, technology and quality programs and initiatives. We also provide certifications so that people can do the ROI analysis on their own. The challenge is that people who own programs may not want to measure them at the impact and ROI levels.

The Phillips ROI MethodologyTM – Measuring Data at All Levels – Part 5

CommLab India

In the fourth part of the series, we saw how the Phillips ROI Methodology TM suggests that measurements be taken at every level. Methods to measure: A lot of sources such as performance records and operational data will provide valid business impact measurements at this level – sales figures, changes in the quality of work, and the amount of time saved to name a few. Level 5: ROI. Methods to measure: Several ROI calculating tools are available.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

An Overview: Phillips' Model for Learning Evaluation

Watershed

While there are many other learning models we’ve yet to cover, the one we’re asked about most often that’s not mentioned in our original series is Phillips' Learning Evaluation Model. In a nutshell, Phillips' model focuses on how to: collect data, isolate the impact of training versus the impact of other factors, and. Tip: Find out even more about Phillips' Model for Learning Evaluation in Jack Phillips' book.). Don’t assume reduced costs = ROI.

Getting to the Bottom Line: Full ROI Study

Performitiv

Welcome back for our final installment of the Getting to the Bottom of ROI blog series. I’m honored to have this week’s blog post come directly from one of the experts, Patti Phillips from the ROI Institute. ROI in Soft Skills. Success with ROI.

Impact and ROI of Learning: Worth Pursuing or Not?

CLO Magazine

Instead, they call for showing the alignment of learning to business goals, focusing on easier-to-measure participant reaction, amount learned and application (levels 1, 2 and 3, respectively, of the Kirkpatrick Model/Phillips ROI Methodology) and finally focusing on employee engagement with learning (consumption of learning and completion rates). However, for certain types of learning there is still a need to measure impact and ROI (levels 4 and 5 of the ROI Methodology).

ROI 52

ROI: Still Evoking Confusion and Controversy

CLO Magazine

The return on investment concept for learning has been around since Jack Phillips introduced it about 40 years ago. Here is an example from an email I received: “Anyone who is involved in the business world is familiar with the concept of ROI. But when it comes to learning initiatives, gathering the necessary data to calculate ROI is difficult to put it mildly.” First, ROI used in the business world, should not be confused with ROI used in the learning world.

ROI 56

Why Don’t Businesses Measure Training ROI?

LearnUpon

However, an overwhelming 61% of training leaders said that they don’t measure training ROI. . With over 80 respondents, our training ROI survey uncovered the real reasons businesses aren’t calculating success, and the important ways to overcome these barriers. . “We

ROI 52

How to Calculate the ROI of Training Programs: The Formula

LearnUpon

When it comes to ROI, there are challenges that learning leaders face , but it’s important to know there are practical solutions. We want to help you tackle the unknown of ROI, and overcome the issues to track this holy grail metric. The ROI Formula.

Evaluating Training – Capturing the Benefits Aspect of ROI

Obsidian Learning

New post Evaluating Training – Capturing the Benefits Aspect of ROI on Obsidian Learning. Calculating ROI. Return on investment (ROI) is a quantification of the relation between the benefits of a program and its costs [benefit-cost ratio (BCR)]. Another useful and often employed formula expresses ROI as the percentage return on the costs incurred. The formula to calculate ROI in this way is: ROI (%) = Benefit – Cost x 100 Cost.

eLearning ROI Case Study: How To Maximize Your Returns

EI Design

I share an eLearning ROI case study that demonstrates how L&D teams can improve and maximize the ROI of corporate training. This demonstrates how you can maximize the ROI by adopting our approach, based on Kirkpatrick’s model of training evaluation. How To Maximize ROI In Corporate Training: A Case Study. What Is ROI On Corporate Training, And Why Is This Measurement Critical Gor L&D Teams? eLearning ROI Case Study.

20 Key Takeaways from ATD 2019

Docebo

Panel discussion with learning leaders from PPD, Explorance and Verizon and also Patti Phillips from the ROI Institute covering how to measure and demonstrate the value of L&D. CLO Magazine found that 71% of organizations are planning to find a way to find the impact and according to another study what’s most important to organizations when it comes to the L&D program is the impact, ROI then awards. Patti Phillips, PH.d,

Docebo 133

The Essential Guide to Learning Analytics in the Age of Big Data

Lambda Solutions

Evaluating Learning Analytics and Measuring ROI. Data Points to Prove the ROI of Learning Analytics. Evaluating Learning Analytics and Measuring ROI. It’s the most recognized method of evaluating a training program’s ROI. Adding ROI to Kirkpatrick.

Make a Credible Business Connection

CLO Magazine

As the value of learning unfolds, five levels of evaluation are possible: reaction, learning, application, impact and ROI, driven by objectives at each level. For example, consider a sales scenario where a sales learning program’s objective is to increase sales from existing customers by 10 percent in six months. In the evaluation, you track the impact measure, “sales from existing customers.” Phillips is the chairman, and Patti P.

Is this thing on? Tips for measuring course effectiveness and return on investment

Obsidian Learning

Determination of Return On Investment , or ROI. The Sales team will be asked to provide historical data on sales of equipment. The historical sales data will be analyzed to determine if sales of equipment increased following training. ROI Results Evaluation. Return on Investment (ROI) measures the financial benefit to the organization of training. Increased equipment sales. Phillips, J. New post Is this thing on?

The Training Evaluation Framework of the Future: The GEvaluation Framework

Growth Engineering

We drew inspiration from heroes of old like Donald Kirkpatrick, Roger Kaufman and Jack Phillips and injected these old models with a serum that transformed it into a lean mean evaluating machine. Batman Bruce Wayne introduced a training scheme for his staff to help them improve their sales of combat equipment. Bruce was pleasantly surprised at how many team members had changed their behaviour and become sales superheroes! Have sales increased?

Looking Back and Ahead on the Measurement and Management of L&D

CLO Magazine

On the measurement side, I am thinking of Don Kirkpatrick, who gave us the four levels, and Jack Phillips, who gave us isolated impact for level 4 and ROI for level 5. On the management side, I am grateful again for the contributions from Don and Jack, and now Jim and Wendy Kirkpatrick and Patti Phillips as well, for their guidance in how to manage, particularly with respect to partnering closely with goal owners and focusing on what it takes to achieve level 3 application.

Here’s the latest thinking on measurement, analytics and reporting

CLO Magazine

Application, Impact and ROI. For years, surveys of learning professionals have shown plans to significantly increase higher-level measurement (level 3 application, level 4 impact and level 5 ROI). In other words, don’t just stop with level 4 impact and level 5 ROI.

Free L&D webinars for December 2020

Limestone Learning

Professionals involved must be prepared to step up to the challenge of showing the value of major programs and initiatives, not only when impact and ROI are requested, but ideally before the request is made. The challenge is to decide which programs are evaluated at impact and ROI.

Free 64

Free L&D webinars for March 2021

Limestone Learning

PT: Powerful Presentation Openings for Successful Sales Meetings Struggling to make an impact with your presentations? This session highlights an ROI study that shows how virtual learning delivered business value in terms that executives, sponsors, and funders appreciated and understood.

Free 90

Mobile Learning: CHANGE YOUR WAYS OR YOU ARE DOOOOOMED!

Dashe & Thomson

For example, a tech company that supports a government initiative requiring the purchase of mobile devices for use in schools stands to profit twice: once with the initial sale of the technology, and again when a better educated, more productive workforce has disposable income to spend on future technology. While many acknowledge the value of human resource development, few companies are prepared to analyze ROI on an asset as “fuzzy” as a well-trained employee.

Free L&D webinars for December 2019

Limestone Learning

Wednesday, December 4, 2019, 9AM – 10AM PT: What Caused the ROI? In this session, Dr. Patti Phillips, CEO, ROI Institute, Inc., Here’s where ROI comes in. During this webinar, you’ll learn what ROI is, what it’s not, and how to make it work.

Free 70

Weighing the Options: Different Schools of Thought

CLO Magazine

Jack Phillips, chairman of ROI Institute Inc., Phillips, who started the ROI Institute in 1993 and has written a number of books on the subject, adds a fifth level, return on investment, to the taxonomy. Consider this sales training example. One way to determine the financial impact on a sales training program is to isolate a group of sales workers who participated in training and those who did not.

Kirkpatrick’s Four Levels of Evaluation

Learnnovators

Level 4 Evaluation – Results: The fourth and final level tries to assess training with regards to business results, for example, determining if sales transactions improved after training of sales staff. Since Kirkpatrick stated his original model, other theorists like Jack Phillips, have referred to a fifth level, namely, Return On Investment (ROI). It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs.

KIRKPATRICK’S FOUR LEVELS OF EVALUATION

Learnnovators

Level 4 Evaluation – Results: The fourth and final level tries to assess training with regards to business results, for example, determining if sales transactions improved after training of sales staff. Since Kirkpatrick stated his original model, other theorists like Jack Phillips, have referred to a fifth level, namely, Return On Investment (ROI). It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs.

Demonstrating Your Training Program’s Return on Investment

Learning Wire

We address these issues, as we discuss return on investment (ROI), and the importance of establishing clear business needs and program objectives. Realizing that ROI Isn’t Difficult! Working out ROI for distance‐learning efforts needn’t be a mystery. Properly measuring ROI provides an answer to the crucial question: for every dollar invested in distance learning, how many dollars are returned after the investment is recovered? Calculating ROI.

ROI 43

The Training Evaluation Framework of the Future: The GEvaluation Framework

Growth Engineering

We drew inspiration from heroes of old like Donald Kirkpatrick, Roger Kaufman and Jack Phillips and injected these old models with a serum that transformed it into a lean mean evaluating machine. Batman Bruce Wayne introduced a training scheme for his staff to help them improve their sales of combat equipment. Bruce was pleasantly surprised at how many team members had changed their behaviour and become sales superheroes! Have sales increased?

Start with the End in Mind

CLO Magazine

This approach is advocated by all the leaders in our field including Jack and Patti Phillips, Jim and Wendy Kirkpatrick, Roy Pollak, et al. Let’s first consider the type of learning that can contribute to your organization’s goals, such as sales training, cost reduction, quality improvement, employee engagement and leadership improvement efforts. For example, if the goal is to increase sales or employee engagement, what impact do you believe training can have on achieving the goal?

Free learning & development webinars for September 2020

Limestone Learning

Tuesday, September 15, 2020, 11AM – 12PM PT: Where the Rubber Meets the Virtual Road: Preparing for Q4 Sales teams, have faced a long list of challenges this year due to the pandemic. “ Chestnut, tree, nature ” by Holger Schué is licensed by Pixabay.

Reflections on Learning Solutions Conference 2014 (Part 2)

Unicorn Training

Fresh back from sunny Orlando, Unicorn CEO Peter Phillips reflects on the key themes of LS Con 14. The second was led by Glenn Bull, CEO of Skilitix a charismatic exponent of an ROI led future for learning. But the real benefits will come from relating experiences to outcomes – more sales, fewer complaints, improved medical outcomes etc.

SCORM 40

Free L&D webinars for May 2018

Limestone Learning

Tuesday, May 1, 2018, 11AM – 12PM PT: The ROI Dilemma: Measuring Results of Your Learning Programs (Free for ATD members) Significant resources are being allocated to training and development across most organizations, but many companies still find themselves unsure of results. L&D can’t prove ROI using the same methods other parts of the business do. Much of the effort around expensive ILT is focused on reducing costs as a means of improving ROI.

Talent Development Reporting Principles Part 2: The Three Statements

CLO Magazine

a 10% increase in sales), any other goals which will be supported by learning, and the expected impact or importance of learning on achieving those goals. In addition to sales, goals might include market share, cost, quality, innovation, productivity, customer satisfaction, employee engagement, retention, and many others. Levels 4 (impact) and 5 (net dollar benefits or ROI) are recommended for key programs.

Free L&D webinars for October 2018

Limestone Learning

Thursday, October 4, 2018, 6AM – 7AM PT: Microlearning: 5 Techniques to Improve Job Proficiency and Prove ROI on Training Investments (Free for ATD members) How can organizations measure the impact of training investments and whether employees are applying learning in the field? Join Neha Gupta of True Office Learning, as she evaluates common e-learning capabilities for cognitive soundness, meaningful engagement, impactful efficacy, and measurable ROI.

Commonly Used Training Evaluations Models: A Discussion with Dr. Will Thalheimer

Convergence Training

People talk about the Philips model (aka ROI) , the Kaufman model , Roger Kaufman’s work, and Rob Brinkerhoff as well through the success case methodology. And okay, if we can just walk through each of the four models you talked about–Kirkpatrick, Phillips, Kaufman, and Brinckerhoff–and maybe you can explain to people, especially people who may not have heard of any of these, what they are and what are some pros and cons of each. Jack & Patti Phillips: [link].

Free L&D webinars for March 2018

Limestone Learning

Tuesday, March 13, 2018, 10:30AM – 11:30AM PT: When Sales Enablement Fails: Discover the Pitfalls That Can Sabotage Your Program (Free for ATD members) You’re familiar with a to-do list. In this webcast, we’ll tackle your sales enablement don’t-do list, with a look at the common mistakes practitioners make when designing, executing, and measuring their program investments. Tuesday, March 13, 2018, 11AM – 12PM PT: Want Results from Your Sales Training?