More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Years later, I realized that she had skipped Kirkpatrick’s Level 4: Results and substituted Phillips’ ROI. Isolating the Effects of the Learning Program.

An Overview: Phillips' Model for Learning Evaluation


While there are many other learning models we’ve yet to cover, the one we’re asked about most often that’s not mentioned in our original series is Phillips' Learning Evaluation Model. In a nutshell, Phillips' model focuses on how to: collect data, isolate the impact of training versus the impact of other factors, and. Tip: Find out even more about Phillips' Model for Learning Evaluation in Jack Phillips' book.).


Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

A Tale of Two Cases: Mobile Solutions with Phillip Neal #ASTDTK14

Learning Visions

These are my live blogged notes from a session on the final day of ASTD Tech Knowledge with Phillip Neal, VP of Business Need at Maestro. Through the application, people can rate the content and give feedback to T&D group about how effective. One of the struggles with mobile is that organizations are used to designing the way they always have and that fits within their existing models of what training is. Mobile is different. (It’s

Why is eLearning undervalued? Peter Phillips considers.

Unicorn Training

Peter Phillips'(Unicorn Training Chairman) considers why eLearning may still be undervalued as a training resource despite the cultural fascination with online technologies. Well, in fact far from being alternatives, good design and effective learning go together like Pooh and Piglet. Listen to Peter Phillips' thoughts on immersive learning here

Showing the ROI of key programs on a budget

CLO Magazine

For example, an action plan can shift the application and impact data collection and analysis to the participants, who provide details of action steps followed and the impact achieved, sort out the effects of the program and even convert data to money.

ROI 84

Evaluating Training Effectiveness and ROI


To evaluate the effectiveness of education and its practicability from the financial standpoint, it is necessary to calculate the expenses connected with creating and conducting the trainings, gauge the results achieved by the employees who have taken part in them, and decide whether the increase in the employees’ efficiency and company profits was sufficient to recoup the associated costs.

ROI 100

How to Effectively Shift to Online Teaching: The Ultimate Guide

TechSmith Camtasia

You were able to easily measure your content’s effectiveness and student performance. By humanizing your content and leveraging the benefits of asynchronous communication and learning, you can create courses that are as effective — or even more effective — as face-to-face learning.

Teach 83

ROI Goes to School and Church

CLO Magazine

The Phillips ROI Methodology is a 10-step process organizations can use to show the value of programs and initiatives. Church leaders know that by addressing the gaps in performance in their business measures, they can achieve their goal of creating 3 million “difference makers” — people who effect or deliver change (level 3), make improvements and have an impact on those they influence (level 4). Phillips, Ph.D., Phillips, Ph.D.,

ROI 46

Effective Learning – Musings from the UnConference

Learning Cafe

This blog post is a summary of the “ Effective Learning ” stream of the Learning Cafe UnConference which was led by Bob Spence. This stream, which was well attended all day, was concerned with how we can make learning more effective and to this end five separate Sessions dealt with some of the many and various aspects of effectiveness. Bob argued that the accountability for learning effectiveness does not rest with the learning and development function solely.

Training Evaluation – 5 Best Ways to Evaluate Training Effectiveness and Impact


Training evaluation refers to an attempt to obtain relevant information on the effects of a training program. It is considered an essential aspect of a training event to be able to reflect, analyze, and improve its effectiveness and efficiency. The Phillips ROI Model.

Do You Know Whether Your eLearning is Effective?


Two questions any eLearning designer should ask when designing a course are, “How will I know if this eLearning course is effective and how will I define effective?” A surgeon wants to know whether a procedure is effective. An eLearning designer wants to know whether a training course is effective. . If a surgical procedure is effective, the patient recovers. If a car repair is effective, the car operates properly.

CAC Presentations

Kapp Notes

Phillips kicked off the CAC this year with introductions and advice for attendees. Dr. Phillips kicks off the CAC. The first presentation this semester is by Robyn Defelice who is discussing project management and the elements that contribute to effectively managing a project. Robyn Defelice discussing project management, instructional design and finding your inner PM. Check out all the presentations at our live link. The CAC event is packed, with a full house.

Is this thing on? Tips for measuring course effectiveness and return on investment

Obsidian Learning

Tips for measuring course effectiveness and return on investment on Obsidian Learning. To answer these questions, we’ll look at several ways you can measure the quality and effectiveness of the learning activities you develop: Pre-delivery quality check. We’ll cover QC in depth in another blog article, but here’s a summary of what to do: Storyboard/Content Validation: Test all course content for instructional effectiveness, grammatical accuracy, and stylistic clarity.

Getting to the Bottom Line: Full ROI Study


I’m honored to have this week’s blog post come directly from one of the experts, Patti Phillips from the ROI Institute. This simple, yet effective soft skills program resulted in an ROI of over 5500% 1. Effectiveness of solution implementation. Phillips, Ph.D.

Employee performance goals; Choosing the right training evaluation model

Learning Pool

Phillips proposed adding a fifth level to the model, return on investment (ROI). Phillips is probably your guy. . Phillips adds a fifth level to Kirkpatrick, ROI, and gives a methodology for calculating the financial impact of programs. Effects of transfer.

Building a Business Case to Optimize Impact


We’re partnering with Jack and Patti Phillips of the ROI Institute to share insights about financial modeling for L&D. Enhance the effectiveness of executive and operational reporting. Performitiv is excited to announce a new webinar taking place September 23.

Introduction to Performance Consulting

Infopro Learning

You can measure the results from performance consulting initiatives using the following levels of evaluation (ref: Jack and Patti Phillips — ROI methodology): Level 1: Have employees responded favorably to the new initiatives? If you are interested in learning more, Infopro Learning breaks learning performance consulting into three main categories; Business and Performance Gap Analysis , Learning Strategy , and Learning Effectiveness Evaluation.

Three Challenges Faced by Today’s L&D Leaders

Your Training Edge

Most challenges faced by training managers today, I believe, fall into a three broad categories: Developing effective, impactful learning solutions that keep pace with technology and changing learning behavior. Rob Brinkerhoff, a professor at Western Michigan University and thought leader in the field, puts that number 80 to 85% (Phillips, 2016)! In a 2008-2009 study, Jack and Patti Phillips surveyed the CEOs of Fortune 500 and large, private-sector employers. Phillips, Ken.

3 Questions to Ask When Picking a Learning Management System


When deciding on the right system for your business, receiving answers to key questions can help leaders narrow down the most effective LMS for their needs. Phillips 2 , contributor to the Association for Talent Development and chairman of The ROI Institute, clarified the process: “First, showing the cost versus benefit of an e-learning approach is no different than any other delivery method. Phillips, Jack J.

Getting to the Bottom of ROI: What Are My Options?


A soft return might be in the form of a presentation summarizing results around how effective a program was. This is the most rigorous approach and aligns to the work done by Patti and Jack Phillips of the ROI Institute.

ROI 52

AWS Bucket code

Adobe Captivate

I tried copying the code you gave. {“Version”:”2008-10-17″,”Id”:””,”Statement”: [{“Sid”:”AddPerm”,”Effect”:”Allow”,”Principal”: {“AWS”:”*”},”Action”:”:”s3:GetObject”,”Resource”:”arn:aws:s3:::hillfort/*”}]}. Mal Phillips. Hi, Paul Wilson.

How do you measure how training creates value? – The 7 learning principles

Learning Wire

The Kirkpatrick/Phillips model shows us how and why to assess training outcomes. Instead of a set of data, it involves a chain of measurable proofs of benefit, as shown in the Kirkpatrick/Phillips pyramid. The Kirkpatrick/Phillips pyramid identifies five dimensions that form a sequence: What is the value created for my company? According to Kirkpatrick, each dimension of the pyramid has an effect on the one above: it impacts the one above, but doesn’t necessarily trigger it.

[Free Webinar] How to measure and maximize the ROI of eLearning

Adobe Captivate

So how can you effectively measure the ROI of your online training? The approach uses Kirkpatrick’s model of training evaluation and Kirkpatrick-Phillips evaluation model of training to measure training effectiveness and arrive at the ROI. What is Kirkpatrick-Phillips evaluation model of training? • There are numerous ways in which training can be delivered and consumed by learners.

Timing is Everything Series: Part 6 Structured vs. On-Demand Learning

Infopro Learning

Using a structured approach lets managers maintain control over the training program, evaluate its effectiveness, and budget for it.1 Sources: Phillips, J. Timing is Everything Series: Intro , Anxiety , Information Overload , Knowledge Formation , Optimum Performance , Growth , Stagnancy , or Decline , Structured vs. On-Demand Learning, ( Download the complete white paper ). Structured vs. On-Demand Learning.

E-Learning vs. In-Person: A False Dichotomy

The Performance Improvement Blog

The single most effective way to eliminate in-person training related costs is to replace classroom instruction with online training. The important question is, “What types of learning interventions for what results and under what circumstances are more effective?”This If I want employees to know the new rules and regulations for FDA compliance, maybe an online program will be sufficiently effective to communicate to them what they need to know.

Talent Development Reporting Principles: The Evolving Standard for L&D

CLO Magazine

Kent and Tamar also established an advisory group of thought leaders in the field including Jack Fitz-enz, Rob Brinkerhoff, Jack Phillips, Josh Bersin, Frank Anderson, and Laurie Bassi. The recommended three for L&D are the business outcomes statement, the effectiveness statement, and the efficiency statement. The Business Of Learning business outcome statement effectiveness statement efficiency statement reporting principles TDRP

How to Improve Learning Retention with Contextual Feedback


To mitigate this risk, instructional designers should have a formal decision-making plan in place to provide effective feedback to their students. While the answer you selected includes some of Kirkpatrick’s Levels of Evaluation, the aspect of Return-on-Investment was developed by Jack Phillips. Jack Phillips, on the other hand, took Kirkpatrick’s model to the next level and focused on Return-on-Investment.

Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

This free eBook, Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation, provides practical tips that you can use to measure the effectiveness of online training, leading to the ROI on your training spend. The approach uses Kirkpatrick’s model of training evaluation and Kirkpatrick–Phillips evaluation model of training for measuring the effectiveness of eLearning to arrive at the ROI.

Vale Don Kirkpatrick

Clark Quinn

I certainly can’t fault him for it either, as he did have a sensible model and it could be put into effective use. The Phillips have made a similar career with their fifth level, ROI, measuring the cost of impacting level 4 against the value of the impact. Last week, Don Kirkpatrick passed away. Known for his four ‘ levels ‘ of measuring learning, he’s been hailed and excoriated. And it’s instructive to see why on both sides.

Unlocked Learning—Training analytics made easy


Being able to measure your team’s training is crucial to its effectiveness. So our CEO Ryan started consulting with firms to see how knowledge was being shared effectively and where teams engaged most.

5 More Great Books for Your Learning & Development Bookshelf

Mike Taylor

Mager and Pipe do this from a holistic perspective focused on finding the true problem and then looking for the most effective and efficient solution. Dana Gaines Robinson, James Robinson, Jack Phillips Partricia Phillips & Dick Handshaw. This book is the place to start for understanding how best to present content with text, graphics, and audio as well as considerations for when these guidelines are most effective.

Pipes 66

We're pleased to announce another record year for us!

Unicorn Training

We also partnered with the University of London and Learning Age Solutions Ltd (LAS) and won the Gold Award for Best Use of Simulations or Virtual Environments at the Learning Technologies Awards.Peter Phillips, Unicorn CEO, said: “Each of our main business streams - content development, platform licences, off the shelf compliance solutions, and games and simulations - achieved double digit growth in the financial year.

eLearning Course Development – What’s The Right Tool for the Job?

ePath Learning

You won’t get far using a flat head (or slotted) screwdriver when you really need a Phillips screwdriver. About the Author: Kris Castiaux is a Learning Environment Concierge (instructional designer) focused on creating impactful and effective learning experiences and environments. Before beginning any home improvement project, you should make sure that you have the proper tools and materials to complete the job.

How do we measure value creation from training?

Learning Wire

In this second article, we’ll be looking at the different aspects of training evaluation represented in diagram form, the three key principles that will help you to evaluate effectively, and a few tips to avoid the issue of intangibles. Next, knowledge acquisition is measured a few weeks later, to assess how effectively knowledge and skills have been passed on to the learners. Now we measure how effectively the acquired knowledge has been applied in the workplace.

Are learning objectives really that important?

The eLearning Nomad

He also adds, “Depending on how it is employed, it may contradict many of what are deemed to be central principles of effective practice of facilitating learning – a democratic ethos, the collaborative determination of curricula, flexibility of format and direction, and the encouragement of self-direction among learners.”. Yet, the evaluation models most talked about in the e-learning sector (Kirkpatrick and Phillips) do exactly that.

Raspberry Thursday As Unicorn Mark's 25th Year With Rebrand

Unicorn Training

[caption id="attachment_2373" align="alignleft" width="225"] CEO, Peter Phillips, celebrates Unicorn's new look[/caption] We've come a long way since the days of floppy disks and giant pixels – leading international eLearning company, Unicorn Training, ushered in our 25th Birthday year with a funky new facelift and party at our Bournemouth HQ today (Thursday 10 January).

In a word: Here’s how Bloomingdale’s, Toys”R”Us, Toyota and others describe Axonify


Peter Sprague – Senior Manager of Sales Effectiveness at Ceridian HCM. Mia Phillips – National Manager of Dealer Education Strategy and Digital Solutions at Toyota. As the old adage goes, “The customer is always right!”. So, I decided to ask some of our customers how they would characterize the Axonify Employee Knowledge Platform in one word. They’re definitely right.

Toys 100