More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I have been blogging a lot about Training Evaluation this year—mostly Kirkpatrick , but also Brinkerhoff and Scriven. I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation.

An Overview: Phillips' Model for Learning Evaluation

Watershed

When we originally published our Learning Evaluation eBook and blog series, we covered four learning evaluation models representing a range of approaches and perspectives: Kirkpatrick, Kaufman, Brinkerhoff, and Anderson. While there are many other learning models we’ve yet to cover, the one we’re asked about most often that’s not mentioned in our original series is Phillips' Learning Evaluation Model. Meet the fifth level of learning evaluation.

The Kirkpatrick-Phillips Model – Part 4

CommLab India

In the third part of this series, we looked at the advantages and disadvantages of the Kirkpatrick Model of Evaluating a training program. I mentioned the Kirkpatrick-Phillips Model of Evaluation in passing, and promised you more on this “ evolved ” model.

What Is Learning Evaluation?

Watershed

Knowing how to aggregate and evaluate all types of learning is a priority for many learning and development practitioners. Technologies are becoming available that enable L&D professionals to aggregate, evaluate, and measure many types of learning data in one place.

The Phillips ROI MethodologyTM – Measuring Data at All Levels – Part 5

CommLab India

Part 1 , Part 2 , and Part 3 of this series dealt with the Kirkpatrick Model of evaluating a training program. In the fourth part of the series, we saw how the Phillips ROI Methodology TM suggests that measurements be taken at every level.

Interview with Jack Phillips on ROI for eLearning

Mindflash

Jack Phillips is founder and CEO of the ROI Institute, Inc., Phillips developed the ROI Methodology™, a critical tool he has used for measuring and evaluating programs such as training, human resources, technology and quality programs and initiatives.

Evaluation and ROI in Compliance Training

Interactive Services

The chances are your program includes some or all of the following: A focus on behavior change and employee conduct rather than just knowledge. But what about evaluation and return on investment (ROI)? . Evaluating Compliance Training Programs.

Learning to Learn from Evaluation of Learning

The Performance Improvement Blog

The Kirkpatricks have four levels, the Phillips have ROI, and Brinkerhoff has the Success Case Method. Each approach to evaluation of training has something to contribute to assessing the impact of formal training on employee learning.

Evaluating Training Effectiveness and ROI

Geenio

How to convince one’s manager that it is worthwhile (and profitable) to continue the training program and expand it to include other departments if you have no data to profit cost ratio to back you up? The Donald Kirkpatrick’s Learning Evaluation Model consists of four levels: Level 1.

ROI 130

Kirkpatrick’s Four Levels of Evaluation

Learnnovators

It was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs. To decide whether to continue offering a particular training program 2. To improve future programs 3.

Predicting Learning Success

CLO Magazine

Phillips is chairman and Patti P. Phillips is president and CEO of the ROI Institute. Part of the evaluation mix should be the predictions of success. We know from experience that programs are evaluated infrequently at level 3, less often at level 4 and rarely at level 5.

Watershed's 7 Steps of Learning Evaluation

Watershed

Out of the dozens of different learning evaluation models currently in practice, which one is right for you? Meet our "super method" for learning evaluation. Identify program goals and. evaluate alignment with strategic priorities. Step 6: Analyze evaluation outcomes.

Is Kirkpatrick’s Model of Evaluating a Training Program The Best? – Part 3

CommLab India

In the first part of the series, I covered the need to evaluate any training program and the basics of the Kirkpatrick model of evaluating a training program. Therefore, it would not be right to make changes to a program based on learners’ reactions.

Three Superheroes of Training Evaluation

Growth Engineering

Well, let’s look at the heroes of training evaluation and how they helped make sense of training evaluation! Followed by Roger Kaufman and then Jack Phillips. This trio laid the foundations that help you evaluate your training. Hero Profile 3: NAME: Jack Phillips.

Evaluating Training – Capturing the Benefits Aspect of ROI

Obsidian Learning

New post Evaluating Training – Capturing the Benefits Aspect of ROI on Obsidian Learning. Training evaluation is necessary and, in many ways, critical to the success of a business. When BCR is greater than one, the benefits outweigh the costs and the program is considered a success.

ROI: Determine the Impact of Your Training Programs

Mindflash

And, measuring the ROI for your training programs is no exception. Industry Growth Means Managers Need to Understand the Business Impact of Their Training Programs. Industry growth suggests that companies will continue to invest in training programs – online and offline.

ROI 52

ROI Goes to School and Church

CLO Magazine

How are these organizations using the ROI Methodology to show the value of their projects and programs? The Phillips ROI Methodology is a 10-step process organizations can use to show the value of programs and initiatives. Phillips, Ph.D., Phillips, Ph.D.,

ROI 60

Impact and ROI of Learning: Worth Pursuing or Not?

CLO Magazine

The primary reason is that senior corporate leaders like the CEO and CFO want to see it and so should the department head and program director. In conclusion, we must not shy away from higher levels of evaluation because they are harder or more subjective.

ROI 67

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

Adobe Captivate

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. ROI determination methodology: One of the popular models used for ROI determination is the Kirkpatrick’s model of training evaluation. What Is Kirkpatrick’s Model Of Training Evaluation? Kirkpatrick’s model of training evaluation is one of the popular models used to evaluate the effectiveness of training.

ROI 56

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. What Is Kirkpatrick’s Model Of Training Evaluation?

Putting Thought to Work: Evaluation in Practice

CLO Magazine

Organizations that have reached higher measurement levels use a blended approach for the various frameworks and find ways to customize evaluation. The company organizes its learning evaluation data using a tool, Metrics That Matter, from KnowledgeAdvisors that connects directly to its learning management system. Jaime Maas, manager of organizational development at Qualcomm, said its program managers are assigned to specific learning topics.

Demonstrating Your Training Program’s Return on Investment

Learning Wire

As distance‐learning programs grow ever more popular, companies have discovered that technology‐ driven learning can be a critical tool to communicate new information and regulations with far‐flung workers, and to help businesses that are experiencing significant growth get employ- ees quickly on the same page. We address these issues, as we discuss return on investment (ROI), and the importance of establishing clear business needs and program objectives.

ROI 43

Is this thing on? Tips for measuring course effectiveness and return on investment

Obsidian Learning

The Kirkpatrick four levels of training evaluation. While later stages of evaluation measure more obvious aspects of quality—such as the impact of the training on the learner—it’s important not to overlook the less obvious factors, such as instructional design or the use of technology.

Ratio 79

How do you measure how training creates value? – The 7 learning principles

Learning Wire

Let’s begin with the evaluation of learning. Why evaluating? Are there credible measurement methods to evaluate value creation? The Kirkpatrick/Phillips model shows us how and why to assess training outcomes. What should we evaluate? Phillips, 2006).

How do we measure value creation from training?

Learning Wire

In a previous article we looked at the five levels of impact in any exhaustive training evaluation process that reflect the key challenges involved in high-quality evaluation. We also looked at the limitations of evaluations due to non-measurable (intangible) factors.

Do You Have a CEO-Friendly Scorecard?

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. The scorecard should offer insight into how L&D programs contribute to improvements in bottom-line measures. This can be collected with every follow-up evaluation conducted.

Measuring the Effectiveness of Your Training

Training Industry

Something must be done so that business leaders can find useful and pertinent information about the effectiveness of training programs, make better use of the training budget, and obtain the results they seek. Jack and Patti Phillips’ model of evaluation emphasizes the importance of tying evaluation to learning objectives. For evaluation to be truly effective, we must start with the end in mind. While valuable, reaction evaluation is not enough.

A Legend’s Look at Learning

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. To see learning as an investment, strategic, expensive and important programs must add business value. Jack J.

E-Learning vs. In-Person: A False Dichotomy

The Performance Improvement Blog

Although this is obviously a marketing piece to promote Citrix Online’s GoToMeeting Corporate product and does have some useful suggestions for selling Web-based programs internally, it sets up a false dichotomy: online vs. in-person. No one can deny that online programs offer a substantial cost savings over in-person training and conferences. In fact, when the argument shifts to results from online programs, the authors can’t help disagreeing with themselves.

Evidence or Proof of L&D Impact? Why Not Both?

Performitiv

It means that an L&D manager said they ‘felt’ there was impact because the program was delivered without incident. It makes sense to plan to do an in-depth analysis via the causal model or Impact Study to comprehensively conclude if there was impact or not from the program.

Make a Credible Business Connection

CLO Magazine

Few would dispute how important learning programs are for business results. As the value of learning unfolds, five levels of evaluation are possible: reaction, learning, application, impact and ROI, driven by objectives at each level. Phillips is the chairman, and Patti P.

Feed the Gorilla

CLO Magazine

A senior executive questions the value of a certain program and wants to see the results. In many cases, the gorilla has concluded that a program — usually an expensive one — is not adding value, so maybe it should be eliminated. We must change the ways we evaluate and report results.

To Deliver Results Start with Why?

CLO Magazine

Demonstrating the business value for learning is not a matter of providing more resources for measurement, evaluation and analytics. Too many learning and development programs are implemented without a clear business need. Too many programs are implemented for the wrong reasons.

Mobile Learning: CHANGE YOUR WAYS OR YOU ARE DOOOOOMED!

Dashe & Thomson

I renew my contentions that providing device-agnostic content, not to mention evaluating it, is tricky on the small screen of a smartphone, and costly in a world where companies are not always providing all staff with handheld devices.

Conquer Your Fear of Results

CLO Magazine

We showed him how to evaluate a coaching project at the impact and ROI level. The perception is if the ROI is negative, it will reflect on the entire team’s performance: the intermediate client who bought the program, the program designers, the coaches or the individuals being coached.

Conquer Your Fear of Results

CLO Magazine

We showed him how to evaluate a coaching project at the impact and ROI level. The perception is if the ROI is negative, it will reflect on the entire team’s performance: the intermediate client who bought the program, the program designers, the coaches or the individuals being coached.

Weighing the Options: Different Schools of Thought

CLO Magazine

The framework for learning evaluation and measurement embraced by most in the industry starts with Kirkpatrick. The framework for learning evaluation and measurement embraced by most in the industry starts with Kirkpatrick. The longtime University of Wisconsin at Madison professor wrote a series of articles in 1959 for the American Society for Training and Development that outlined what became known as the four levels of evaluation — reaction, learning, behavior and results.