Front-End Analysis: Backward Analysis and the Performance Gap

Dashe & Thomson

Don Clark, on his Big Dog, Little Dog: Performance Justification blog post “Analysis” says that the Japanese approach to performance improvement is to ask “why” five times when confronted with a problem or a desire to improve a part of an organization. The post Front-End Analysis: Backward Analysis and the Performance Gap appeared first on Social Learning Blog.

More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I have been blogging a lot about Training Evaluation this year—mostly Kirkpatrick , but also Brinkerhoff and Scriven. I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Trend line analysis.


Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The Phillips ROI MethodologyTM – Measuring Data at All Levels – Part 5

CommLab India

This blog is the 5 th part of the Kirkpatrick series that I have been writing about over the last few weeks. Part 1 , Part 2 , and Part 3 of this series dealt with the Kirkpatrick Model of evaluating a training program. In the fourth part of the series, we saw how the Phillips ROI Methodology TM suggests that measurements be taken at every level. An analysis tool must be used to measure outcomes.

Is Kirkpatrick’s Model of Evaluating a Training Program The Best? – Part 3

CommLab India

This is the third blog in the Kirkpatrick Model of Instruction series. In the first part of the series, I covered the need to evaluate any training program and the basics of the Kirkpatrick model of evaluating a training program. In the second part of this series, I delved into each level of the Kirkpatrick model. It won’t stop just there – there would need to be an in-depth analysis conducted into the reasons for failure. His name is Dr. Jack Phillips.

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

Adobe Captivate

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business. Training Needs Analysis (TNA). What Is Kirkpatrick’s Model Of Training Evaluation?

ROI 56

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business. Training Needs Analysis (TNA). What Is Kirkpatrick’s Model Of Training Evaluation?

Impact and ROI of Learning: Worth Pursuing or Not?

CLO Magazine

Instead, they call for showing the alignment of learning to business goals, focusing on easier-to-measure participant reaction, amount learned and application (levels 1, 2 and 3, respectively, of the Kirkpatrick Model/Phillips ROI Methodology) and finally focusing on employee engagement with learning (consumption of learning and completion rates). In other cases, statistical analysis like regression may be used to estimate the isolated impact from the training.

ROI 52

Don Kirkpatrick’s Contribution to Learning & Development

CLO Magazine

The name evolved from the fact that they were published as four installments, each one adding another level to the analysis. Jack Phillips began applying the four levels in the late ’60s and later extended the work by adding ROI as the fifth level. I just saw an announcement that Don will retire from the speaking circuit this year. Few people have single-handedly made such an impact on our profession. I have known Don for years and his story is very interesting.

Is this thing on? Tips for measuring course effectiveness and return on investment

Obsidian Learning

The Kirkpatrick four levels of training evaluation. The most commonly used method of accomplishing this is Kirkpatrick’s Four Levels of Evaluation. Kirkpatrick and Kirkpatrick (2006) compare it to measuring customer satisfaction and note that when learners are satisfied with training, they are more motivated to learn. Kirkpatrick, D. L., & Kirkpatrick, J. Phillips, J. Training Evaluation Kirkpatrick Levels of Evaluation ROI

[Free Webinar] How to measure and maximize the ROI of eLearning

Adobe Captivate

This begins with the Training Needs Analysis, or TNA phase, and successively builds up right up to the determination of its impact on business. The approach uses Kirkpatrick’s model of training evaluation and Kirkpatrick-Phillips evaluation model of training to measure training effectiveness and arrive at the ROI. What is Kirkpatrick’s model of training evaluation? What is Kirkpatrick-Phillips evaluation model of training? •

Workplace Learning 2025 – What is the ROI of learning and development?

Learning Pool

A starting point for measuring the benefits of workplace learning in terms of business results is to begin analysis before the training to define goals and strategy. Six Part Series: Workplace Learning 2025.

ROI 77

Z490 Basics: Your Intro to the ANSI/ASSP Z490 EHS Training Standards

Convergence Training

A is for Analysis; D is for Design; the next D is for Development; I is for Implementation; and E is for Evaluation. AnalysisAnalysis in ADDIE begins with identifying the problem and its cause.

Looking Back and Ahead on the Measurement and Management of L&D

CLO Magazine

On the measurement side, I am thinking of Don Kirkpatrick, who gave us the four levels, and Jack Phillips, who gave us isolated impact for level 4 and ROI for level 5. On the management side, I am grateful again for the contributions from Don and Jack, and now Jim and Wendy Kirkpatrick and Patti Phillips as well, for their guidance in how to manage, particularly with respect to partnering closely with goal owners and focusing on what it takes to achieve level 3 application.

The Essential Guide to Learning Analytics in the Age of Big Data

Lambda Solutions

The Kirkpatrick Evaluation Model and the related Phillips’ Model (see the next chapter) were developed to evaluate the effectiveness of online learning based on the impact it has on your organization. The Kirkpatrick Evaluation Model. Adding ROI to Kirkpatrick.

How do we measure value creation from training?

Learning Wire

This should take place over a period of time (minimum 2 months, according to Kirkpatrick (1998)) and aims to measure how the learner’s behavior has changed since he or she completed the training. Even though certain things are hard to measure reliably, Phillips (2015) suggests a way of getting round this when evaluating the impacts of a training course. In a nutshell, this type of analysis is influenced by so many factors that it’s hard to isolate the effect training has by itself.

ADDIE Backwards Planning Model

Big Dog, Little Dog

Note that the Learning Platform (Implement) rests on the Analysis, Design, Development, and Evaluation Phases. The steps in the Analysis Phase closely align with Phillips' Needs Model and Kirkpatrick's Four Levels of Evaluations. In addition, the Analysis steps align with the Design and Development steps: Click for a larger version with “clickable&# links. Analysis Phase.


eLearning ROI Case Study: How To Maximize Your Returns

EI Design

This demonstrates how you can maximize the ROI by adopting our approach, based on Kirkpatrick’s model of training evaluation. While we use Kirkpatrick’s model of training evaluation and KirkpatrickPhillips evaluation model of training as the baseline, we have enhanced this further through a combination of practical approaches and tips highlighted in the eLearning ROI case study given below.

5 Tips To Maximize The ROI Of Online Training

Adobe Captivate

In this article, I outline a popular ROI methodology (using Kirkpatrick’s model of evaluation), and 5 tips that you can use to maximize ROI in corporate training. Most of us are familiar with the Kirkpatrick’s model of evaluation. In today’s context, adding Phillips’ ROI calculation as the fifth level makes this framework more useful and relevant. You will note that each of these tips influences different levels of the Kirkpatrick’s model of evaluation.

ROI 55

Watershed's 7 Steps of Learning Evaluation


We've combined our favorite elements from Kirkpatrick , Kaufman , Anderson's Value of Learning , Brinkerhoff's Success Case Method , and Phillips' Model to create our version of a "super method" of how to evaluate learning. Consider use of dashboards for ongoing monitoring and reports for analysis at specific points in the program. Out of the dozens of different learning evaluation models currently in practice, which one is right for you?

Commonly Used Training Evaluations Models: A Discussion with Dr. Will Thalheimer

Convergence Training

But anyway, when we think about data and analysis, you know, we need to collect data that’s accurate, valid, relevant, highly predictive of what we care about, what’s important, that’s also cost-effective. So we can also look at our designs, our analysis, our assumptions, and look at and get information about our learning by looking at the inputs as well as the outputs. Four Common Learning Evaluation Models–Kirkpatrick, Kaufman, Philips & Brinkerhoff.

Instructional Design Basics: What Is ADDIE?

Convergence Training

ADDIE is an acronym that stands for each of the steps of the model–analyze, design, develop, implement, and evaluation (or you might see it listed out as analysis, design, development, implementation, and evaluation). The five steps of ADDIE are: Analysis. Analysis or Analyze.


What is an Instructional Design Model?

CommLab India

Analysis. E-learning Design: Instructional Design Models Vs Strategies The Kirkpatrick-Phillips Model – Part 4. Organizations are realizing that a well-trained and efficient workforce is a decisive factor for business success. As a result, training has gained importance and the ubiquity of computers and the Internet has made e-learning or online training, a popular choice. Instructional Design (ID) models are an important part of the e-learning development process.

Discussing the ASTD Handbook, eLearning, and Published Expertise with Elaine Biech

Web Courseworks

I’m happy to say that the ASTD Handbook meets my demands in every regard, and although I haven’t read through all 980 pages of this massive reference guide, I’ve searched the handbook multiple times and always come away with excellent analysis and hints on what to explore next. For example when contemplating the topic of evaluation several influential and respected names immediately come to mind: Kirkpatrick, Phillips, Brinkerhoff, and others.

ASTD 135

What is stopping companies from measuring learning: Skillsets, datasets, toolsets or mindsets?


As anyone familiar with analytics will tell you, the data exists but the difficulty many companies have is finding a way to collect it for meaningful analysis. Yes, organizations continue to view L&D as a line item expense part of loss/profit analysis and not a long term investment, which it is. Yet, L&D professionals continue to herald formal evaluation - Kirkpatrick and Phillips - as industry standards, essentially disregarding new tools at their disposal.

Putting Thought to Work: Evaluation in Practice

CLO Magazine

Most rely on quantitative as well as qualitative measures, ensuring some human intuition and analysis is included. Then she said the tool automates levels 1 through 5 — including the Phillips ROI model — to help learning leaders report and analyze the data. In addition to real-time analysis, some companies use isolated impact studies after a program to evaluate learning.

Brewing CALDO: How communications and learning professionals can thrive using DevOps

CLO Magazine

When was the last time you were able to do a formal needs analysis at the start of a project? Is the learning and development profession overwhelmed? Odds are, you might be feeling overwhelmed. Certainly, so many of us are, and it’s making us sick. Learning professionals are not immune.

A Day in the Life of a Learning Objective

CLO Magazine

For example, when a firm decides to add a new product line as part of its growth strategy, leaders complete the business analysis to define the product’s target market and design. The precision required to hit this new target requires strong coordination that includes consultation, analysis and testing. The outcomes of this gap analysis inform the newly defined roles, as well as the performance expectations that define the corresponding competencies.

Effective Learning – Musings from the UnConference

Learning Cafe

Even less effort seemed to be taken to conduct any worthwhile analysis of this data. Not all participants at the Session were familiar with the Kirkpatrick Model (4 levels – Reaction; Learning; Application; Impact) of Evaluation, or the 5th level (ROI) discussed by Phillips and the 6th (Sustainability) and 7th (Sharing the Benefits) levels put by Rylatt.