Remove Analysis Remove Business Remove Evalution Remove Phillips

More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I have been blogging a lot about Training Evaluation this year—mostly Kirkpatrick , but also Brinkerhoff and Scriven. I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Trend line analysis.

The Phillips ROI MethodologyTM – Measuring Data at All Levels – Part 5

CommLab India

Part 1 , Part 2 , and Part 3 of this series dealt with the Kirkpatrick Model of evaluating a training program. In the fourth part of the series, we saw how the Phillips ROI Methodology TM suggests that measurements be taken at every level. An analysis tool must be used to measure outcomes. Level 4: Business Impact. But let’s be realistic – changes or improvements in business would occur due to several reasons other than the training program itself.


Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Interview with Jack Phillips on ROI for eLearning


Jack Phillips is founder and CEO of the ROI Institute, Inc., Phillips developed the ROI Methodology™, a critical tool he has used for measuring and evaluating programs such as training, human resources, technology and quality programs and initiatives. The pressure in the business world today is to deliver value and financial return on investment. We also provide certifications so that people can do the ROI analysis on their own.

Showing the ROI of key programs on a budget

CLO Magazine

At the same time, you don’t necessarily have the resources to devote to a comprehensive evaluation. The facilitators’ role is to teach to business impact. 2: Build in data collection and analysis. 7: Be selective when evaluating to this level.

ROI 84

Is Kirkpatrick’s Model of Evaluating a Training Program The Best? – Part 3

CommLab India

In the first part of the series, I covered the need to evaluate any training program and the basics of the Kirkpatrick model of evaluating a training program. Here’s a quick diagrammatic representation of the gist: The eLearning industry relies tremendously on the 4 levels of the Kirkpatrick Model of Evaluating a training program. Here’s what we know about the benefits of the model: The model can be used to evaluate classroom training as well as eLearning.

Commonly Used Training Evaluations Models: A Discussion with Dr. Will Thalheimer

Convergence Training

And that’s especially true when it comes to issues regarding learning evaluation. We were excited to be able to talk with Dr. Thalheimer about four common learning evaluation models, and we’ve got the recorded video for you below. If you prefer your learning evaluation information in written form, just scroll down for the transcript of our discussion. Many thank to Will for participating in this discussion on learning evaluation and for everything he does.

Determining The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

In this article, I outline how you can use the Kirkpatrick’s model of training evaluation to measure training effectiveness, its impact, and the ROI of eLearning. The measurement of ROI of eLearning needs an integrated approach that should begin during the Training Needs Analysis or TNA phase and should successively build up right up to the determination of its impact on business. Training Needs Analysis (TNA). Assessing the gain for business.

Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation

EI Design

This free eBook, Free eBook: Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation, provides practical tips that you can use to measure the effectiveness of online training, leading to the ROI on your training spend. Practical Approaches To Determine The ROI Of eLearning – Using Kirkpatrick’s Model Of Training Evaluation. What is Kirkpatrick’s model of training evaluation?

Impact and ROI of Learning: Worth Pursuing or Not?

CLO Magazine

Instead, they call for showing the alignment of learning to business goals, focusing on easier-to-measure participant reaction, amount learned and application (levels 1, 2 and 3, respectively, of the Kirkpatrick Model/Phillips ROI Methodology) and finally focusing on employee engagement with learning (consumption of learning and completion rates). Aligning learning to business goals and measuring levels 1 through 3 are always good ideas, so no disagreement there.

ROI 51

Putting Thought to Work: Evaluation in Practice

CLO Magazine

Organizations that have reached higher measurement levels use a blended approach for the various frameworks and find ways to customize evaluation. Most rely on quantitative as well as qualitative measures, ensuring some human intuition and analysis is included. The company organizes its learning evaluation data using a tool, Metrics That Matter, from KnowledgeAdvisors that connects directly to its learning management system.

Introduction to Performance Consulting

Infopro Learning

To maintain a competitive advantage and increase their company’s market share, business leaders are increasingly investing in performance consulting. Performance consulting is a process that produces business results by improving the performance of people in an organization. Performance consulting is results-focused and concentrates on the gaps that exist between business and performance results.

Getting to the Bottom of ROI: What Are My Options?


Sometimes due to constraints with data, resources, or capabilities, we can only tell the story of ‘return’ with purely evaluation or activity data. This approach lies somewhere in the middle, leveraging both evaluation data and some business data.

ROI 52

[Free Webinar] How to measure and maximize the ROI of eLearning

Adobe Captivate

This begins with the Training Needs Analysis, or TNA phase, and successively builds up right up to the determination of its impact on business. The approach uses Kirkpatrick’s model of training evaluation and Kirkpatrick-Phillips evaluation model of training to measure training effectiveness and arrive at the ROI. What is Kirkpatrick’s model of training evaluation? What is Kirkpatrick-Phillips evaluation model of training? •

Workplace Learning 2025 – What is the ROI of learning and development?

Learning Pool

While ROI can be elusive, organisations that do it well are starting with the business metric and examining performance outcomes,” says CIPD head of L&D Andy Lancaster. But it is more useful to examine ROI through the lens of the business cycle.

ROI 77

ROI: Determine the Impact of Your Training Programs


Industry Growth Means Managers Need to Understand the Business Impact of Their Training Programs. According to Research and Markets report, “Global E-Learning Market Analysis & Trends – Industry Forecast to 2025,” the e-Learning market is expected to grow at a compound annual growth rate 7.2% This may be the top question asked of business leaders as they present a case to launch a new business initiative.

ROI 40

E-Learning vs. In-Person: A False Dichotomy

The Performance Improvement Blog

A simple ROI analysis of the savings can underscore the point within your own organization. However, if I want those employees to develop good teamwork skills then a totally Web-based program, while efficient, is not likely to get the business results I need. They quote Jack Phillips: “Our studies have shown that participants in e-learning programs are less likely to follow through than in an instructor-led program,” notes Jack Phillips, Ph.D.,

The Essential Guide to Learning Analytics in the Age of Big Data

Lambda Solutions

How to use learning analytics for evaluation. Evaluating Learning Analytics and Measuring ROI. Most of the time, companies collect big data from external sources to help the business serve customers more effectively, become more efficient, and increase profits.

CFO, Friend or Foe?

CLO Magazine

Discuss the projects you want to evaluate. Have them review program costs that would be included in an ROI analysis. You’ll find a helpful team who appreciates your efforts to show business value. The telecom CLO embarked on a program to measure the impact and ROI for major projects and connect programs to the business, using many of the aforementioned steps. Phillips is the chairman and Patti P. Phillips is president and CEO of the ROI Institute.

ADDIE Backwards Planning Model

Big Dog, Little Dog

Note that the Learning Platform (Implement) rests on the Analysis, Design, Development, and Evaluation Phases. The steps in the Analysis Phase closely align with Phillips' Needs Model and Kirkpatrick's Four Levels of Evaluations. In addition, the Analysis steps align with the Design and Development steps: Click for a larger version with “clickable&# links. Analysis Phase. Evaluation Phase.


Instructional Design Basics: What Is ADDIE?

Convergence Training

ADDIE is an acronym that stands for each of the steps of the model–analyze, design, develop, implement, and evaluation (or you might see it listed out as analysis, design, development, implementation, and evaluation). The five steps of ADDIE are: Analysis.


Don Kirkpatrick’s Contribution to Learning & Development

CLO Magazine

dissertation at the University of Wisconsin and needed some good measures to evaluate the impact of a training program for supervisors. All four were important to evaluate a program. Throughout the ’50s he gave talks at conferences and referred to his evaluation framework, which he continued to use and refine. The name evolved from the fact that they were published as four installments, each one adding another level to the analysis. The Business Of Learning

Here’s the latest thinking on measurement, analytics and reporting

CLO Magazine

Third, programs and computing power are facilitating the use of microdata, which simply means that data are available at the individual level for further analysis or for follow-up with the employee. It is an exciting time to be a learning professional.

Evidence or Proof of L&D Impact? Why Not Both?


This is where you assemble significant amounts of data, run statistical models like regression analysis to show a link between the learning program and the business outcome. This may also be part of a periodic project where your team or a 3rd party consultant conducts an in-depth analysis on the program and its related impact and writes-up a report summarizing the findings. This is where you leverage your ongoing evaluation process to make measuring impact more meaningful.

A Legend’s Look at Learning

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. For almost four decades, Tom Peters has been preaching the gospel of putting people first, a message more urgent than ever in today’s rapidly changing business environment. Peters is a leading business management guru and the best-selling author of 16 books, including “In Search of Excellence,” co-authored with Robert H. Jack J.

What is an Instructional Design Model?

CommLab India

Organizations are realizing that a well-trained and efficient workforce is a decisive factor for business success. An ID model helps to evaluate learners’ needs and design and develop the course based on this. Analysis. The types of activities and exercises that will be used in the course are planned and how learners are to be evaluated is also determined. Evaluation.

eLearning ROI Case Study: How To Maximize Your Returns

EI Design

This demonstrates how you can maximize the ROI by adopting our approach, based on Kirkpatrick’s model of training evaluation. How Can They Showcase Improvement In Employee Performance, Gain Sought By Business, And – More Specifically – An Overall Gain That Justifies The Expense? This resulted in improvements that the business had sought; an increase in deal closures (through a consistent tracking and ongoing analysis across regions).

Avoiding the Curse of the Consultant

CLO Magazine

accounting for nearly half (44 percent) of the global market, according to analysis from Greentarget, a public relations firm. Clients who fund consulting want to see the business value and sometimes even the ROI. Consulting can also be a risky business. The first challenge is to deliver credible business results to clients. If clients aren’t happy, client referrals won’t develop and it’s difficult to have a sustainable business.

5 Tips To Maximize The ROI Of Online Training

Adobe Captivate

In this article, I outline a popular ROI methodology (using Kirkpatrick’s model of evaluation), and 5 tips that you can use to maximize ROI in corporate training. As suggested by Keri Bennington of UNC Kenan-Flager Business School in a report, “ROI measures should be related to performance after the L&D experience and, according to some, tied to a dollar figure. Most of us are familiar with the Kirkpatrick’s model of evaluation. Level 4: Business Impact.

ROI 55

What is stopping companies from measuring learning: Skillsets, datasets, toolsets or mindsets?


In one of our recent posts, " Why you need to take a Google Analytics approach to measuring learning ," we lay the foundation of our perspective regarding L&D''s constant battle for greater relevance in business strategy and planning. In my book, the buck stops fairly and squarely with the L&D profession as it''s their job to persuade senior execs to invest in training to improve business performance," Graham Cook, founder of RSVP Design & Mobile Learning Design, argues.

Free L&D webinars for December 2019

Limestone Learning

December is notoriously busy, but if you find yourself with a free hour, why not check out a free webinar? It might get you thinking about your business now in the future. Training needs analysis. Retailers are facing unique challenges in today’s volatile business world.

Free 70

Discussing the ASTD Handbook, eLearning, and Published Expertise with Elaine Biech

Web Courseworks

I’m happy to say that the ASTD Handbook meets my demands in every regard, and although I haven’t read through all 980 pages of this massive reference guide, I’ve searched the handbook multiple times and always come away with excellent analysis and hints on what to explore next. For example when contemplating the topic of evaluation several influential and respected names immediately come to mind: Kirkpatrick, Phillips, Brinkerhoff, and others.

ASTD 135

A Day in the Life of a Learning Objective

CLO Magazine

For example, when a firm decides to add a new product line as part of its growth strategy, leaders complete the business analysis to define the product’s target market and design. Once the business plan is completed and the sales channel strategy is defined, the firm’s human capital has to launch the product and develop market share. Leaders have to align the organizational systems to move from the business goal to successful implementation.

Brewing CALDO: How communications and learning professionals can thrive using DevOps

CLO Magazine

If we hold to our old ways of thinking and doing business, these information tsunamis will completely overwhelm us – perhaps far more than we can now imagine. When was the last time you were able to do a formal needs analysis at the start of a project?

Effective Learning – Musings from the UnConference

Learning Cafe

Evaluation and Measurement – Bob Spence. It was agreed that evaluating the success of learning is something we know should be done but, in reality, it’s rarely completed well. The Session participants noted that the most common form of “evaluation” was the completion of “smile sheets” by participants which typically provide some vague and thinly veiled opinion about the training session just attended.

Free L&D webinars for October 2019

Limestone Learning

Join Patti Phillips, CEO of ROI Institute, and Katharine Aldana, Learning and Development Design Manager for Verizon, as they demonstrate how you can show the impact and ROI of your leadership development programs. Wednesday, October 2, 2019, 11AM – 12PM PT: Designing Learning Programs for Lasting Impact (Free for ATD members) Business and learning leaders must navigate through confusion and clutter when designing corporate learning programs.

Free 55

Free L&D webinars for March 2018

Limestone Learning

However, one consideration that people often overlook is the type of technology that an LMS uses, which is important to consider when evaluating whether an LMS will be able to provide the type of functionality you’ll need to meet your goals. But organizations that appreciate and recognize their employees—not just for blockbuster achievements but for meaningful efforts and results—get better business results than organizations that don’t, according to Brandon Hall Group research.

2018: This Year in Learning– 109 Curated L&D Articles from 2018

The Learning Dispatch

Accessibility (6) Instructional Design (21) Evaluation (4) Learning Experience (19) Professionalism (9) Program Design (27) Style, Usage, and Grammar (10) Visual Design (9) Microassist’s Learning Dispatch Blog (4). Evaluation. Are you seeing a push to incorporate more data analysis into your learning and development process? (If At the Harvard Business Review , Todd Warner reminds us that if learning is to be successful, it needs to be placed in context.

Grovo 16