More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Years later, I realized that she had skipped Kirkpatrick’s Level 4: Results and substituted Phillips’ ROI.

An Overview: Phillips' Model for Learning Evaluation

Watershed

While there are many other learning models we’ve yet to cover, the one we’re asked about most often that’s not mentioned in our original series is Phillips' Learning Evaluation Model. In a nutshell, Phillips' model focuses on how to: collect data, isolate the impact of training versus the impact of other factors, and. Tip: Find out even more about Phillips' Model for Learning Evaluation in Jack Phillips' book.).

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Interview with Jack Phillips on ROI for eLearning

Mindflash

Jack Phillips is founder and CEO of the ROI Institute, Inc., Phillips developed the ROI Methodology™, a critical tool he has used for measuring and evaluating programs such as training, human resources, technology and quality programs and initiatives. Sales managers, for example, can mandate that all the sales associates take a course and then do follow-ups with each associate, be a coach to them, and encourage them to use the skills.

Why is eLearning undervalued? Peter Phillips considers.

Unicorn Training

Peter Phillips'(Unicorn Training Chairman) considers why eLearning may still be undervalued as a training resource despite the cultural fascination with online technologies. Last week David Guralnick, president of the International eLearning Association (IELA), suggested end user experience is 'undervalued' in much eLearning, although he went on to insist many of the downsides to online training are product specific not with the overall concept.

Does coaching deliver impact?

CLO Magazine

The process has been adopted by 26 federal governments, more than 300 health care associations, 150 universities and many nonprofits, charities and faith-based organizations. Leadership Development Strategy impact ROI Methodology Phillips ROI Methodology ROI ROI Institute coaching

Company announcement

Unicorn Training

Ken has been associated with Unicorn for many years as a non-executive director and for the past ten years as Chairman.Unicorn CEO, Peter Phillips remarked: “Ken brought a wealth of business experience to the Unicorn board and made a significant contribution to the strategic development of the business. Unicorn is very sad to announce that company Chairman, Ken Pringle has died after a short illness.

Three Challenges Faced by Today’s L&D Leaders

Your Training Edge

Rob Brinkerhoff, a professor at Western Michigan University and thought leader in the field, puts that number 80 to 85% (Phillips, 2016)! In a 2008-2009 study, Jack and Patti Phillips surveyed the CEOs of Fortune 500 and large, private-sector employers. Jack & Patti Phillips, Measuring What Matters: How CEOs View Learning Success 2009). Phillips, Jack & Phillips, Patti. Phillips, Ken.

3 Questions to Ask When Picking a Learning Management System

TOPYX LMS

Phillips 2 , contributor to the Association for Talent Development and chairman of The ROI Institute, clarified the process: “First, showing the cost versus benefit of an e-learning approach is no different than any other delivery method. Phillips, Jack J. Association for Talent Development. Last year, 75% of companies worldwide used a learning management system (LMS) for workplace learning and development (1 ).

Short Course on Evaluation of Training and Learning in Knowledge Economy

The Performance Improvement Blog

LAD Global , in partnership with the Singapore Training and Development Association , has made my short course on evaluation of training and learning available for free online. I summarize three major approaches to evaluation: Kirkpatrick’s four levels ; Phillips’ ROI ; and Brinkerhoff’s Success Case Method.

Timing is Everything Series: Part 6 Structured vs. On-Demand Learning

Infopro Learning

Sources: Phillips, J. Prior to joining InfoPro, Kyle served as a research associate on subjects including e-learning, online education, game-based learning, and social media usage in higher education at St. Timing is Everything Series: Intro , Anxiety , Information Overload , Knowledge Formation , Optimum Performance , Growth , Stagnancy , or Decline , Structured vs. On-Demand Learning, ( Download the complete white paper ). Structured vs. On-Demand Learning.

Looking Back and Ahead on the Measurement and Management of L&D

CLO Magazine

On the measurement side, I am thinking of Don Kirkpatrick, who gave us the four levels, and Jack Phillips, who gave us isolated impact for level 4 and ROI for level 5. I am also thinking of all the work done by the Association for Talent Development to promote measurement and to benchmark key measures through their annual industry survey. Of course, there are many more, such as Ken Phillips and John Mattox, and I apologize to all those whom I have not mentioned.

Vale Don Kirkpatrick

Clark Quinn

The second problem was that whether or not he intended it (and there are reasons to believe he didn’t), it become associated only with training interventions. The Phillips have made a similar career with their fifth level, ROI, measuring the cost of impacting level 4 against the value of the impact. Last week, Don Kirkpatrick passed away. Known for his four ‘ levels ‘ of measuring learning, he’s been hailed and excoriated.

Training Evaluation – 5 Best Ways to Evaluate Training Effectiveness and Impact

Kitaboo

The Phillips ROI Model. Very similar to the Kirkpatrick model in approach, the Phillips ROI model has an extra step, which is to evaluate the program’s return on investment (ROI) by measuring the difference between training cost and training results.

#ATD2015 It’s a Wrap Part One: Sue Prenderville

Learning Rebels

The ATD ICE (Association for Talent Development International Conference and Expo) Conference never fails to teach me something new. Michele Lawson and Kelly Phillips. #ATD2015 – It’s a wrap! This will have been my sixth time, in a row, attending this conference and by now, one would think I would be nonchalant about the experience. Wow, is that not the case.

Unlocked Learning—Training analytics made easy

Coassemble

Dr. Kirkpatrick was one of the presidents of the American Society for Training and Development, now known as the Association for Talent Development (ATD). In 2003, Dr. Jack Phillips introduced the fifth level as the return of investment for the training.

Unicorn scoops two Industry Awards

Unicorn Training

Evaluating Training Effectiveness and ROI

Geenio

To evaluate the effectiveness of education and its practicability from the financial standpoint, it is necessary to calculate the expenses connected with creating and conducting the trainings, gauge the results achieved by the employees who have taken part in them, and decide whether the increase in the employees’ efficiency and company profits was sufficient to recoup the associated costs.

ROI 100

Bloomingdale’s, Toys”R”Us, Toyota and others tout the benefits of Axonify

Axonify

Axonify is giving us the ability really to educate associates, make them aware of changes in their behavior to really make a safe environment. Mia Phillips – National Manager of Dealer Education Strategy and Digital Solutions at Toyota. We’ve been able to, through the Axonify development process, determine the behaviours, specific behaviours that we want our associates to be able to exhibit when they’re interacting with customers.

Toys 100

Bloomingdale’s, Toys”R”Us, Toyota and others tout the benefits of Axonify

Axonify

Axonify is giving us the ability really to educate associates, make them aware of changes in their behavior to really make a safe environment. Mia Phillips – National Manager of Dealer Education Strategy and Digital Solutions at Toyota. We’ve been able to, through the Axonify development process, determine the behaviours, specific behaviours that we want our associates to be able to exhibit when they’re interacting with customers.

Toys 100

How To Measure The ROI Of Online Training?

Adobe Captivate

Costs are fairly easy to define and would normally include the cost of eLearning course development as well as associated costs of team members (including teams that are associated with the development process and Subject Matter Experts). Typically, there would also be associated costs of the supporting delivery (Learning Management System, Administrative cost of managing the initiative, and other related infrastructure required for delivery).

ROI 65

Free learning & development webinars for September 2021

Limestone Learning

Erin Cox, Expert Trainer and Facilitator at American Management Association, will reveal a proven method to create a consistent culture where employees feel empowered for meeting and exceeding customer expectations — creating a more profitable business.

Free 83

Unicorn is now part of The Access Group!

Unicorn Training

Unicorn comes to Access with more than £10m of revenues and in excess of 1,500 customers, including key names such as UK Finance Association, University of London, Tesco Bank, and Chartered Insurance Institute. Peter Phillips, CEO of Unicorn also shares, “We see Access as the perfect home for our customers, solutions and people. The Access Group, today announced the acquisition of Unicorn, the UK’s leading provider of learning technology solutions.

News: Learning Now tv Gets On Board With E-Learning 20-20

Unicorn Training

Learning Now TV, the live-streamed internet TV channel focusing on the world of learning and development, has been announced as the latest associate to get involved in this month's unique E-Learning 20-20 - Stay Ahead of the Game event. Marco Faccini of Learning Now TV said: “Learning Now TV is really proud to be associated with this great project in bringing insightful, engaging, up to the minute thinking and current practice to our TV audience.

Objectives are the Objective

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. The publisher, the Association for Talent Development, created the title to remind learning and talent development professionals we must move beyond learning objectives. Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. Jack J.

Here’s the latest thinking on measurement, analytics and reporting

CLO Magazine

For example, organizations are testing the data to see what is associated (or correlated) with employee retention and employee engagement. It is an exciting time to be a learning professional.

What’s LEO’s Chain of Evidence Learning Evaluation Model?

Watershed

Actually, we’ve called on a lot of the learning evaluation models you may be familiar with—Kirkpatrick, Kaufman, Phillips, Anderson, and the like.

Learning Styles and E-Learning

eLearning 24-7

Peter Phillips, a pioneer in e-learning development tied to instructional design believes that learning styles and perspectives to exist. Association of learning styles with different e-learning problems: a systematic review and classification.

Workplace Learning 2025 – What is the ROI of learning and development?

Learning Pool

This report was originally published on Raconteur in association with Learning Pool. Six Part Series: Workplace Learning 2025. Part 4: While the benefits of workplace learning are wide-ranging, measuring the return on investment (ROI) remains a challenge for many organisations.

The Best Places to Explore in Rest of January 2022

Learnloft

The major tourist attractions in Australia are Warner Bros Movie World, Twelve Apostles, Phillip Island, and Whitsunday Islands. South Africa is a paradise for adventure seekers, and its name is associated with safari tours in the wildlife sanctuary.

The Elevator Pitch for Trainers

Training Industry

Every year, when the Association for Talent Development (ATD) Annual State of the Industry Report is released, one of the topics that are guaranteed to be part of the discussion is the need for learning professionals to communicate the value of training. The challenges associated with communicating the value that the training function provides to the larger organization could perhaps be mitigated if learning professionals were better at delivering elevator pitches.

NEWS: Unicorn Training Announces Record Year

Unicorn Training

Unicorn is uniquely positioned to offer turnkey solutions, combining SkillsServe’s sector-leading features with relevant and up-to-date content and outstanding instructional design, backed by long-standing partnerships with such industry bodies as the Chartered Insurance Institute (CII) and the British Bankers Association (BBA).In

Unlocked Learning—Training analytics made easy

Coassemble

Dr. Kirkpatrick was one of the presidents of the American Society for Training and Development, now known as the Association for Talent Development (ATD). In 2003, Dr. Jack Phillips introduced the fifth level as the return of investment for the training. Dr. Phillip’s proposed addition created a training assessment model that shaped how online training can benefit teams by providing an accurate scope of insight to a business leader.

Free learning & development webinars for October 2021

Limestone Learning

PT: Community Member Showcase Join TLDCast’s crowdcast as they feature Gwen Navarrete Klapperich, Chief Learning Consultant of Klapperich International Training Associates (KITA) LLC. “ Flying dog, Batman, bats ” by Andrea Bohl is licensed by Pixabay. It’s that spooky time of year again.

Free 99

How To Measure The ROI Of Online Training?

EI Design

Costs are fairly easy to define and would normally include the cost of eLearning course development as well as associated costs of team members (including teams that are associated with the development process and Subject Matter Experts). Typically, there would also be associated costs of the supporting delivery (Learning Management System, Administrative cost of managing the initiative, and other related infrastructure required for delivery).

ROI 50

Free learning & development webinars for August 2021

Limestone Learning

This session, hosted by Dr. Patti Phillips, CEO of ROI Institute, will describe how to measure the value, including ROI, of DEI programs. “ BEACH, MAR, OCEAN ” BY TURIANO NETO IS LICENSED BY PIXABAY. The race to summer’s end is on.

Free 100

News: Tomb Raider Creator Confirmed For E-Learning 20-20

Unicorn Training

Presented by e.learning age in association with Unicorn Training and Growth Engineering, E-Learning 20-20 takes place over two days with gamification, games and the next generation of online learning the hot topics to be deconstructed and debated by delegates from across eLearning, HR and learning and development. joked Peter Phillips, Unicorn CEO.

Outstanding Achievement Joy for Unicorn's Henry

Unicorn Training

"The industry's best kept secret" is how judges described Unicorn Training's Henry Phillips as he won the ‘eLearning industry award for outstanding achievement – individual’ at the 2012 eLearning Awards at London Marriott Hotel Grosvenor Square last night (Thursday 8 November).Technical The personal recognition associated with this Outstanding Achievement Award is a fitting and timely recognition from the industry he has served so well.”It

NEWS: David and Laura New Captains of Content Ship!

Unicorn Training

Meanwhile Jason Woodward has stepped up from his role as Senior Help Desk Advisor to take on the title and associated duties of Help Desk Manager. Peter Phillips, Unicorn CEO, said: “We’re always keen to promote people within the business and give everyone experience and opportunities across all facets of the business should they wish to explore them. Two of our award-winning instructional design team have taken the helm in helping steer our eLearning strategy forwards through 2014.

Evidence or Proof of L&D Impact? Why Not Both?

Performitiv

At the same time, review your outcome data (from Step 2) and look for associations and correlations in the data where it is trending positively over time and/or against the control group. However, L&D should hire experts (like a statistical causal model expert and/or a certified Phillips ROI Process expert) once in a while to do an L&D impact project/study. In the world of Learning & Development (L&D), impact is super important.

28 eLearning quotes from eLearning experts, implementers, and gurus

TalentLMS

Whether you’re a small association or large enterprise, eLearning videos allow you to deliver the perfect training and story that resonates with your audience anywhere in the world or anytime they need access.