More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Years later, I realized that she had skipped Kirkpatrick’s Level 4: Results and substituted Phillips’ ROI. Trend line analysis.

Workplace Learning 2025 – What is the ROI of learning and development?

Learning Pool

Time, costs, and measurement metrics are among drivers of this mismatch. While ROI can be elusive, organisations that do it well are starting with the business metric and examining performance outcomes,” says CIPD head of L&D Andy Lancaster. Six Part Series: Workplace Learning 2025.

ROI 77
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Here’s the latest thinking on measurement, analytics and reporting

CLO Magazine

There are two very significant developments here, each of which will change the way human capital metrics are reported. In the future, why would any employee go to work for an organization that refuses to disclose its human capital metrics?

The Essential Guide to Learning Analytics in the Age of Big Data

Lambda Solutions

What metrics and sources to use in implementing learning analytics. This data can be sorted, filtered, and correlated to specific metrics, such as activity and course completions. That means selecting the right metrics on actual job performance data—not just training performance.

Watershed's 7 Steps of Learning Evaluation

Watershed

We've combined our favorite elements from Kirkpatrick , Kaufman , Anderson's Value of Learning , Brinkerhoff's Success Case Method , and Phillips' Model to create our version of a "super method" of how to evaluate learning. Step 2: Define metrics for effective evaluation. Identify success metrics most appropriate to the organization. Ensure that these metrics cover the complete story from learning through to achievement of the program goals.

Putting Thought to Work: Evaluation in Practice

CLO Magazine

Most rely on quantitative as well as qualitative measures, ensuring some human intuition and analysis is included. The company organizes its learning evaluation data using a tool, Metrics That Matter, from KnowledgeAdvisors that connects directly to its learning management system. Managers input progress measures into the LMS, which streamlines the data to Metrics That Matter.

Instructional Design Basics: What Is ADDIE?

Convergence Training

ADDIE is an acronym that stands for each of the steps of the model–analyze, design, develop, implement, and evaluation (or you might see it listed out as analysis, design, development, implementation, and evaluation). The five steps of ADDIE are: Analysis. Analysis or Analyze.

ADDIE 65

CFO, Friend or Foe?

CLO Magazine

To keep the relationship friendly: Consider them to be metrics experts. If you are having difficulty securing additional funds for metrics, analytics and measurement, you may have a sympathetic ear because the CFO understands the power of analytics. Have them review program costs that would be included in an ROI analysis. Phillips is the chairman and Patti P. Phillips is president and CEO of the ROI Institute.

Free learning & development webinars for June 2021

Limestone Learning

If you’re in self-analysis mode, you might benefit from checking out a free webinar or two. Engagement and motivation are important drivers that impact other meaningful metrics, like productivity, profitability, customer satisfaction, retention, safety and quality.

Free 65

Free L&D webinars for December 2019

Limestone Learning

Training needs analysis. In this session, Dr. Patti Phillips, CEO, ROI Institute, Inc., While ROI has a long history of use, it remains one of the most misunderstood and misrepresented metrics in the learning and development data dictionary.

Free 70

What is stopping companies from measuring learning: Skillsets, datasets, toolsets or mindsets?

Xyleme

By adapting our language and perspective to integrate terms like traffic, bounce rate, conversion, time on site and social sharing into an L&D context, we create a dynamic system that uses data to drive smarter decision-making and draw on accurate metrics for more actionable insights. As anyone familiar with analytics will tell you, the data exists but the difficulty many companies have is finding a way to collect it for meaningful analysis.

Is this thing on? Tips for measuring course effectiveness and return on investment

Obsidian Learning

There are two sources of data gathered in the Level 4 evaluation process for the course: Metrics collected by the Support team (pulled from the Help Ticket System). The historical support metrics will be analyzed to determine support call trends before and after training. To determine the financial benefit of your course, you need to identify both hard data elements and soft data elements (Phillips, 1996): Hard data elements are benefits to which monetary amounts may be assigned.

Free L&D webinars for October 2019

Limestone Learning

Join Patti Phillips, CEO of ROI Institute, and Katharine Aldana, Learning and Development Design Manager for Verizon, as they demonstrate how you can show the impact and ROI of your leadership development programs. The fundamental problem with both approaches is that the metrics are historical views and do not help workers impact work. “ Carrot harvest ” by woodleywonderworks is licensed under CC BY 2.0. Is that the sound of the heat coming on?

Free L&D webinars for March 2018

Limestone Learning

Our discussion will cover a range of topics, including identifying sales enablement’s unique purpose for your company; building consensus on goals and objectives; navigating the mandate for interlock with contributors in sales leadership, sales operations, and product marketing; and mastering the metrics that matter to your most important KPIs. The critical metrics for linking sales enablement to desired business outcomes, and growing your budget over time.