More on Re-evaluating Evaluation – Jack Phillips and ROI

Dashe & Thomson

I just realized that I haven’t included a single word about Jack Phillips , who introduced Return on Investment (ROI) as Level 5 to Kirkpatrick’s Four Levels of Evaluation. My first exposure to Phillips’ ROI—although I didn’t realize it at the time—was through a colleague who introduced me to Kirkpatrick’s Four Levels. Years later, I realized that she had skipped Kirkpatrick’s Level 4: Results and substituted Phillips’ ROI.

Showing the ROI of key programs on a budget

CLO Magazine

For example, the needs assessment team should start with why , with a clear business measure at the beginning, ensure that the proper solution is implemented and develop objectives at multiple levels, up to and including impact. The facilitators’ role is to teach to business impact. Crisis Leadership Measurement Coronavirus covid-19 data analysis learning ROI Phillips ROI MethodologyWe know the situation you are facing with the COVID-19 crisis.

ROI 53

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

My 15 favourite Australian e-learning bloggers

E-Learning Provocateur

Since then, she has joined Dachis Group where she and James Dellow write about social business on the Headshift blog. This community promotes thought leadership in L&D. Wendy Phillips – Wendy develops e-learning at one of the biggest telcos in the Asia-Pacific region. Fay Moore made my day when she nominated me for the Versatile Blogger Award.

Matching Military Veterans With Business Veterans

CLO Magazine

The program matches experienced business leaders with military veterans and entrepreneurs committed to veteran hiring. But a report conducted by Phillip Carter and Cathy Barrera shows that veterans tend to leave their first jobs out of the service faster than non-veterans, indicating that they take the first job available rather than the “best fit” role. Military Veteran Partners aims to help by supporting veteran businesses and employment opportunities. “We

ROI Goes to School and Church

CLO Magazine

When you think about ROI, you likely think of businesses and service organizations. The Phillips ROI Methodology is a 10-step process organizations can use to show the value of programs and initiatives. It measures six types of data: reaction and planned data (level 1), learning (level 2), application and implementation (level 3), business impact (level 4), ROI (level 5) and intangibles (level 6). Phillips, Ph.D., Phillips, Ph.D.,

ROI 38

Stepping Up to the ROI Challenge

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. In his 2017 Chief Learning Officer article, “The Business Case for Leadership Development,” William C. And the authors of an October 2016 article in Harvard Business Review referred to leadership development programs as the “great training robbery.”. Some estimates put the annual investment in leadership development in the U.S. Jack J.

ROI 54

Do You Have a CEO-Friendly Scorecard?

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. 1 measure of L&D investments preferred by executives is business impact, followed by ROI. Additionally, consider showing the connection of each program to key business measures. ” This line of sight to key business measures is critical; if your CEO can’t see it, you have a problem. Phillips is president and CEO of the ROI Institute. Jack J.

CFO, Friend or Foe?

CLO Magazine

For example, show the results for a major leadership development program at the impact level. CFOs may have no idea how to connect leadership development to a financial ROI, but chances are, you do. You’ll find a helpful team who appreciates your efforts to show business value. The telecom CLO embarked on a program to measure the impact and ROI for major projects and connect programs to the business, using many of the aforementioned steps.

Evaluating Training – Capturing the Benefits Aspect of ROI

Obsidian Learning

Training evaluation is necessary and, in many ways, critical to the success of a business. In the current economic context, people represent one of the primary strategic assets of a business. In this context, the adoption of assessment methodologies becomes a critical imperative for businesses and training organizations. The Phillips ROI Methodology took this model a step further, adding the ROI calculation as a fifth level.

Objectives are the Objective

CLO Magazine

Phillips is the chairman, and Patti P. Phillips is president and CEO of the ROI Institute. After all, business value is their favorite measurement category. If you don’t start with a business measure, it’s difficult to have business impact. Programs need to start with why — why we are doing this — and that’s often a specific business need. Leadership development is often the area where this is ignored. Phillips is the chairman, and Patti P.

4 Critical Factors for Evaluating a Learning Company

Obsidian Learning

But as much as we are passionate about applying both to create effective learning experiences, we also understand that there must be a business case for choosing a learning company. With close to two decades’ experience in the learning industry, we have learned a thing or two about the critical factors that any business or learning decision maker should consider when evaluating existing learning vendor or selecting a new learning company.

Learning for Leaders: 3 Tips for Your eLearning Coaching Courses

eLearning Brothers

Leadership is a much sought-after quality in the business world and one that any ambitious career person should hope to obtain. Having good coaching skills and encouraging others to foster leadership traits within themselves creates a culture of self-motivated and persuasive minds, allowing for creativity and hard work on the scale of an entire company.

Unicorn is now part of The Access Group!

Unicorn Training

The Access Group sees the addition of Unicorn to its Access Workspace solution as yet further confirmation of its intent to be the solution provider of choice to the UK’s thousands of mid-market and growing businesses. This means that Access will be able to support businesses to deliver on every aspect of their learning strategy. Peter Phillips, CEO of Unicorn also shares, “We see Access as the perfect home for our customers, solutions and people.

Here’s the latest thinking on measurement, analytics and reporting

CLO Magazine

Other measures recommended for disclosure by large organizations include leadership trust, time to fill vacant positions, percentage of positions filled internally and diversity of the leadership team. Ken Phillips, founder and CEO of Phillips Associates, (not related to the ROI Institute’s Patti or Jack Phillips) is doing some exciting work using microdata to reduce the scrap rate and increase application. It is an exciting time to be a learning professional.

Ten People Every Learning Pro Should Know

Mike Taylor

Performance Consulting: A Strategic Process to Improve, Measure, and Sustain Organizational Results Dana Gaines Robinson, James Robinson, Jack Phillips Partricia Phillips & Dick Handshaw. John Hagel is a top voice on 21st-century information-age institutional leadership and important concepts including accessing and working with knowledge flows.

Free learning & development webinars for September 2020

Limestone Learning

It’s a busy time of year, even during normal times. But since HR never has to make the business case for compliance, it can be a persuasive approach to larger culture initiatives. Independent consultants saw their business dry up.

Free 59

Increasing the Value of Your Organization’s Training Investments

Beyond Campus Innovations

Whether as broad as training in management and leadership, or as narrow as a topic such as customer service, organizational training that carries the components identified under Best Practices above, will facilitate positive employee contribution while also more likely than not to have college credit value. Bolling, J, Phillips, M. & Increasing the Value of Your Organization’s Training Investments.

The Inclusive Training Model for Training Retention

Training Industry

ROI experts Jack and Patti Phillips argue that this increased attention is a result of training sponsors who apply pressure on training professionals to focus on measurement and evaluation. The Performance Support Philosophy Performance support philosophies focus on experiences on the job and are perhaps best typified by the efforts of Morgan McCall and his colleagues at the Center for Creative Leadership, who promote the 70/20/10 technique.

Free L&D webinars for December 2019

Limestone Learning

December is notoriously busy, but if you find yourself with a free hour, why not check out a free webinar? It might get you thinking about your business now in the future. How do you better ensure manager and leadership engagement? Tuesday, December 3, 2019, 10AM – 11AM PT: Delivering the Best Candidate Experience Starts Now An effective candidate experience improves the levels of quality hires, engaged employees, employee retention and business revenue.

Free 53

The Discussion Continues on Impact and ROI

CLO Magazine

L&D exists for many reasons, but I suggest the most important reason is to help our organization accomplish its business goals, such as higher sales, increased productivity, reduced costs and greater customer or patient satisfaction. Of course, L&D is positioned to help achieve HR goals as well, such as higher employee engagement, which in turn will contribute indirectly to realizing all the business goals. These are all important high-level business or HR goals.

ROI 46

Building a Better Working World

CLO Magazine

From left: Simon Berridge, Jan Cannon-Bowers, Christiana Zidwick, Brenda Sugrue, Eric Ellefsen, Shawn Phillips. Recognizing that high-performing teams drive competitive advantage and that workplace learning is a key differentiator between businesses that thrive and those that do not, EY leadership hired the company’s first global chief learning officer, Brenda Sugrue. Under Sugrue’s leadership, EY also has implemented SuccessFactors Learning, a new global LMS.

Free L&D webinars for October 2019

Limestone Learning

Tuesday, October 1, 2019, 9AM – 10AM PT: Demonstrating the ROI in Leadership Development Organizations worldwide spend billions on leadership development; yet, for many organizations, little evidence exists that those investments are paying off. Join Patti Phillips, CEO of ROI Institute, and Katharine Aldana, Learning and Development Design Manager for Verizon, as they demonstrate how you can show the impact and ROI of your leadership development programs.

Free 58

Evaluation and ROI in Compliance Training

Interactive Services

Higher integrity scores have been linked with cost-reductions, like less employee misconduct and improved risk identification and were linked to boosts in business performance, including higher employee productivity, better strategic management, and improved business performance. Many also use qualitative indicators, such as talent recruitment, leadership trust, and employee engagement.

10 New Years Resolutions for Learning and Development Professionals


We’ll continue to use our agile, user-centered design approach to build bespoke products and experiences that will equip our workforce with the capabilities and knowledge to maintain a leadership position in digital commerce.” Support employees at the speed of business. “Signify (the new company name for Phillips Lighting) is in the midst of disruptive change, and we are changing the way the learning function operates to align with the speed of our business.

What can L&D learn from the UK election results?

Unicorn Training

Unicorn CEO Peter Phillips explores some of the parallels between the recent UK General Election, and themes of engagement, communication and social influence in learning.The recent election outcome in the UK defied every major opinion poll and made fools of most of the media experts. Can we, in a business environment do the same? It is no good telling your staff to behave ethically if your business routinely treats customers unfairly.

The Wolf of Warfare

CLO Magazine

We don’t stay in business without our employees being on the cutting edge of new technologies and digital transformation, because that’s the services that we provide to the government — whatever the latest and greatest cutting-edge stuff is.”. Karen Wolf, chief learning officer at defense contractor ManTech International, sees learning and development as essential to the success of the business. And she’s got her own unique leadership style.

Outstanding Achievement Joy for Unicorn's Henry

Unicorn Training

"The industry's best kept secret" is how judges described Unicorn Training's Henry Phillips as he won the ‘eLearning industry award for outstanding achievement – individual’ at the 2012 eLearning Awards at London Marriott Hotel Grosvenor Square last night (Thursday 8 November).Technical Technical Director, Henry, is a founding director of Unicorn and has continued to be a core member of the leadership team for 20 years, including three highly successful years as managing director.

Free L&D webinars for April 2020

Limestone Learning

Now and then, forecasting ROI on improved proficiency with critical skills is a useful pursuit as it helps demonstrate value in mathematical terms, when those all-important business measures are unavailable. Join Patti Phillips, CEO of ROI Institute, and Katharine Aldana, Learning Design Manager at Verizon, as they describe four simple ways to forecast ROI for your programs. However, performance-based, real-time recognition isn’t the reality for 53% of businesses.

Free 63

Start with the End in Mind

CLO Magazine

This approach is advocated by all the leaders in our field including Jack and Patti Phillips, Jim and Wendy Kirkpatrick, Roy Pollak, et al. Let’s first consider the type of learning that can contribute to your organization’s goals, such as sales training, cost reduction, quality improvement, employee engagement and leadership improvement efforts. Jack Phillips introduced the level 5 measure of ROI to address this issue.

Putting learning at the heart of talent strategy

Leo Learning

And by its very nature, this constant technical innovation and the accelerated pace of business are putting organisations of all types squarely in the learning business. And by its very nature, this constant technical innovation and the accelerated pace of business are putting organisations of all types squarely in the learning business. Aligning L&D with performance, succession planning, and business impact. Nguyen Phillips, A.,

Free L&D webinars for May 2018

Limestone Learning

L&D can’t prove ROI using the same methods other parts of the business do. Provide guidance on how to talk with your business leaders and other stakeholders about learning and argue “table stakes, not sweepstakes.” Thursday, May 3, 2018, 12PM – 1PM PT: Annual Leadership Survey Results: Are Your Organizations Doing Enough to Develop the Next Generation of Leaders? This session will explore: What the data says about leadership efforts so you can benchmark your organization.

Expert Panel: Learning Transfer, Chatbots, and Measurement

Mobile Coach

Her second book, Making Change Work: How to Create Behavioral Change in Organizations to Drive Impact and ROI, co-authored with Jack and Patti Phillips of the ROI Institute, was published in 2016 by Kogan Page. Expert Panel: Learning Transfer, Chatbots, and Measurement. By Casey Sullivan. 25 Nov 2019. On Nov 20th, we were pleased to host Trish Uhl, Emma Weber and Paul Bills for a panel discussion on chatbots, Coach M, behavior change, learning transfer, and measurement.

What is stopping companies from measuring learning: Skillsets, datasets, toolsets or mindsets?


In one of our recent posts, " Why you need to take a Google Analytics approach to measuring learning ," we lay the foundation of our perspective regarding L&D''s constant battle for greater relevance in business strategy and planning. In my book, the buck stops fairly and squarely with the L&D profession as it''s their job to persuade senior execs to invest in training to improve business performance," Graham Cook, founder of RSVP Design & Mobile Learning Design, argues.

Free L&D webinars for March 2018

Limestone Learning

Identify and practise the virtues of mindful leadership. But organizations that appreciate and recognize their employees—not just for blockbuster achievements but for meaningful efforts and results—get better business results than organizations that don’t, according to Brandon Hall Group research. This webinar is designed to inspire organizations to do a better job of recognizing and appreciating their employees—because it is the right thing to do, and it makes business sense.

Discussing the ASTD Handbook, eLearning, and Published Expertise with Elaine Biech

Web Courseworks

For example when contemplating the topic of evaluation several influential and respected names immediately come to mind: Kirkpatrick, Phillips, Brinkerhoff, and others. When comparing the two lists, you can see there are some immediate matches: ROI and Phillips; the Four Levels and Kirkpatrick. Now we still have other leadership experts without a topic. We all know that executives are very busy people.

ASTD 135

Why are there so few eLearning millionaires?

Unicorn Training

In this extract from a blog article, first published in Elearning Age in 2013, Peter Phillips looks at the commercial development of bespoke eLearning, and its growth from a small fragmented cottage industry into today’s much larger fragmented cottage industry.

Commonly Used Training Evaluations Models: A Discussion with Dr. Will Thalheimer

Convergence Training

And okay, if we can just walk through each of the four models you talked about–Kirkpatrick, Phillips, Kaufman, and Brinckerhoff–and maybe you can explain to people, especially people who may not have heard of any of these, what they are and what are some pros and cons of each. And I’m going to go into ROI, but it means return on investment, just like you would learn in business school. This looks like for leadership training, it could be anything along there.