The Kirkpatrick-Phillips Model – Part 4

CommLab India

I mentioned the Kirkpatrick-Phillips Model of Evaluation in passing, and promised you more on this “ evolved ” model. I call this an “ evolved ” model because, the Kirkpatrick-Phillips Model of Evaluating a training program is based on the Kirkpatrick Model of Evaluation. There are four levels of evaluating a training program in the Kirkpatrick model; there is an additional fifth level in the Phillip model. Phillip ROI Methodology TM.

The Phillips ROI MethodologyTM – Measuring Data at All Levels – Part 5

CommLab India

In the fourth part of the series, we saw how the Phillips ROI Methodology TM suggests that measurements be taken at every level. The formula to measure ROI is: As you can see, the most important parts of the Phillips ROI Methodology TM are collecting and analyzing data, and we have seen how this can be done successfully. Related Posts The Kirkpatrick-Phillips Model – Part 4 Is Kirkpatrick’s Model of Evaluating a Training Program The Best?


Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Why is eLearning undervalued? Peter Phillips considers.

Unicorn Training

Peter Phillips'(Unicorn Training Chairman) considers why eLearning may still be undervalued as a training resource despite the cultural fascination with online technologies. We still see many examples of ‘find the next button, then click it and read’ or impressive design to disguise a course that is actually very poorly written, with little real instructional design and probably limited investment in testing the learning outcomes.

Train, Empower, Achieve: New Thoughts in Performance Support by Carla Torgerson and Phillip Neal

Learning Solutions Magazine

Design Strategies Getting Started Immersive Learning Instructional Design Mobile Learning Performance SupportIn the past, employees would have learned details of their jobs through formal training, through coaching, and by informal learning through Internet searches and conversations with peers.

Front-End Analysis: Backward Analysis and the Performance Gap

Dashe & Thomson

ADDIE Backward Analysis Cause Analysis Four Levels of Evaluation Front-end Analysis Instructional Design Jack Phillips Joe Harless Kirkpatrick Performance analysis Performance Gap Causal analysis Front-end analysis Performance Analysis performance improvement

Instructional Design Basics: What Is ADDIE?

Convergence Training

Many people who wind up having training creation as part of their job roles have never had a full opportunity to learn about the basics of instructional design, how people learn, and how to develop training. The Phillips “ROI” Model.


Bloomsburg University Instructional Technology Students Win Awards

Kapp Notes

The departments honoring students included: Audiology and Speech Pathology Biological and Allied Health Sciences Chemistry and Biochemistry Exercise Science and Athletics Geography and Geosciences Instructional Technology Mathematics, Computer Science and Statistics Nursing Physics and Engineering Technology While I think all of our Instructional Technology students are amazing, our department noted three students for special recognition.

E-Learning & Instructional Design 101

Rapid eLearning

There’s a lot of debate about instructional design and whether or not you need a formal education to create effective elearning. Today I want to explore some elements of instructional design and why it’s important when building an elearning course. Our brains just keep on working, whether we plan it or not (unless of course you’re at an Emo Phillips show ). Instructional Design. I’ve always seen instructional design as an intrusive process.

Cammy Beans Learning Visions: Instructional Strategies?

Learning Visions

Cammy Beans Learning Visions Musings on eLearning, instructional design and other training stuff. Friday, March 14, 2008 Instructional Strategies? What instructional strategies do you use to make your content more memorable and engaging? Im not just thinking about the gadgets and the gizmos that you use or the instructional design "method" behind the process (e.g., Mnemonics "King Phillip Came Over From Geneva Spain" Remember that one from high school biology?

Introduction to Performance Consulting

Infopro Learning

You can measure the results from performance consulting initiatives using the following levels of evaluation (ref: Jack and Patti Phillips — ROI methodology): Level 1: Have employees responded favorably to the new initiatives? Instructional DesignIn the last couple of years, performance improvement has become a key focus area for organizations across the world.

CAC Presentations

Kapp Notes

Phillips kicked off the CAC this year with introductions and advice for attendees. Dr. Phillips kicks off the CAC. Robyn Defelice discussing project management, instructional design and finding your inner PM. The first presentation this semester is by Robyn Defelice who is discussing project management and the elements that contribute to effectively managing a project. Check out all the presentations at our live link. The CAC event is packed, with a full house.

How to Improve Learning Retention with Contextual Feedback


Successful eLearning outcomes require clear communication between instructional designers and the learners themselves. Instructional designers must therefore be diligent in developing processes for delivering the feedback they provide to their students – both for correct and incorrect responses. To mitigate this risk, instructional designers should have a formal decision-making plan in place to provide effective feedback to their students.

Cammy Beans Learning Visions: Super-Close Google Map Zooms

Learning Visions

Cammy Beans Learning Visions Musings on eLearning, instructional design and other training stuff. I stumbled across this blog entry today from Phillip Lennsen, Google Blogoscoped. Posted by Cammy Bean at 12:49 PM 0comments: Post a Comment Newer Post Older Post Home Subscribe to: Post Comments (Atom) Cammy Bean Greater Boston, MA, United States View my complete profile About This Blog Subscribe in a reader Subscribe via email Are you an Instructional Designer?

Google 100

Cammy Beans Learning Visions: Games for the Brain

Learning Visions

Cammy Beans Learning Visions Musings on eLearning, instructional design and other training stuff. Wednesday, March 07, 2007 Games for the Brain These brain games are from Phillip Lenssen, via Dean at my company who was thinking about how we could use brain teasers or games to get a learner prepped to learn. Best of Learning Visions Essential Reading for Instructional Designers The Corporate Moodle: A Tipping Point? Online Chat with Charles Reigeluth (Instructional.

Brain 100

What Are mLearning's Benefits, Challenges, Future? by Bill Brandon

Learning Solutions Magazine

In this interview, Peter Phillips, CEO of Unicorn Training Group, offers his insights into the business benefits. Design & Development Tools Emerging Topics Instructional Design Mobile Learning Training Strategies of mobile learning, particularly for continuing professional development. He discusses what drives adoption. of mobile learning, what impedes adoption, and what to do about change management.

Timing is Everything Series: Part 6 Structured vs. On-Demand Learning

Infopro Learning

Sources: Phillips, J. Instructional DesignTiming is Everything Series: Intro , Anxiety , Information Overload , Knowledge Formation , Optimum Performance , Growth , Stagnancy , or Decline , Structured vs. On-Demand Learning, ( Download the complete white paper ). Structured vs. On-Demand Learning.

Introduction and Summary Scripts for Virtual Instruction Safety in the Manufacturing Industry

Training Industry

This is particularly true in virtual instruction where you are not physically present to excite your audience. After years of successfully developing and presenting virtual instruction, I have found that the foundations of a firecracker virtual training class are lighting rod introduction and summary scripts. October 23, 1989: Phillips disaster. Endings and beginnings are more important than middles.

Learning for Leaders: 3 Tips for Your eLearning Coaching Courses

eLearning Brothers

Only by knowing exactly which tools are in your arsenal can you properly assess a situation and form the proper “plan of attack,” much like how a handyman/woman should recognize when a particular screw will require the use of a Phillip’s head screwdriver or a flathead screwdriver. Course Library Custom Solutions Developer Resources eLearning Featured Instructional Design Resources Products/Services Project Management Resources Resources Training Resources

How do you measure how training creates value? – The 7 learning principles

Learning Wire

The Kirkpatrick/Phillips model shows us how and why to assess training outcomes. Overhead costs : training department, salaries of in-house trainers and instructional designers, rooms set aside for training, equipment, software licences, etc. Instead of a set of data, it involves a chain of measurable proofs of benefit, as shown in the Kirkpatrick/Phillips pyramid. According to Phillips (2012), intangibles are benefits that cannot be given a monetary value.

Three Challenges Faced by Today’s L&D Leaders

Your Training Edge

Rob Brinkerhoff, a professor at Western Michigan University and thought leader in the field, puts that number 80 to 85% (Phillips, 2016)! In a 2008-2009 study, Jack and Patti Phillips surveyed the CEOs of Fortune 500 and large, private-sector employers. Jack & Patti Phillips, Measuring What Matters: How CEOs View Learning Success 2009). Phillips, Jack & Phillips, Patti. Phillips, Ken.

5 More Great Books for Your Learning & Development Bookshelf

Mike Taylor

Dana Gaines Robinson, James Robinson, Jack Phillips Partricia Phillips & Dick Handshaw. E-learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. How To Instructional Design LDToolbox learning WorkOutLoud Workplace Learning BooksIn case you missed it, Connie Malamed and JD Dillon both recently recommended 5 good books for Learning & Development pros.

Pipes 66

Are learning objectives really that important?

The eLearning Nomad

Yet, the evaluation models most talked about in the e-learning sector (Kirkpatrick and Phillips) do exactly that. Adult learning Instructional design I don’t know about you, but I often hardly take notice of the learning objectives when I start a course. If the course theme inspires me and I decide to register, I take the attitude of ‘take me along on your journey and I’ll decide for myself what I take home…’.

Is Kirkpatrick’s Model of Evaluating a Training Program The Best? – Part 3

CommLab India

This is the third blog in the Kirkpatrick Model of Instruction series. His name is Dr. Jack Phillips. The Phillips Model adds a fifth step to the Kirkpatrick Model of Evaluation – Return on Investment. Related Posts Kirkpatrick’s Model of Evaluation – the Very Basics of the Model: Part 2 Kirkpatrick’s Model of Evaluation – Making Maximum Use of Evaluation: Part 1 E-learning Design: Instructional Design Models Vs Strategies.

Short Course on Evaluation of Training and Learning in Knowledge Economy

The Performance Improvement Blog

In other words, L&D professionals are using “smile sheets” that measure immediate reaction to classroom instruction, collected at the end of training. I summarize three major approaches to evaluation: Kirkpatrick’s four levels ; Phillips’ ROI ; and Brinkerhoff’s Success Case Method. LAD Global , in partnership with the Singapore Training and Development Association , has made my short course on evaluation of training and learning available for free online.

Kirkpatrick’s Four Levels of Evaluation


Since Kirkpatrick stated his original model, other theorists like Jack Phillips, have referred to a fifth level, namely, Return On Investment (ROI). e-learning elearning Instructional Design Learning Theory Learnnovators C2 Workshop Kirkpatrick's Four Levels of EvaluationIt was while writing his thesis in 1952 that Donald Kirkpatrick became interested in evaluating training programs.

Brewing CALDO: How communications and learning professionals can thrive using DevOps

CLO Magazine

Is Instructional Design Thriving or Dying? ” . Instructional Design Is Dead ” . Instructional Design is Dead. If Instructional Design is Dead, What Fills the Void? ”. Is the learning and development profession overwhelmed? Odds are, you might be feeling overwhelmed.

The Evolving Face of Embedded Performance Support


Below are a few performance support solutions that we’ve already designed: XL Mill MPSS : A tablet-based performance support solution (made up of quick, bite-sized instructional videos accompanied by Quick Reference Guides) that leverages the power of QR Codes. THE QUOTE: “ Design and develop performance support solutions with a focus on context, not content.” – Jeremy Smith. “ You can’t teach people everything they need to know.

Do You Know Whether Your eLearning is Effective?


According to Jack Phillips, there are five ways to determine whether training is effective : Level 1: Were learners satisfied with what they learned? Moreover, if you followed your instructional design process well, you built in time to do this evaluation from beginning to end. Course Development E-learning Online Course Development Online Training e-learning elearning instructional design

E-Learning vs. In-Person: A False Dichotomy

The Performance Improvement Blog

The single most effective way to eliminate in-person training related costs is to replace classroom instruction with online training. They quote Jack Phillips: “Our studies have shown that participants in e-learning programs are less likely to follow through than in an instructor-led program,” notes Jack Phillips, Ph.D., Online training and conferencing advocates continue to ask the wrong question.

Vale Don Kirkpatrick

Clark Quinn

And it’s instructive to see why on both sides. The Phillips have made a similar career with their fifth level, ROI, measuring the cost of impacting level 4 against the value of the impact. Last week, Don Kirkpatrick passed away. Known for his four ‘ levels ‘ of measuring learning, he’s been hailed and excoriated. He derived his model as an approach to determine the impact of an intervention on organizational performance.

Discussing the ASTD Handbook, eLearning, and Published Expertise with Elaine Biech

Web Courseworks

For example when contemplating the topic of evaluation several influential and respected names immediately come to mind: Kirkpatrick, Phillips, Brinkerhoff, and others. When comparing the two lists, you can see there are some immediate matches: ROI and Phillips; the Four Levels and Kirkpatrick. Managing eLearning astd book review books development process distance learning elearning instructional design interview Jon Aleckson subject matter experts

ASTD 135

4 Critical Factors for Evaluating a Learning Company

Obsidian Learning

Co-authored by Adam Lowry and Carl Phillips (both are project managers at Obsidian Learning). New post 4 Critical Factors for Evaluating a Learning Company on Obsidian Learning. As many of our past blog posts demonstrate, talent and creativity are a big part of what happens at Obsidian. But as much as we are passionate about applying both to create effective learning experiences, we also understand that there must be a business case for choosing a learning company.

eLearning Course Development – What’s The Right Tool for the Job?

ePath Learning

You won’t get far using a flat head (or slotted) screwdriver when you really need a Phillips screwdriver. About the Author: Kris Castiaux is a Learning Environment Concierge (instructional designer) focused on creating impactful and effective learning experiences and environments. Before beginning any home improvement project, you should make sure that you have the proper tools and materials to complete the job.

Evaluating Training – Capturing the Benefits Aspect of ROI

Obsidian Learning

The Phillips ROI Methodology took this model a step further, adding the ROI calculation as a fifth level. Blended Learning eLearning Instructional Design Leadership Process Project Management Support Training Evaluation adult learning BCR benefit cost ratio budget cost management return on investment ROI training evaluationNew post Evaluating Training – Capturing the Benefits Aspect of ROI on Obsidian Learning.

Ten People Every Learning Pro Should Know

Mike Taylor

I´ve yet to meet the person who has dreamed all their life of becoming an instructional designer, elearning devolper, or any other L&D role. Performance Consulting: A Strategic Process to Improve, Measure, and Sustain Organizational Results Dana Gaines Robinson, James Robinson, Jack Phillips Partricia Phillips & Dick Handshaw.

#ATD2015 It’s a Wrap Part One: Sue Prenderville

Learning Rebels

Michele Lawson and Kelly Phillips. Now based in Vancouver, she works as a freelance instructional designer and e-learning author for Limestone Learning Inc. #ATD2015 – It’s a wrap! The ATD ICE (Association for Talent Development International Conference and Expo) Conference never fails to teach me something new. This will have been my sixth time, in a row, attending this conference and by now, one would think I would be nonchalant about the experience.

A Day in the Life of a Learning Objective

CLO Magazine

It’s at the center of the instructional systems design process, which is a core part of the way learning practitioners create courses. Robert Gagne’s foundational work during World War II with the Army Air Corps to effectively train pilots, and Robert Mager’s “Preparing Instructional Objectives” (1962), which defined a process to create effective learning objectives, to name a couple. Shapiro is an instructional systems design consultant.