Alternative to the Kirkpatrick Model of Training Evaluation

LearnDash

If you have been in the elearning (or training) industry for any amount of time, then you are most likely aware of the Kirkpatrick model of learning evaluation. One could write an entire book on the Kirkpatrick model and the different levels, but I am not going to get into too much detail. On nearly every consulting project I have worked on, the Kirkpatrick model has been what we have used to gather and report data to the client.

Kirkpatrick Revisited | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Kirkpatrick Revisited by Barbara on April 18, 2011 in Instructional Design After I finished my post a few weeks ago on Reevaluating Evaluation , I found out that Donald Kirkpatrick , the granddaddy of the Four Levels of Evaluation, was taking a farewell tour before his retirement and would be presenting a workshop at the American Society of Training and Development (ASTD) in Minneapolis.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

50 Years of the Kirkpatrick Model

Upside Learning

In the fifty years since, his thoughts (Reaction, Learning, Behavior, and Results) have gone on to evolve into the legendary Kirkpatrick’s Four Level Evaluation Model and become the basis on which learning & development departments can show the value of training to the business. In November 1959, Donald Kirkpatrick published a series of seminal articles on training evaluation in the ‘Journal of the ASTD’.

JANE BOZARTH – CRYSTAL BALLING WITH LEARNNOVATORS

Learnnovators

Custom E-Learning E-Learning Interviews Learning Consulting WOL #lrnchat B. Traynor Beverly Traynor Brinkerhoff Community of Practice Donald Kirkpatrick e-learning eLearning Guild Master Award eLearning Solutions on a Shoestring Empathy Map Etienne Wenger Flipchart Geometric Close HR Jane Bozarth Khan Academy Kirkpatrick’s Taxonomy L&D Learning Solutions Magazine Learnnovators M.

Is It Time To Kill the Kirkpatrick Model?

Trivantis

The Kirkpatrick Model for training evaluation is kind of like Old Faithful. Here is the model as described by the Kirkpatrick Partners: But is the Kirkpatrick Model still valid? I wasn’t the only one who thought his phrasing was a little harsh: When it comes to the Kirkpatrick Model and its four levels of training evaluation, everyone has an opinion—and they’re not always flattering. However, not everyone hates the Kirkpatrick Model.

DEEPER ELEARNING DESIGN: PART 1 – THE STARTING POINT: GOOD OBJECTIVES

Learnnovators

This is the first post in a series of six that covers Deeper eLearning. There’s a process called performance consulting that looks to determine what the real need is, and this should be employed before determining a course is the solution. x --x --x --x --x Here are links to all six parts of the "Deeper eLearning Design" series: 1. Deeper eLearning Design: Part 1 – The Starting Point: Good Objectives. Deeper eLearning Design: Part 2 – Practice Makes Perfect.

Design 106

Deeper eLearning Design: Part 1 – The Starting Point: Good Objectives

Learnnovators

This is the first post in a series of six that covers Deeper eLearning. There’s a process called performance consulting that looks to determine what the real need is, and this should be employed before determining a course is the solution. Here are links to all six parts of the “Deeper eLearning Design” series: 1. Deeper eLearning Design: Part 1 – The Starting Point: Good Objectives. Deeper eLearning Design: Part 2 – Practice Makes Perfect.

Why eLearning Development Ratios Can be Hazardous to Your Career.

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Why eLearning Development Ratios Can be Hazardous to Your Career by Jon on November 15, 2010 in budgeting , eLearning Brandon Hall , in partnership with Chapman Alliance , recently published the results of its latest survey about eLearning development ratios. The subject matter – teaching consultants how to configure ERP software – was unusually complex.

Ratio 144

Why eLearning Development Ratios Can be Hazardous to Your Career

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Why eLearning Development Ratios Can be Hazardous to Your Career by Jon on November 15, 2010 in budgeting , eLearning Brandon Hall , in partnership with Chapman Alliance , recently published the results of its latest survey about eLearning development ratios. The subject matter – teaching consultants how to configure ERP software – was unusually complex.

Ratio 122

Is Your Measuring Stick Allowing You To Manage For The Better.

Dashe & Thomson

by Guest on April 2, 2011 in performance support Lynn Cases is a Senior Training Consultant for Dashe & Thomson. Lynn Cases, Senior Training Consultant Blog this! Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Is Your Measuring Stick Allowing You To Manage For The Better? She currently leads training at General Mills for Standard Desktop Applications, SharePoint, and New Hire Orientation.

eLearning – Are We Missing The Point?

TalentLMS

I want to start this off by asking one simple question…does eLearning really work? There are many arguments both for and against eLearning, but the stark reality is, that if you are pushed for an answer, when you look at the facts, the answer is a resounding “NO”…but it so easily could be a “Yes.” First and foremost is that there are no real FACTS about eLearning being effective, particularly in the workplace. Who is eLearning for? Opinion eLearning

Learning Design: The Great, The Good and The Good Enough

Wonderful Brain

Here lies the collision and connection: In the hopes that ‘rapid’ eLearning cannot only reduce the time to create courseware the tools, ever more nuanced, allow developers to become designers as well. I don’t believe there has been a study conducted on performance improvement or even a Kirkpatrick view of which types of courses yield intended results. This could be a story about buggy whips.

The Lonely eLearner: Creating Social Learning Anchors | Social.

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS The Lonely eLearner: Creating Social Learning Anchors by Andrea on March 9, 2011 in LMS (Learning Management System) , blended learning , eLearning , feedback , social learning The other day, I ran across Clive Shepherd’s recent blog post The New Social Learning – a review and I was struck by an observation he made there.

Social 130

ROI and Metrics in eLearning

Tony Karrer

I'm working on an article around the use of ROI and metrics in eLearning. Kirkpatrick's Level 3: Improving the Evaluation of E-Learning Level 3 evaluations measure whether the there was an actual transfer of learning to the actual work setting. BPM and workflow technologies have been able to achieve significant gains in productivity Metrics Recently, functional managers have begun using eLearning to meet business objectives.

Stop Evaluating Training!

Upside Learning

"So how do you evaluate the success of eLearning that you create?" Kirkpatrick’s evaluation model has long been the holy grail of training effectiveness measurement to businesses. My response to clients has typically been: If you are referring to Kirkpatrick Levels 1 & 2 it’s not very difficult; ‘smiley sheets’ will tell us about Reaction, and ‘assessments’ can help determine Learning. eLearning

Commonly Used Training Evaluations Models: A Discussion with Dr. Will Thalheimer

Convergence Training

And if you’d like to read other discussions we’ve had with Will, click these links to learn more about spaced practice , the effectiveness of elearning , smile sheets, and learning myths v. Here’s some research I did with the eLearning Guild just last year. But this research study is available at the eLearning Guild. And I do this a lot in my consulting work. Four Common Learning Evaluation Models–Kirkpatrick, Kaufman, Philips & Brinkerhoff.

Instructional Design: The Process – 1

Origin Learning

There have been all types of blend in learning, using all possible avenues from brick-and-mortar classrooms, virtual classrooms, eLearning, digital tutorials, videos, to xAPI tracking all forms of social or informal learning. Use the Ruth Clark’s media principles of design for effective eLearning. Measure the learning effectiveness with Kirkpatrick’s Four Levels of Training Evaluation. Course creation and delivery have come a long way in the past couple of decades.

Free L&D webinars for January 2021

Limestone Learning

Join Olu Burrell, CEO of Olu Burrell Consulting, for a session where you’ll: Learn the Three Value Proposition , a framework for aligning your values to your career path no matter the conditions. “ Winter, landscape, snow ” by Michael Gaida is licensed by Pixabay.

Free 107

Unlocked Learning—Training analytics made easy

Coassemble

So our CEO Ryan started consulting with firms to see how knowledge was being shared effectively and where teams engaged most. One of the biggest eLearning mistakes that occur with online training is devoting disproportionate amounts of time to assessment.

Free learning & development webinars for April 2021

Limestone Learning

PT: Rethinking the Way You Author Elearning Whether in a large enterprise or a team of one, elearning authors today are expected to deliver effective learning outcomes using minimal resources, rapid turn-around time and a razor-thin budget.

Free 83

Free L&D webinars for January 2020

Limestone Learning

Thursday, January 9, 2020, 9AM – 10AM PT: Context Matters — Quit Writing Questions and Design Elearning Experiences Instead Elearning seems irretrievably bound by questioning and testing — often meaningless and almost always off-putting to the learner.

Free L&D webinars for May 2020

Limestone Learning

In this webinar, with Jim Kirkpatrick, Ph.D., Join Juan Moran, Solutions Consultant at NovoEd, for a demo to learn how NovoEd’s collaborative learning platform enables global enterprises to transform in-person workshops into highly engaging digital learning experiences.

Free 65

Measuring Learning Effectiveness: Beyond Training Happy Sheets & Memory Recall

Learning Cafe

Despite Learning measurement frameworks like Kirkpatrick and Philips ROI that have been around for so many years, defining meaningful measures still continues to be a big challenge for L&D. Will Thalheimer, PhD, is a consultant and research translator, providing organizations with learning audits, research benchmarking, workshops, and strategic guidance. Will consults through Work-Learning Research, Inc.

The Top 7 Was You Can Utilize Your Remaining 2018 Training Budget

Coreaxis

Priorities will vary by company, industry, and by applying a little performance consultation, you can quickly identify your learning priorities and determine where the remaining budget can be spent. When you translate your eLearning courses, you are able to deliver consistency of training which can increase productivity, foster a more inclusive workplace, and maximize time spent training.

Brain Rules for Learning: Who Knew? We All Did. | Social Learning Blog

Dashe & Thomson

by Andrea on April 15, 2011 in Classroom Learning , Informal Learning , Training Development , blended learning , eLearning , social learning Recently, I was lucky enough to attend a keynote speech by Dr. John Medina on his book Brain Rules at the eLearning Guild’s Learning Solutions 2011 conference. First, in a classroom or eLearning environment, I think we need to restructure our training to provide more opportunities for repetition of important material.

Brain 141

Unlocked Learning—Training analytics made easy

Coassemble

So our CEO Ryan started consulting with firms to see how knowledge was being shared effectively and where teams engaged most. One of the biggest eLearning mistakes that occur with online training is devoting disproportionate amounts of time to assessment. The earliest and most widely accepted and formalized training assessment process was the Kirkpatrick Model by Dr. Donald Kirkpatrick. Being able to measure your team’s training is crucial to its effectiveness.

Manifesting in practice extended

Clark Quinn

In my last post, I wrote about the first step you should take to move to Serious eLearning , which was making deeper practice. performance consulting and Kirkpatrick level 4), then figure out what performance by individuals would lead to that business change, and then develop your learning objectives and practice to get people able to do that performance.

The Learning & Development Podcast: Design Thinking with Danny Seals and Tim Brind

looop

Tim, I’m not sure if you want to take him through what we did with the large consultants company we work with? I’ve been in operations for, what, the last 10 years, and moved back to a more design role, consulting in Danny’s team only recently.

The LTEM Training & Learning Evaluation Model

Convergence Training

And in particular, we talked about Kirkpatrick , Philips , Brinkerhoff , and Kaufman. And not only that, but our learning evaluation gurus, Kirkpatrick, Brinkerhoff, etc., Comparing LTEM and Kirkpatrick. Level three of Kirkpatrick is similar to tier seven, transfer.

The Temporary Staffing Revolution | Social Learning Blog

Dashe & Thomson

Because of the vast range of services we provide as a management consulting firm, we’re something different to every client. Some see us as instructional designers, some as technical writers, others as change management consultants, and still others as a supplemental staffing agency. Many consulting firms in our industry become too niche and lose out on work they can easily provide but do a poor job of marketing.

Organizational Change Management Cited – Again – as Key.

Dashe & Thomson

In a recent post, he cites a recent poll by Panorama Consulting , in which IT executives are asked about the “deadliest sin” of ERP implementations.

Change 126

Why Companies Should Spend More on Social Learning | Social.

Dashe & Thomson

Among industries, a greater number of technology companies and business services/consulting firms spent money on these tools. Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Why Companies Should Spend More on Social Learning by Paul on May 5, 2011 in Informal Learning , blended learning , social learning Companies are spending next to nothing on social learning, and their frugality is going to come back to haunt them.

Not Everyone is a Social Customer | Social Learning Blog

Dashe & Thomson

Thierry de Baillon , cofounder of Socialearning Consulting, takes this stance in a recent blog post. Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Not Everyone is a Social Customer by Paul on February 11, 2011 in Development Tools , customer service , social learning A couple weeks ago I wrote a blog about the need to train your clients on the various methods of…training.

Social 116

The $2 Whiteboard Shows Power of Peer-to-Peer Learning | Social.

Dashe & Thomson

Of course, the person “next to you” might just as often be consulted via email or other online tool, but it doesn’t change this fact: the amount of workplace learning done in formal training sessions is a tiny fraction of of the learning that takes place one-on-one, between coworkers.

5 Ways to Increase the Value of Your Customer Base

Dashe & Thomson

Selecting consultants with the appropriate skills, experience and personality goes a long way to make a client happy. Some companies treat their customers as partners, especially in the B2B markets – soliciting their help in the design of a new eLearning module or getting ideas for better customer service.

Custom 100

Make Learning An Experience. Blend It! | Social Learning Blog

Dashe & Thomson

Allow them to discover information in bite-sized portions through self-directed activities such as eLearning, and then follow-up with a workshop, discussion group, open lab, or other opportunity to apply the new information. You will still need to create good content, but simple eLearning development tools will help make the transition from ILT to blended learning a smoother one.

5 Ways to Increase the Value of Your Customer Base | Social.

Dashe & Thomson

Selecting consultants with the appropriate skills, experience and personality goes a long way to make a client happy. Some companies treat their customers as partners, especially in the B2B markets – soliciting their help in the design of a new eLearning module or getting ideas for better customer service.

Custom 100

The Power of Your Network | Social Learning Blog

Dashe & Thomson

Train Your Client On Training January 31, 2011 Leveraging the Law of the Few to Manage Change in the Workplace February 21, 2011 Analyzing the ROI of Social Media in Training May 3, 2011 Why eLearning Development Ratios Can be Hazardous to Your Career November 15, 2010 eLearning Review: A Module for the National Security Arena October 15, 2010 Virtual Boot-Camp: Games and Learning with the U.S.

Accelerated Learning: Where Does It Fit In? | Social Learning Blog

Dashe & Thomson

Train Your Client On Training January 31, 2011 Leveraging the Law of the Few to Manage Change in the Workplace February 21, 2011 Analyzing the ROI of Social Media in Training May 3, 2011 Why eLearning Development Ratios Can be Hazardous to Your Career November 15, 2010 eLearning Review: A Module for the National Security Arena October 15, 2010 Virtual Boot-Camp: Games and Learning with the U.S.

Free learning & development webinars for August 2017

Limestone Learning

Tuesday, August 8, 2017, 12PM – 1PM PST: Adjusting Your Consultative Selling Approach to Engage the Modern Buyer (Free for ATD members) Today’s buyers are ultra-informed and have more options than ever before. A consultative selling approach should help sellers cut through the noise and lead their customers to clarity. In this webcast, you’ll learn how to bring a fresh approach to your consultative selling training programs. eLearning