Donald L. Kirkpatrick, 1924 - 2014

The Performance Improvement Blog

Kirkpatrick died. It seems like every training, HRD, and HPI manager knows the Kirkpatrick Model even if they don’t know the name of the model or who invented the four levels. They know they can evaluate reaction to training, learning from training, behavior change in the workplace, and results for the organization. Even assessment of “learning” doesn’t tell us much. However, this criticism doesn’t diminish my admiration for Kirkpatrick. Kirkpatrick

Kirkpatrick's Four Levels of Training Evaluation: A Critique

The Performance Improvement Blog

At the end of Dan McCarthy’s blog post , “How to Evaluate a Training Program”, in which he explains his pre-post, survey approach to applying the Kirkpatrick four levels of training evaluation , he asks: Has anyone used a system like this, or something better? While better than nothing, for many training programs (as well as for coaching, mentoring, simulations, self-directed learning, etc.), That’s part of the learning process. Many organizational factors (e.g.,

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Kirkpatrick’s Guidelines for Evaluating Training Programs

The E-Learning Curve

Kirkpatrick & Kirkpatrick set out “helpful” guidelines for the measurement of learning. Kirkpatrick’s Guidelines for Evaluating Training Programs is a post from: E-Learning Curve Blog.

Best practices on measuring the impact of organizational learning

Matrix

Learning measurement is one of those topics that constantly seems to need revisiting. The Kirkpatrick model still stands as a beacon in this sea of continuous renewal but there is the poignant need for a different approach to measuring everything from engagement to impact of training programs. Learning evaluation needs to be simpler. Ultimately, this will lead to a learning culture that is data driven. Read more: 4 Great tips for developing a learning culture.

Can We Align Kirkpatrick’s Guidelines & NonFormal Learning?

The E-Learning Curve

Kirkpatrick's guidelines are incompatible with the assessment of non-formal learning in three ways. Can We Align Kirkpatrick’s Guidelines & NonFormal Learning? is a post from: E-Learning Curve Blog.

The Learning Alliance and the Four Levels of Training Evaluation

The Performance Improvement Blog

In response to my blog post titled, “Kirkpatrick’s Four Levels of Training Evaluation: A Critique” , Wendy Kirkpatrick wrote a comment directing me to a white paper that she co-authored with Jim Kirkpatrick, "The Kirkpatrick Four Levels: A Fresh Look After 50 Years 1959 - 2009." That document describes updated thinking that the Kirkpatrick’s call “The Kirkpatrick Model”.

Evaluating Non-Formal Learning using Kirkpatrick’s Four-level model: More…

The E-Learning Curve

How to use the 4 Level Model to evaluate non-formal learning Evaluating Non-Formal Learning using Kirkpatrick’s Four-level model: More… is a post from: E-Learning Curve Blog. Tags: e-learning evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning workplace learning

Short Course on Evaluation of Training and Learning in Knowledge Economy

The Performance Improvement Blog

LAD Global , in partnership with the Singapore Training and Development Association , has made my short course on evaluation of training and learning available for free online. I hope people involved in talent development will find this course to be a helpful introduction to measuring the impact of all types of learning interventions, not only formal training. . My emphasis in this course is on using measurement and evaluation for learning.

Measuring the Learning Effect of Non-Formal Learning

The E-Learning Curve

I have asserted that non-formal learning (NFL) is located on a continuum between so-called informal and formal learning Measuring the Learning Effect of Non-Formal Learning is a post from: E-Learning Curve Blog. Tags: e-learning evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning workplace learning

Evaluating Non-formal Learning: Validity in Research

The E-Learning Curve

When considering research designs to evaluate the effectiveness of learning it's important to consider the types of data that you have access to. Evaluating Non-formal Learning: Validity in Research is a post from: E-Learning Curve Blog. Tags: e-learning evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning workplace learning

Approaches to Evaluating Non-Formal Learning: the Case Study

The E-Learning Curve

I consider a case study methodology to be the most effective strategy to use when evaluating non-formal learning. Approaches to Evaluating Non-Formal Learning: the Case Study is a post from: E-Learning Curve Blog. Tags: e-learning evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning workplace learning

Learning Culture & Human Capital: The Reality, the Myth and the Vision

The Performance Improvement Blog

iLearning Forum is the most important learning meeting in Europe. While preparing the Learning technologies France 2018 conference programme, I have been doing research and reading, and in particular looking at L&D trends, Talent Management and Human capital management. So much for Human Capital Management and Learning Culture! They realized that a culture focused on learning needs leaders and managers focused on learning.

Capturing non-formal learning-related data

The E-Learning Curve

This is the methodology I use to collect data on non-formal learning programs. Capturing non-formal learning-related data is a post from: E-Learning Curve Blog. Tags: e-learning case study evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning qualitative research design workplace learning

Evaluating Non-Formal Learning Programs – Table of Links

The E-Learning Curve

To wrap up this series of posts on the E-Learning Curve Blog, here is the complete table of links to each post in the series 'Evaluating Non-Formal Learning.' Evaluating Non-Formal Learning Programs – Table of Links is a post from: E-Learning Curve Blog.

Evaluating Non-formal Learning: Using ‘tests of rigor’ for validation

The E-Learning Curve

Evaluating Non-formal Learning: Using ‘tests of rigor’ for validation is a post from: E-Learning Curve Blog. Tags: e-learning evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning workplace learning Without rigor research is worthless becomes fiction and loses its utility.

Using Quantitative Data when Evaluating Non-Formal Learning

The E-Learning Curve

Using Quantitative Data when Evaluating Non-Formal Learning is a post from: E-Learning Curve Blog. Tags: e-learning case study evaluation formal learning informal learning Kirkpatrick knowledge workers non-formal learning nonformal learning organizational learning qualitative research design workplace learning

Non-Formal Learning – Evaluation Considerations

The E-Learning Curve

Workers are required to learn new skills, in the context of their functional tasks: they do not necessarily have the time to take formal training courses. Non-Formal Learning – Evaluation Considerations is a post from: E-Learning Curve Blog.

Learning to Learn from Evaluation of Learning

The Performance Improvement Blog

The Kirkpatricks have four levels, the Phillips have ROI, and Brinkerhoff has the Success Case Method. Each approach to evaluation of training has something to contribute to assessing the impact of formal training on employee learning. The real value is in organizational learning from evaluation. Learning from evaluation depends on asking the right questions. What’s important here is to realize that questions like these are a tool for learning, not blame.

Yet more on Evaluating Non-Formal Learning

The E-Learning Curve

The non-formal methodology I’m describing is a generalized account of the type work I carry out when developing and implementing non-formal learning initiatives in organizations. The type of learning interventions being discussed here are what [.] Yet more on Evaluating Non-Formal Learning is a post from: E-Learning Curve Blog.

[WEBINAR RECAP] CREATING A MODERN LEARNING STRATEGY: YOUR ROADMAP TO TRANSFORMING CORPORATE LEARNING

PDG

Is a changing work environment causing you to rethink your learning strategy? Modern learning strategies should be a flexible roadmap focused on the key metrics that drive your business. Here’s a sneak peek at what was discussed: What does a modern learning strategy mean to you?

Deeper eLearning Design: Part 1 – The Starting Point: Good Objectives

Learnnovators

The goal of this series is to build upon good implementations of instructional design, and go deeper into the nuances of what makes learning that really works. For a learning experience design to be truly effective, it has to have a focus. That focus is the outcome that the learning experience is designed to achieve. So, the starting point of a learning design has to be the objective that will achieve the outcome.

Year in Review in Learning - 2018

The Performance Improvement Blog

With the publication of my new book, Minds at Work: Managing for Success in the Knowledge Economy , I have continued to focus my blog posts on a manager’s role in supporting continuous learning for all employees in the workplace. And I have examined an employee’s responsibility for continuous learning in the Knowledge Economy. 1) This Is What I Believe About Learning in Organizations. I wrote: The Purpose of Business is Learning. We wrote: Learning independently.

Pernicious problems

Clark Quinn

I’m using a standard for organizational learning quality in the process of another task. So, for the first one, this is in their standard for developing learning solutions: Uses blended models that appeal to a variety of learning styles. Learning styles are debunked! Design for the learning instead! Why or for whom doesn’t matter.

On Talent Development Reporting principles

Matrix

Have you learned anything new today? How much have you learned since you had your morning coffee? And that’s one of the problems corporate L&D faces – accounting for how much employees have learned and, more importantly, how well. Obviously, this includes learning.

On measuring the impact of learning

Matrix

Yet it is precisely because everything is happening so fast that it’s increasingly difficult to measure the impact of learning within the organization. All the stakeholders declare that they understand the importance of organizational learning and consider it a profitable investment but they also feel it’s difficult to weigh the results. Read more: Measuring training effectiveness — the Kirkpatrick model. Read more: Why each employee needs a learning path.

What L&D professionals need to know about impact mapping

Matrix

The issue of quantifying L&D results in organizational outcomes is an old and sticky one. Today, I will discuss what impact mapping is and how it can help organizations that need a more focused learning approach. Looking at the learning value chain.

The Essential Guide to Learning Analytics in the Age of Big Data

Lambda Solutions

Download The Essential Guide to Learning Analytics in the Age of Big Data and keep it as your eLearning secret weapon! This article is designed to be your A-to-Z guide to learning analytics. You’ll discover: The basic concepts of learning analytics. Level 2: Learning.

Learning and Development Glossary

Petra Mayer

Therefore, the idea of this blog is to provide an easy reference around the varied concepts in learning and development. Take this as your Learning and Development Glossary, if you may, to stay up-to-date with the times. Agile Learning. Asynchronous Learning.

Senge, Learning Organizations and asking a question.

Mark Oehlert

A few days ago I tweeted a question about why Peter Senge never seemed to be mentioned in learning circles along with folks like Bloom, Gagne, and Kirkpatrick. : #crowdbooster told me that I was RT'd 7 times on that tweet and reached a potential audience of about 18,000 people. I don't work squarely in the learning and training field anymore and am quite happy being in the social media for the enterprise space and working for an awesome company like Socialtext.

Surfing the Net: Waste of Time or Personal Directed Learning.

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Surfing the Net: Waste of Time or Personal Directed Learning? by Paul on April 13, 2011 in Informal Learning , social learning Last week my girlfriend and I ate dinner at Darbar Indian Grill in Uptown Minneapolis with another couple (good food, but overpriced), and we got on the topic of surfing the net on the job. Brain Rules for Learning: Who Knew?

The other 5 principles of learning reinforcement

Matrix

On his quest to find the best way to reinforce organizational learning, Anthonie Wurth identified seven principles for achieving this. The following five principles refer to what the organization should do to ensure employees not only learn but get to apply that knowledge in the workplace for better results. At the same time, this type of „learning on demand” will have a minimal impact on daily responsibilities as everyone can access it when they have the time to do so.

48 Books Every Aspiring Chief Learning Officer Should Read

TalentLMS

I might be biased, but being part of the learning and development community is not only fascinating but rewarding. But it’s also the reason that to be the best trainer/ training manager/ chief learning officer, you have to keep your learning and development top of mind too. Learning books (4). Learning technology books (2). Learning & business strategy books (4). Learning and Development Culture books (5). Learning books. Kirkpatrick.

Revamping 70-20-10

CLO Magazine

There is a core set of frameworks that support the way organizational learning and development is conducted. Many of these, such as the Kirkpatrick evaluation levels, carrot and stick motivational programs and the ADDIE model have been around since the 1960s. The Kirkpatrick framework made sense in a world based on courses and classrooms. The world of mobile and social learning and Google, however, requires new measures.

Free learning & development webinars for March 2017

Limestone Learning

Wednesday, March 1, 2017, 11AM – 12PM PT: 6 Ways Every Learning Leader Should be Using Video (Free for ATD members) Melissa is a rising star at your company. This session will explore six examples of how companies are improving their learning strategies with video. Learn directly from Jim and Wendy Kirkpatrick, creators of the New World Kirkpatrick Model, how to start any training program right, so that value is built in and can effectively be demonstrated when it is complete.

Top 60 eLearning Posts for October 2010

eLearning Learning Posts

The art of Twitter , October 11, 2010 Learning how to use Twitter as a tool to develop your personal learning network is not always simple, and as with any other social networking tools, there is an unwritten protocol. Top 100 Tools for Learning 2010: Final list, presentation and more , October 18, 2010 Yesterday I finalised the Top 100 Tools for Learning 2010 list. Specifically, m-learning? This may be because designers only know about the Kirkpatrick “Levels.”

The Ultimate Glossary of eLearning Terms

LearnUpon

Active Learning. Active learning is a strategy focused on encouraging learners to actively participate in training. Examples of active learning activities include practical tasks and problem-solving conducted in small groups. It’s a five-phase framework that instructional designers use; a guideline for building effective training and learning support tools. In today’s fast-paced learning environments, the AGILE method is often seen as more efficient than ADDIE.

Free learning & development webinars for August 2020

Limestone Learning

Tuesday, August 4, 2020, 12PM – 1PM PT: Four Corporate Learning Design Practices: Making the Most of Remote Learning In this session, Darcy White, Ph.D., Learning Consultant, walks you through the ins and outs of building professional interactions in just minutes using Storyline 360.

LearnTrends: Backchannel

Jay Cross

Clark Quinn and I led a discussion on Reinventing Organizational Learning at LearnTrends this morning. Moderator (Clark Quinn): we're the people who've retained our love of learning despite our education. jadekaz: life long learning. Moderator (Clark Quinn): slow learning, not event learning. Chris 2: Agile networks require collaborative learning across companies. Is there an emerging model for social learning?