How to Evaluate Learning: Kirkpatrick Model for the 21st Century—A Revision

Dashe & Thomson

I was asked by Wendy Kirkpatrick to remove the copyrighted Kirkpatrick diagrammatic model from my original blog post, How to Evaluate Learning: Kirkpatrick Model for the 21st Century.

Kirkpatrick Revisited | Social Learning Blog

Dashe & Thomson

I have included Kirkpatrick’s Four Levels of Evaluation in every proposal I have ever written, and I wanted to hear from Kirkpatrick himself regarding his take on the current state of evaluation and whether his four levels are still viable.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

To “Kirkpatrick” or not to “Kirkpatrick”, that is the Question (or is it?)

Learning Rebels

To “Kirkpatrick” or not to “Kirkpatrick”, that is the question. Many a person has debated the Kirkpatrick evaluation taxonomy. To name a few: Dan Pontefract: Dear Kirkpatrick’s: You Still Don’t Get It (a personal favorite).

Vale Don Kirkpatrick

Clark Quinn

Last week, Don Kirkpatrick passed away. Performance support interventions or social network outcomes could similarly be measured (at least on levels 3 and 4), yet the language was all about training, which made it easy for folks to wrongly conclude that training was your only tool. Kirkpatrick rode this tool for the rest of his career, created a family business in it, and he wasn’t shy about suggesting that you buy a book to learn about it.

Evaluating Social Learning

Dashe & Thomson

There are people looking at applying the Kirkpatrick model, there are people measuring the use of social learning tools, and there are people talking about something similar to Brinkerhoff’s Success Case Method. So how does he apply the model to creating and evaluating social learning?

Re-evaluating Evaluation | Social Learning Blog

Dashe & Thomson

And as time has gone by, I have started to wonder about the validity of Kirkpatrick in today’s world. The title was “Expanding ROI in Training Programs Using Scriven, Kirkpatrick, and Brinkerhoff,” which sounds pretty academic.

Evaluating Informal Learning

Dashe & Thomson

She knows that I have been blogging about learning evaluation for the past couple of years—mostly Kirkpatrick but also [.] The post Evaluating Informal Learning appeared first on Social Learning Blog.

Why Companies Should Spend More on Social Learning | Social.

Dashe & Thomson

Cammy Bean’s latest blog post provides many ideas as well as real-life examples for Using Social Media for Learning. The slow adoption of social learning is not localized to Minnesota and North Carolina.

Social Media Metrics

Clark Quinn

I continue to get asked about social learning metrics. Until we get around to a whitepaper or something on metrics, here’re some thoughts: Frankly, the problem with Kirkpatrick (sort of like with LMS’ and ADDIE, *drink*) is not in the concept, but in the execution. But I digress… So, let’s say you are interested in seeing what social media can do for your organization: what are you not seeing but need to? social strategy

Online Video: the Perfect Social Learning Tool? | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Online Video: the Perfect Social Learning Tool? Because video is, apparently, a perfect manifestation of social learning theory.

Measuring Training Effectiveness Through Gaming

Dashe & Thomson

The post Measuring Training Effectiveness Through Gaming appeared first on Social Learning Blog. Evaluation Gaming Theory evaluation feedback gaming Kirkpatrick user adoption

Games 224

How Social Networks Can Harness the Power of Weak Ties | Social.

Dashe & Thomson

A lot of the Social Media Mavens , however, are really ranting, not about the technology, but about the human dynamics related to social networking. Learning and development professionals should remember the Weak Ties theory when designing social learning systems.

The Lonely eLearner: Creating Social Learning Anchors | Social.

Dashe & Thomson

In this lonely form of learning, there is no opportunity for social learning to take place, either in the moment or as a follow up. I think we need to provide learners with some “social anchors&# in these types of eLearning programs to help facilitate the social learning process.

Social 166

Hey, That's Social Learning! | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Hey, That’s Social Learning! These kids really get social learning!

Analyzing the ROI of Social Media in Training | Social Learning Blog

Dashe & Thomson

In no realm has this been more evident than in our constant encouragement of the use of internal social media networks as a crucial benefit-multiplier for any employee training project. So, long story short, social media once again proves its immense utility in a world where Web 2.0

Top 5 Performance Support Apps for Learning Designers

Learnnovators

That’s why Instructional Design Guru defines terms from Instructional Design, Cognitive Psychology, Social Media, Multimedia, Technology and Law. offers 40 short practical sessions on business aspects, instructional design, graphics & multimedia, and social media.

What’s New In Enterprise Learning?

Dashe & Thomson

Does it improve on Kirkpatrick? Here’s a recent article by Kineo’s Cammy Bean that offers quick but helpful tips on social learning implementation. [link]. social learning elearning Kirkpatrick learning evaluation mLearning project management virtual classroom

Not Everyone is a Social Customer | Social Learning Blog

Dashe & Thomson

This ever-changing technological landscape is currently held captive by social media, and for good reason. Are people still just people, customers still customers, and social media simply tools we can all add to our ever-growing belt?

Custom 148

Who's Building the Social Learning Roads? | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Who’s Building the Social Learning Roads? I’m merely attempting to show how confusing this new world of social media is.

Social 148

Hey, That's Social Learning!

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Hey, That’s Social Learning! These kids really get social learning!

Front-End Analysis: Backward Analysis and the Performance Gap

Dashe & Thomson

The post Front-End Analysis: Backward Analysis and the Performance Gap appeared first on Social Learning Blog.

Twitter as Social Learning: Seven Ways to Facilitate the Exchange.

Dashe & Thomson

Where Facebook and LinkedIn serve mainly as social dashboards for our personal and professional networks, respectively, I see Twitter as a customized information portal. The point is, Tweet Deck gives me a completely customizable, real-time social learning feed.

The Impact of Social Learning: Will You Be The First? | Social.

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS The Impact of Social Learning: Will You Be The First? But what does that have to do with social learning? Social learning no longer has to take place in person.

Social 200

Embracing Innovation in Learning | Social Learning Blog

Dashe & Thomson

View all posts by Andrea → ← Who’s Building the Social Learning Roads?

The Sound of Silence | Social Learning Blog

Dashe & Thomson

View all posts by Jim → ← Organizational Change Management Cited – Again – as Key Contributor to ERP Failure Do Instructional Designers in the Social Digital Age need an Engineering Background?

Sound 174

What Can Charlie Sheen Teach Us About Internal Marketing? | Social.

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS What Can Charlie Sheen Teach Us About Internal Marketing? by Jim on March 8, 2011 in social learning I’ll be honest. Just good, wholesome, social learning knowledge.

Teach 163

Using Kirkpatrick's Four Levels to Create and Evaluate Informal & Social Learning Processes

Big Dog, Little Dog

In my last post, The Tools of Our Craft , I wrote how the Four Level Evaluation model is best used by flipping it upside down and that it can be used to evaluate informal and social learning. In this post, I want to expand on the second point—evaluating informal and social learning. Note that this post uses as actual problem that is based on informal and social learning for the solution. Store it in a social site (such as a wiki or SharePoint) for easy retrieval.

Who's Going to Build the Social Learning Roads?

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Who’s Building the Social Learning Roads? I’m merely attempting to show how confusing this new world of social media is.

Social 130

Give User Adoption the Respect it Deserves | Social Learning Blog

Dashe & Thomson

View all posts by Paul → ← How Social Networks Can Harness the Power of Weak Ties Virtual Boot-Camp: Games and Learning with the U.S.

Adopt 191

Rx for SMEs | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Rx for SMEs by Jolene on January 14, 2011 in subject matter experts , system implementation training Subject Matter Experts are some of the hardest working people on the planet — especially when it comes to system implementation projects. SMEs have a ton of work to do and generally keep their heads down until all work is done — defining requirements, documenting processes, testing, collaborating on training content, and training end-users. Clients will often ask what I see as the biggest risk or roadblock to end-user readiness. My answer is almost always SME availability; we simply cannot do our jobs without them. Here are some ideas for taking care of your SMEs. Use the functional designs, to-be process diagrams, and test scripts to take a stab at learning objectives, an outline, and draft content before you meet with your SMEs. Set up a Web-based content collaboration site (wikis work great for this). Start a page for each learning topic and add draft learning objectives and content. The SME can then visit the site when they have time and do a structured brain-dump. Find out which meetings your SMEs are attending and get invited those that will likely provide valuable content. That way you learn as your SMEs learn. Provide SMEs with opportunities to report their readiness. Consider using a SME Readiness Assessment to gauge SME readiness and availability to do their job. Then make course corrections, as needed. Give tokens of appreciation; listen for clues so you can give meaningful “gifts.&# One colleague had chocolate covered bacon delivered to her SME based on stories they shared about local food oddities and legends. “The decision to actually send the bacon came when, as we were saying good-bye, Tom [SMEs boss] said, “You guys have got to send Dave — who has a reputation for eating anything, including a doughnut that had been in the company freezer for a year — some of that chocolate covered bacon.” It was a simple, inexpensive gesture that, even if Tom was joking, appeared as an easy win – real low hanging fruit. If the client expresses a wish and you can grant it that easily, why not show that you’ve been listening?&# Check out these posts for more tips and tricks: What Everyone Should Know about Working with Subject Matter Experts by Tom Kuhlmann, Rapid E-Learning Blog and Working with Subject Matter Experts posted in The Learning Circuits Blog. Blog this! Bookmark on Delicious Digg this post Recommend on Facebook Buzz it up Share on Linkedin share via Reddit Share with Stumblers Tweet about it Subscribe to the comments on this post Print for later Bookmark in Browser Tell a friend Tags: project management , subject matter experts , surveys , system implementation training About Jolene One of my favorite things to do is save the day. Im a problem-solver and thoroughly enjoy helping clients succeed and look good. Ive been creating training and e-Learning programs for over 20 years, serving as an instructional designer, writer, developer, and project manager. I am currently the Director of Instructional Design and eLearning for Dashe & Thomson.In my spare time I read, play with my kiddos, and train with the Dashe & Thomson running team. View all posts by Jolene → ← Work as Improv Theater: Teaching the Right-Brained Learner The Freemium Three: Three Free Tools That Will Work Wonders For Your Next Training Project. → Download Free Whitepaper The Top 10 Pitfalls of End User Training – and How to Avoid Them Given the current state of the economy, businesses large and small are looking for ways to improve productivity while maintaining quality. Download the whitepaper » Blog this! Bookmark on Delicious Digg this post Recommend on Facebook Buzz it up Share on Linkedin share via Reddit Share with Stumblers Tweet about it Subscribe to the comments on this post Print for later Bookmark in Browser Tell a friend No comments yet. Leave a Reply Click here to cancel reply. Search the blog Popular Latest Comments Tags Web-Based, Instructor-Led, EPSS? Train Your Client On Training January 31, 2011 Leveraging the Law of the Few to Manage Change in the Workplace February 21, 2011 Analyzing the ROI of Social Media in Training May 3, 2011 Why eLearning Development Ratios Can be Hazardous to Your Career November 15, 2010 eLearning Review: A Module for the National Security Arena October 15, 2010 Virtual Boot-Camp: Games and Learning with the U.S. Military May 19, 2011 Give User Adoption the Respect it Deserves May 17, 2011 How Social Networks Can Harness the Power of Weak Ties May 11, 2011 Addressing On-Demand Learning and Performance Needs #LCBQ May 9, 2011 Why Companies Should Spend More on Social Learning May 5, 2011 Gregg Sean: Nice review of the topic , I was seeking to see wh. Rob Mueller: Great post on using games as a training device. Pe. Jim: Glad you enjoyed the post, Liam! It is amazing ho. Liam McCoy: Thanks for this. Ive been looking for some ammo t. Jim: Glad you found the post helpful, Jeff! Properly d. blended learning budgeting Classroom Learning classroom training customer service Donald Kirkpatrick elearning ERP Training Facebook Facilitation feedback ILT Informal Learning innovation instructional design instructor-led training interactive learning Jane Bozarth JIT learning Kanye West LinkedIn LMS marketing MNISPI mobile learning peer-to-peer learning performance support project management Robert Brinkerhoff sales social learning social learning theory social media subject matter experts Success Case Method surveys synchronous system implementation training temporary staffing Training Development Twitter video web-based training Wikis youtube Email Alerts Follow Us! Tweets Follow @dashethomson on Twitter Download Free Whitepaper The Top 10 Pitfalls of End User Training – and How to Avoid Them Given the current state of the economy, businesses large and small are looking for ways to improve productivity while maintaining quality. Download the whitepaper » Blog this! Bookmark on Delicious Digg this post Recommend on Facebook Buzz it up Share on Linkedin share via Reddit Share with Stumblers Tweet about it Subscribe to the comments on this post Print for later Bookmark in Browser Tell a friend Other Learning Blogs Andrew McAfee’s Blog The Rapid eLearning Blog Big Dog, Little Dog Bozarthzone Discovery Through eLearning E-learning Curve Blog eLearning Roadtrip The Learning Generalist ID and Other Reflections The eLearning Coach Harold Jarche: Life in Perpetual Beta Weejee Learning Making Change: Ideas for Lively eLearning Corporate eLearning Strategies and Development eLearning Technology The Learning Circuits Blog Cammy Bean’s Learning Visions Kapp Notes Internet Time Blog Will at Work Learning eLearning Learning Dave’s Whiteboard Communication Nation Categories blended learning (7) budgeting (2) Classroom Learning (8) customer service (3) Development Tools (4) EHR Training (1) eLearning (13) ERP Training (2) Facilitation (2) feedback (2) Gaming Theory (2) Informal Learning (15) Innovation (1) Instructional Design (10) Leadership (1) LMS (Learning Management System) (3) marketing (2) mobile learning (3) Organizational Change Management (2) performance support (8) Project Management/Project Delivery (6) Reviews (2) sales (3) social learning (27) Social Media (1) subject matter experts (3) system implementation training (3) Temporary staffing (1) Training Development (9) user adoption (1) Video (5) Wikis (3) Archives May 2011 (6) April 2011 (12) March 2011 (13) February 2011 (7) January 2011 (9) December 2010 (7) November 2010 (2) October 2010 (1) September 2010 (1) February 2010 (1) © 2011 Social Learning Blog. All Rights Reserved. Visit us at dashe.com

The Return of the (Digital) Native | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS The Return of the (Digital) Native by Jim on March 25, 2011 in mobile learning In recent years, we’ve all heard a lot about digital natives.

The Temporary Staffing Revolution | Social Learning Blog

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS The Temporary Staffing Revolution by Paul on December 28, 2010 in Temporary staffing A few weeks ago, I grabbed coffee with a long-time family friend that happens to be a training developer.

Addressing On-Demand Learning and Performance Needs #LCBQ | Social.

Dashe & Thomson

In more recent years, websites, wikis and blogs have entered the picture, creating social learning platforms that learners can modify themselves.

What Can March Madness Teach Us About Blended Learning? | Social.

Dashe & Thomson

Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS What Can March Madness Teach Us About Blended Learning?

Teach 166

What’s the ROI on Disengaged Employees?

Dashe & Thomson

From Kirkpatrick’s Four Levels of Evaluation, to Michael Scriven to Jack Phillips [.] appeared first on Social Learning Blog. social learning evaluation millenials ROI social media social technologyTraining evaluation appears to be the Holy Grail of the L&D world. It’s one of the hottest topics in the blogosphere and at conferences (see Barbara Camm’s highly trafficked posts on evaluation), and yet it remains extremely elusive.

ROI 152