Kirkpatrick Revisited | Social Learning Blog
APRIL 17, 2011
I have included Kirkpatrick’s Four Levels of Evaluation in every proposal I have ever written, and I wanted to hear from Kirkpatrick himself regarding his take on the current state of evaluation and whether his four levels are still viable.
Vale Don Kirkpatrick
MAY 28, 2014
Last week, Don Kirkpatrick passed away. The numbers have been documented (from a presentation with results from the ASTD Benchmarking Forum) as dropping in implementation from 94% doing level 1, 34% doing level 2, 13% doing level 3, and 3% doing level 4. Kirkpatrick rode this tool for the rest of his career, created a family business in it, and he wasn’t shy about suggesting that you buy a book to learn about it.
A tribute to Dr Donald Kirkpatrick, pioneer and veteran of Instructional Design
MAY 20, 2014
Dr. Donald Kirkpatrick is one of those few people that have achieved eternity by virtue of their contribution. A professor emeritus at University of Wisconsin and the creator of the Kirkpatrick Four-level Evaluation Model , Dr. Kirkpatrick passed away on May 9, 2014 at the age of 90.
Discussing the ASTD Handbook, eLearning, and Published Expertise with Elaine Biech
AUGUST 4, 2014
When my copy of the second edition ASTD Handbook arrived at the office this summer, I immediately felt the urge to explore my new resource and see what content made the final cut for an important industry asset. The ASTD Handbook does just that. The ASTD Handbook does this. .
Don Kirkpatrick’s Contribution to Learning & Development
MARCH 1, 2011
By 1959, editors for the predecessor of ASTD’s T&D magazine had heard of his approach and asked him to write an article. I just saw an announcement that Don will retire from the speaking circuit this year. Few people have single-handedly made such an impact on our profession. I have known Don for years and his story is very interesting. Don got his start in learning when he was working on his Ph.D.
Looking Forward to Busy Time at ASTD 2014
MAY 2, 2014
Looking forward to this year’s ASTD ICE conference in Washington, DC. Hoping to show them the highlights of the conference and all the wonderful events at ASTD this year. 1:15 pm – 2:00 pm: Join me for a great panel discussion with Ruth Clark and James Kirkpatrick.
Re-evaluating Evaluation | Social Learning Blog
MARCH 15, 2011
And as time has gone by, I have started to wonder about the validity of Kirkpatrick in today’s world. The title was “Expanding ROI in Training Programs Using Scriven, Kirkpatrick, and Brinkerhoff,” which sounds pretty academic.
What's the problem with Kirkpatrick?
Clive on Learning
APRIL 21, 2008
While acknowledging that Kirkpatrick's four levels of evaluation had proved valuable over more than thirty years in helping to measure instructor-led, content-based 'training' interventions, Sloman felt that a new approach was necessary to support a more self-directed, work-based 'learning' process. It's worth checking first of all whether Kirkpatrick's model is still useful for evaluating the top-down stuff. So does Kirkpatrick's model apply as well in a learner-centred context?
Become a Strategic Partner Through Effective Training Evaluation #ASTD2014 @Jim_Kirkpatrick
MAY 7, 2014
These are my live blogged notes from a concurrent session (W104) at the ASTD International Conference & Expo, this week in Washington, D.C. James Kirkpatrick, Senior Consultant Kirkpatrick Partners Sometimes we have to do the politically incorrect thing.
50 Years of the Kirkpatrick Model
AUGUST 31, 2009
In the fifty years since, his thoughts (Reaction, Learning, Behavior, and Results) have gone on to evolve into the legendary Kirkpatrick’s Four Level Evaluation Model and become the basis on which learning & development departments can show the value of training to the business.
The Power of Simplicity
JUNE 6, 2011
Don Kirkpatrick gave his farewell presentation on the four levels at ASTD’s annual International Conference & Exposition in Orlando last week. His work, popularized by his four-part series in the monthly ASTD magazine in 1959-1960, provided that measurement framework for the profession. The Business Of Learning Kirkpatrick scorecards
Stop Evaluating Training!
MAY 2, 2013
Kirkpatrick’s evaluation model has long been the holy grail of training effectiveness measurement to businesses. ASTD ICE 2013 | May 19 – 22 | Dallas, TX, USA | Stand #839. "So how do you evaluate the success of eLearning that you create?"
Measuring And Evaluating Learning – The Top Skill For L&D Teams
DECEMBER 13, 2011
Recent research by ASTD and REED Learning reveals that measuring and evaluating learning is the top-most skill L&D teams are looking for. Even though it is a challenge to prove training/learning’s effect beyond Kirkpatrick’s level 1 & 2 -senior management continues to ask for numbers so here we are – the L&D folks want that skill the most.
Why We Should Stop Talking About ROI in Training
APRIL 4, 2012
Many people look at Don Kirkpatrick ’s work from as early as 1959 as the beginning of ROI in learning and development. It was in his early work that Kirkpatrick developed his four-level model: Level 1: Reaction. In concept, Kirkpatrick’s levels seem valuable.
Recent Research Review -- Reviewed (and Lamented)
Will at Work Learning
AUGUST 7, 2014
The Kirkpatrick framework has a number of theoretical and practical shortcomings…” (p. I''ll be speaking on this in an upcoming ASTD webinar. . Basing Our Evaluations on the Kirkpatrick 4 Levels is Insufficient!!! .
How Can Infographics Produce Better E-Learning Courses?
MARCH 27, 2012
Understanding Kirkpatrick’s 4 Levels of Evaluation. April 10 : Jacksonville, FL ( NEFL ASTD ). April 17 : Virginia ( SEVA ASTD ). July: Knoxville, TN ( Smoky Mountain ASTD ). August: Houston, TX ( ASTD Houston ). October 17 : Bloomington, IL ( CIC-ASTD ).
ROI and Metrics in eLearning
OCTOBER 16, 2007
Kirkpatrick's Level 3: Improving the Evaluation of E-Learning Level 3 evaluations measure whether the there was an actual transfer of learning to the actual work setting. The way to demonstrate that is by doing Kirkpatrick Level 3 (measuring the extent ROI of E-Learning: Closing In When it comes to e-learning, computing ROI suddenly becomes a complicated procedure requiring thoughtful chinstroking, serious seminar time, and earnest input from consultants and vendors.
The Only Person Who Behaves Sensibly Is My Tailor
Performance Learning Productivity
NOVEMBER 24, 2014
ATD has been producing this annual report for years (originally as the ASTD). Brinkerhoff’s Success Case Method addresses systems impact rather than trying to isolate the impact of learning individually as the more simplistic Kirkpatrick approach attempts.
Tony Bingham #ASTDL20 keynote
APRIL 29, 2011
Today I’m at ASTD’s New England Regional Conference: Learning 2.0 These are my live blogged notes from the opening keynote with Tony Bingham, CEO and President of ASTD. CEOs don’t care about Kirkpatrick level 1, 2, 3. Don’t get left behind in lovely Westford, MA. Conference Board research from 2009: CEO challenges “how do we stay afloat?”
Allison Rosset Guest Post: Evaluation—Words Into Action?
The Learning Circuits
MAY 7, 2012
We speak fluent Kirkpatrick. An ASTD benchmarking study looked at course evaluations by Kirkpatrick level. ASTD’s own studies of practice, and others, show steady increases in the use of technology for learning and performance. This is one of those topics that never goes away. It reigns supreme in just about every needs study for workplace learning professionals. We say we want to do more and know more.
Why Corporate Training is Broken And How to Fix It
JULY 17, 2012
Don Kirkpatrick proposed a model for measuring the outcomes of training. The American Society for Training and Development (ASTD) reports that companies spend $1,067 per employee (2.7% None of this activity shows up in ASTD’s and other trade organizations’ statistics.
How Big Data Will Reshape eLearning — and the Future of Work
FEBRUARY 21, 2012
This isn’t the traditional, Kirkpatrick -style learning data most people think about, like post-workshop evaluations and test scores. David Kelly is the director of training at Carver Federal Savings Bank and ember of the ASTD National Advisors for Chapters.
Cammy Beans Learning Visions: Beginning Instructional Designers Toolkit
MAY 1, 2007
My list begins as such: Important Theories and Terms: Gagnes 9 Events Kirkpatrick Levels ADDIE Cognitive Load Theory ARCS (John Keller) Books: Ruth Clark: e-Learning and the Science of Instruction Malcom S. About Kilpatrick Levels : do you mean Kirkpatrick levels ? Reflecting on #ASTD10 Recommended: "In Defense of the LMS" Chicago Bound: Kineo at ASTD ICE #astd10 One Year on at Kineo #yam Now that’s an Enterprise Moodle! -- Kineo Moodle f.
Accelerated Learning: Where Does It Fit In? | Social Learning Blog
MARCH 27, 2011
Organizations such as PACT, ASTD, MNISPI, and the Digital Learning Forum get my creative juices going to generate new ideas and synergies. Social Learning Blog Training and Performance Improvement in the Real World Home About Bios Subscribe to RSS Accelerated Learning: Where Does It Fit In?
Top 70 eLearning Posts for June and Hot Topics including iPad and Mobile Learning
eLearning Learning Posts
JULY 7, 2010
Evaluating Non-Formal Learning in the Context of Kirkpatrick’s Four-Level Model - The E-Learning Curve , June 7, 2010 The Four-Level Model is incompatible with the assessment of non-formal learning. Evaluating Non-Formal Learning in the Context of Kirkpatrick’s Four-Level Model is a post from: E-Learning Curve Blog. You might get ideas from this recording of a webinar that I gave today for the Baton Rouge ASTD. Best of eLearning Learning. June 2010.
Brain and Memory with Arthur Kohn #astdtk13
JANUARY 31, 2013
I'm at the ASTD Tech Knowledge 2013 Conference kicking off today January 29, 2013 in San Jose, California. so here's the return on investments, here's your Kirkpatrick.). These are my liveblogged notes from a concurrent session with Arthur Kohn. Apologies for typos and incoherence. Brain and Memory: Seven Tips that Improve E-Learning. Arthur Kohn, PhD. Fulbright Professor of Cognitive Science. He starts us off with a memory test.
Hot List - Second Half of January
FEBRUARY 4, 2009
As I was at ASTD last week, I missed doing my Hot List for the week. Alternatives to Kirkpatrick Wiki as repository for a virtual community Wikipedia - tightening editing Remote Collaboration the Horizon report 2009 from Educause Items HP Learning Center - free online software, business, marketing and IT classes for small and medium business Keywords Social Media Work Skills Twitter Photoshop Captivate Adobe Google Articulate eBook Tools Demo ASTD TechKnowledge Notes on the list.
Better Discussion / Debate in Learning
SEPTEMBER 6, 2006
In particular, he laments that as he was reading a discussion in a different domain and "working on the team picking out sessions for the 2007 ASTD conference " he found himself wanting to have better discussion and debate in our world of learning. Actually, I think that maybe FOO Camp and Bar Camp aren't quite the right format, but having the kind of dialog that occurs at unconferences is definitely needed at corporate learning conferences, e.g., ASTD, Training, etc. Kirkpatrick?
Cammy Beans Learning Visions: Youre So Immature: e-Learning in Some Organizations
OCTOBER 5, 2007
He was venting about Kirkpatrick evaluations. Reflecting on #ASTD10 Recommended: "In Defense of the LMS" Chicago Bound: Kineo at ASTD ICE #astd10 One Year on at Kineo #yam Now that’s an Enterprise Moodle! -- Kineo Moodle f. ASTD Keynote: “People Lie Richard Hilleman Electr. Cammy Beans Learning Visions Musings on eLearning, instructional design and other training stuff.
NOVEMBER 18, 2009
Plug for ASTD - CPLP Certification includes all of these areas of expertise. Asif: Kirkpatrick talks about 'ROE -- return on expectations'. Clark Quinn and I led a discussion on Reinventing Organizational Learning at LearnTrends this morning.