The unscience of evaluation

E-Learning Provocateur

Evaluation is notoriously under done in the corporate sector. I’m not suggesting that evaluation is never done. However, a secondary concern I have with evaluation goes beyond the question of quantity: it’s a matter of quality. Evaluation by design.

The unscience of evaluation

E-Learning Provocateur

Evaluation is notoriously under done in the corporate sector. I’m not suggesting that evaluation is never done. However, a secondary concern I have with evaluation goes beyond the question of quantity: it’s a matter of quality. Evaluation by design.

Learning Analytics: Advanced Evaluation Complexity


Advanced Evaluation is less common than Data Evaluation , which means there’s no well-worn path leading the way. What is Advanced Evaluation? In other words, advanced evaluation asks: Why is this happening? Advanced Evaluation & Analysis Types.

Program Evaluation: A Process for Learning

The Performance Improvement Blog

I was recently asked, “What is your view of program evaluation? At the risk of over-simplifying these two approaches to knowing, I would say that the purpose of evaluation is to improve programs, services, and organizations and to be accountable for results.

Good Evaluation Facilitates Learning

The Performance Improvement Blog

Evaluation of programs (e.g., training, coaching) and organizations has more to do with facilitating learning than it does with statistics. Good evaluation requires good facilitators. Kylie Hutchinson writes about this issue in her post on the American Evaluation Association blog, AEA365. Tags: Evaluation Leadership Teamwork Training Impact AEA365 coaching evaluation facilitation facilitator Kylie Hutchinson leadership training

8 Online Training Evaluation Techniques


In this article, we’ll highlight the 8 top online training evaluation techniques. 8 Methods For Online Training Evaluation. Online training evaluation is crucial for corporate eLearning. Here are the 8 most effective methods to evaluate your online training program: 1.

How Effective are Video-Based Training Courses?


While it’s good that employers provide training for their employees, it doesn’t mean that training is always effective. It’s amazing how the same exact training content is more effective delivered through one method as opposed to another. These statistics speak for themselves.

Metrics for Measuring Training Effectiveness


Companies and organizations want to supply the most effective training to provide a measurable return on investment. The tried-and-true Kirkpatrick evaluation method was developed in the 1950’s by University of Wisconsin professor Donald Kirkpatrick.

Measuring The Effectiveness of Your Blended Learning Program

Obsidian Learning

We should consider how to measure the effectiveness of that investment. You are likely familiar with Kirkpatrick’s model 1 of the 4 levels of evaluation: The higher you go up the levels, the more time and resources required, but the better the information you obtain.

It’s Time To Evaluate Your Onboarding Process

Bluewater Learning

It’s tempting to just do what we’ve always done, but the statistics on onboarding illustrate how critical it is to get it right. It’s important you consider evaluating your onboarding process to make sure it’s driving retention and not encouraging desertion. When we think of gamification it’s often done digitally, but it doesn’t have to be digital to be effective. The post It’s Time To Evaluate Your Onboarding Process appeared first on Bluewater Learning, Inc.

Do You Know Whether Your eLearning is Effective?


Two questions any eLearning designer should ask when designing a course are, “How will I know if this eLearning course is effective and how will I define effective?” A surgeon wants to know whether a procedure is effective. Effective eLearning is not always so clear.

Effective Learning – Musings from the UnConference

Learning Cafe

This blog post is a summary of the “ Effective Learning ” stream of the Learning Cafe UnConference which was led by Bob Spence. Evaluation and Measurement – Bob Spence. It was agreed this could be achieved by evaluating at the 3rd level (Application).

Effective Training Visuals—Abstract to Concrete


We’re back with the fourth in a series of blog posts written to help you evaluate elearning courses by considering how well their visuals add to the effectiveness of the training.

How Effective is Your Training? Focus on Measurements that Matter


Why waste everyone’s time with quizzes that only measure your sales team’s memorization of statistics or processes that don’t impact their ability to convert leads into sales? If there’s a real value in quizzing your trainees, try to maximize quiz effectiveness by crafting questions around skills that support behaviors, i.e. specific, measurable, actionable, achievable, and observable. Looking for more practical tips on evaluation and measurement?

Quiz 76

50 Years of the Kirkpatrick Model

Upside Learning

In the fifty years since, his thoughts (Reaction, Learning, Behavior, and Results) have gone on to evolve into the legendary Kirkpatrick’s Four Level Evaluation Model and become the basis on which learning & development departments can show the value of training to the business.

Specifying a Criterion in Performance Objectives

Integrated Learnings

In the grand scheme of things, those behaviors impact key performance indicators, which we can assess as part of evaluating training’s effectiveness…but I still have some behaviors not clearly associated with a statistic. Though not associated with a particular statistic, one can observe whether the learner was able to identify the cancellation reason as a result of asking the right questions. Evaluation eLearning ObjectivesBy Shelley A. Gable.

Correlation Without Causation

The Performance Improvement Blog

Gun shows have no effect on crime. Evaluation Leadership Training Impact Christopher Chabris Daniel Simons illusion of cause Invisible Gorilla Kevin Lewis Michael BrooksOrganizational leaders often misinterpret social science data.

Baseball and your Learning Organization


Statistics are not just limited to the baseball field. Statistics are powerful. We are living in the golden age of reporting, where statistics are feeling less like math and more like real world functionalities that are understandable and accessible.

Learning Measurement: Don’t Over Promise and Under Deliver!


These are very different statements the latter is much harder to argue without significant statistical data. Unless you do the statistical analysis or a deep ROI Impact Study, talk about the correlation you have to the data. ‘We can prove the learning impacted results!’

Training Stats Don’t Mean SQUAT Without This


Measuring training effectiveness is a necessary component of any training implementation, but there is one things that absolutely cannot be forgotten if you plan on reporting metrics on your training initiative. So how do you capture baseline statistics?

The Learning Styles Zombie

Clark Quinn

They did a meta-analysis of the research out there, and concluded this with statistical rigor. Not with psychometric validity (that means tests that stand up to statistical analysis). It’s June, and June is Learning Styles month for the Debunker’s Club.

Evidence or Proof of L&D Impact? Why Not Both?


This is where you assemble significant amounts of data, run statistical models like regression analysis to show a link between the learning program and the business outcome. This is where you leverage your ongoing evaluation process to make measuring impact more meaningful.

The Future of Enterprise Mobile Learning [INFOGRAPHIC]


It will also give you the opportunity to evaluate the effectiveness in your organization before “mobilizing” more complex subjects. Recently there has been a huge emphasis of elearning, and mobile learning, within education – and for good reason.

Why is Social Learning the new Watercooler?


Social numbers and statistics. In fact, social learning is one of the most effective and efficient ways to unlock and spread knowledge across an organization. What are the new approaches your company is evaluating or deploying in the training environment?

Reporting on talent management


That’s why the people at the Centre for Talent Reporting decided to come up with a logical model that could provide a good common denominator when it came to the evaluation of a reporting on various talent management programs.

Simple Ways to Deal with 9 Common Work Problems

Your Training Edge

Effective communication is a key to an organization’s success and vital to operating efficiently. Today’s organizations are faced with various types of problems regarding their employees.

Selling Storytelling in Learning

Experiencing eLearning

How are you measuring the effectiveness of this training?” ” “And how have the results been from that evaluation?” Let’s go back to the topic of evaluation. I got a call from a prospective client looking to hire an instructional designer.

16 Metrics of Healthy Customer Service-Oriented Businesses: Part Two


Last week, we published a blog that highlighted five metrics that leaders in QSR operations should reference when evaluating their business operations and employee performance. In today’s blog, we describe six metrics that can be used to evaluate the health of a business, specifically those in the hotel and hospitality segment. years in 2014, employees in this sector move onto other jobs more frequently than other industries, according to the Bureau of Labor Statistics.

The MMO-LMS: The close association of Games and Learning


Player usage statistics for EVE Online (2013-14). We need to adopt the “most effective” aspects of MMOGs and apply them to the core learning environment. The learner starts his or her journey with the basic courses, explores a few specialized ones and evaluates their potential.

Creating Multiple-Choice Questions: The Dos and Don’ts


Remember, a multiple-choice test is made to assess the ability of individuals to measure their performance within the field and not to evaluate what they have digested over the course of past years. The results will be improved performance and better statistics because of a skilled performer.

5 Steps to Successful Product Training Onboarding for Sales Reps


To avoid being a part of this statistic, it is important to establish an effective onboarding training program. Having an effective onboarding process in place is critical in giving your new hires the best start possible in their new roles.

How Docebo LMS is Compliant With GDPR


Non-compliance comes with a big price tag, so it’s in your best interest to partner with an LMS provider that makes GDPR compliance easy and effective. Process for regularly testing, assessing and evaluating the effectiveness of TOMs. GDPR is coming!

Docebo 130

How to Increase Your Employees’ Productivity

Your Training Edge

Contrary to how this may seem, this machine-like routine is far from beneficial for our productivity, as it in fact has a detrimental effect on our focus, motivation, and ability to solve problems efficiently.

Getting Started With Learning Data and Analytics

CLO Magazine

Metrics can have the effect of gamifying your job and instilling a motivation and passion in your team. Evaluation : Once we have data, we can begin to evaluate it to understand whether it means something good or bad.

The (Not So) Curious case of Corporate eLearning


Reduced Training Costs – Studies show that online trainings are generally more cost effective than the traditional training media. Go ahead and evaluate some of them. It can help you re-design trainings effectively.