Malicious metrics

Clark Quinn

Ultimately that initial model built by the questions would get refined by learner behavior in the system (and we also intended a suite of interventions ‘layered’ on top that would help improve learner characteristics that were malleable). Like others, I have been seduced by the “what X are you” quizzes on FaceBook. I certainly understand why they’re compelling, but I’ve begun to worry about just why they’re so prevalent.

What Are Your Training Metrics Actually Measuring?

Your Training Edge

Much has been written on the subject and many experts have weighed in on what they consider to be the most crucial training metrics ( here are my top 10 ). Still others have argued for separating behavior metrics from performance metrics, and other modifications.

When Bad Metrics Happen in Good Companies: 3 Examples of Flawed Metrics

Coreaxis

Here are a few examples of companies with flawed performance metrics. This is an instance of a counterproductive metric: the organization’s own goals (providing excellent patient care) cannot be met because of the new requirements. Rankings that Reinforce Bad Behaviors. Given that his manager’s own rating hinges on the performance of her staff, it looks like Tobias will be getting away with it until the metrics are revised. Flawed Metrics

How to Use Training Metrics to Measure eLearning Effectiveness

eFront

But it’s not all doom and gloom because training metrics can help you catch those nasty issues before they’re repeated, and improve the value of your training efforts. Know Your Metrics From Your KPIs. This is why KPIs are often used to implement metrics.

From Sales Enablement to Sales Performance: Moving the Needle on the Metrics That Matter

Speaker: Mike Kunkle, Vice President, Sales Transformation Services, Fast Lane Digital

What’s missing is a clear focus on driving measurable improvement in sales performance and the expertise required to truly move the needle on the metrics that matter. How to perpetuate success with systems thinking, including the 5 Stages of Sales Mastery & Behavior Change.

Get Actionable Learning + Performance Data into Managers’ Hands with Axonify Team Metrics + Compare

Axonify

L&D must evolve its measurement practices beyond traditional metrics like completions, training hours, quiz scores and satisfaction. Rather than emailing around difficult-to-decipher spreadsheets weeks or months after a training event, L&D must provide real-time insights into employee knowledge gaps, behavior challenges and compliance issues. Today we’re taking this idea a step further with our newest insight capabilities— Axonify Team Metrics and Compare.

Get Actionable Learning + Performance Data into Managers’ Hands with Axonify Team Metrics + Compare

Axonify

L&D must evolve its measurement practices beyond traditional metrics like completions, training hours, quiz scores and satisfaction. Rather than emailing around difficult-to-decipher spreadsheets weeks or months after a training event, L&D must provide real-time insights into employee knowledge gaps, behavior challenges and compliance issues. Today we’re taking this idea a step further with our newest insight capabilities— Axonify Team Metrics and Compare.

Metrics that Matter - Thoughts from a West Texas Road Trip

The Learning Dispatch

The dashboard computer for the vehicle supplied a mind boggling number of metrics including arrival time at destination, trip mileage, miles to empty, average miles per gallon, instantaneous miles per gallon, etc. Recently, my wife and I rented a minivan for a family trip to Taos, NM.

Training Strategy for Changing Behavior

LearnDash

If you need to change the current behavior of an organization through education on new policies and practices, then you need to have a proven training strategy. Throughout all of the steps you should be collecting metrics.

Measuring Leadership Effectiveness

Your Training Edge

From the subjective, you can move into numbers-based metrics. You can look at the metrics that are used to determine the health of the organization and make a link back to leadership, especially on those metrics that are not linked to pay or bonuses.

What Gets Measured Gets Done.Revisited

The Peformance Improvement

An organization has to do something with those metrics in order to “get done” what needs to get done, i.e., organizational learning, performance improvement, and change. Evaluation Management evaluation manage measure metrics Terry Starbucker

How Employee Performance determines the Success of Your Training Program

eFront

The evaluation process usually involves both the manager and staff in scrutinizing and justifying employee performance metrics together. These levels are reactionary feedback, learning checks, observation of behavioral changes, and produced results.

Why We Should Stop Talking About ROI in Training

Mindflash

Level 3: Behavior. Another model and methodology from Jack Phillips includes a fifth level – ROI – which adds an added financial metric to the mix. Behavior and Results? In many cases they are not being tracked, and when they are, we’re too focused on the metric itself.

ROI 72

Measuring Success (ROI) of a Training MOOC, Part 1

Your Training Edge

The first metric to be considered was the number of students completing the courses with passing grades (usually defined as 70 percent or better). Depending how you look at it, this metric leads to either an excellent or a terrible conclusion. Behavior – How well the new knowledge, skills, and attitudes are applied on the job. Second, decide how each metric will be determined. As much as possible, tie each metric to a specific number or dollar value.

ROI 109

The Happy Bottom Line

Jay Cross

Psychologist Daniel Kahneman won the Nobel Prize in Economics for inventing Behavioral Economics. Metrics of organizational learning Psychology Well-beingCLO , October 2012. When I was 5 years old my mother always told me that happiness was the key to life.

Learning Data: The real definition and how you can prove business impact

Axonify

If you’re like most learning organizations, you’re currently tracking metrics such as: Online course completions. Does this data show that employees changed their behavior on the job based on your training? Behavior change takes time, and most training programs have set start and completion dates. To really understand how your learning strategy is impacting your employees and your business, you have to expand your data scope to include modern learning metrics.

Reputation in Social Learning Technologies

CLO Magazine

Best known for uses on the Web, these systems collect, distribute and aggregate behaviors of those who operate somewhat anonymously. There are other systems that do not explicitly evaluate a contributor or content, but rather implicitly evaluate past behaviors and contributions to assess the likelihood of current content being trustworthy. Social Workforce learning metrics and measurement reputation social learning social workforce

Koreen Pagano #DevLearn: The 80:20 Rule of Data Analysis

Learning Visions

Metrics that don''t matter.learning orgs spend a energy tracking metrics that don''t matter: time spent, courses completed, passing scores, # attempts.these metrics show the costs of the training, but not of the value. This isn''t data about whether they learned anything or changed behavior. For most orgs, the metrics that matter: are we fast, cheap, good? And how do you capture data and metrics that matter? Performance metrics and not learning metrics.

Intangibles matter

Jay Cross

Cross then goes on to make the point about the way outcomes are measured; “First, the metrics that people have been using for the past 30 years— using accounting measures—are totally ridiculous. The proof is not to look at the learning, but instead to look at the changes in behavior that come about as a result of the learning.”. Tags: Metrics of organizational learning Leadership, Intangibles, and Talent Review.

Stock 36

Conducting Post-Course Evaluations

CourseArc

Level 3: How did the learners ’ behavior change after attending training? To measure behavior changes, the learner’s baseline behavior must be compared to the behavior after the training. Determining the metrics of success before course development is the first step.

How to Measure Online Course Effectiveness

CourseArc

Every course or training initiative has at least one of two goals: to bridge knowledge gaps , and/or to transform the learner’s behavior. LEVEL 3: Behavior. Have supervisors, colleagues, and co-workers seen positive behavioral adjustments? to reward behavioral change.

Corporate Training: It’s time to enter a new frontier

Axonify

So, while other business functions have become metrics focused—attributing every dollar spent to whether it achieved an objective—corporate learning has been left out of the equation. After all, with typical, one-and-done training metrics like session durations, completion rates and grades used in a classroom or in an LMS (Learning Management System), it’s impossible to do much (other than prove training occurred).

Looking Within: How To Gather And Analyze Actionable Learning Insights

TalentLMS

Learning insights are often referred to by other names, like learning analytics, or learning metrics. While the changes in learner behavior that training aims to achieve can be pretty hard to measure, online learning insights can prove the effectiveness of your training in other ways.

Train Where it Counts: Turn Work Into Your Main Learning Engine

Pract.us

Use work experience to train the key behaviors for high performance. Shifting the focus from general competency to specific work behaviors and shifting the environment from the classroom to the field will tie learning closer to business results. Shift learning goals to key behaviors.

Measuring Training Program ROI

LearnDash

Facilitate Behavioral Change. The only way for a learning program to be successful is if it can result in genuine behavioral change. Associating these metrics to key business outcomes allows you to better measure the true impact of a training.

ROI 147

4 Ways to Supercharge Your Sales Managers

Knowledge Guru

Never mind the fact that sales managers must monitor goals and metrics, help reps hit targets, manage deadlines, and make sure reps are following the proper sales process. The CRM is full of it and it can be hard to find the most meaningful metrics.

Sales 130

How to Impress the CEO with Your Training Program

Pract.us

If you want to impress your CEO with your training programs, position L&D as a catalyst for creating the employee behaviors that drive business progress. Key metrics that represent those goals. Find the activities and behaviors that impact those goals.

Five Ways to Decrease Learning Decay in the Workplace

CLO Magazine

Requiring this form of application allows participants to leave with an action plan, which is a great start to thinking about adopting new behaviors right away. This puts the responsibility on the manager to know what has been taught, as well as what new behaviors are intended.

A Strong L&D Strategy is Based on Setting Goals and Measuring Success

Inkling

To make your L&D strategy the best that it can be, develop your content with specific goals in mind, and set metrics to measure progress toward those goals. Measure the metrics that you need. To get an accurate idea of the ROI you’re realizing from training materials, try measuring metrics such as: Engagement. Are your employees demonstrating a change in their behaviors as a result of the training?

Leadership Analytics

Your Training Edge

First, behavioral profiling is an excellent analytical tool. There are two ways to approach behavioral analytics for leaders. First, you can identify behavioral characteristics of well-known leaders, either in the world at large or within the organization itself.

Measuring Leadership Effectiveness

Your Training Edge

From the subjective, you can move into numbers-based metrics. You can look at the metrics that are used to determine the health of the organization and make a link back to leadership, especially on those metrics that are not linked to pay or bonuses.

Big Data: The Holy Grail for L&D?

Axonify

But, up until now, one of L&D’s biggest challenges has been to identify and capture metrics that clearly align learning with bottom-line business impact. But, for it to be truly valuable, learning metrics must first be clearly aligned to business performance.

How do you measure microlearning?

Axonify

If you hope to achieve level 3 (behavior), you have to ask managers or trainers to schedule extra time for observations at specific intervals after the training event. This is why so many L&D heads rest their reputations on weak metrics, like participation satisfaction (we got a 4.6 You can then use behavior observation to determine if knowledge has transferred onto the job. To change their behavior, employees must have foundational knowledge on the topic.

Getting what you need from your learning assessments?

CD2 Learning

Assessments are powerful tools for increasing employee engagement and behavior change. Does it provide comprehensive and just-in-time assessment metrics/analytics through standard or customized reporting at various organizational levels?

Is Big Data a Game-Changer for L&D?

Axonify

But, up until now, one of L&D’s biggest challenges has been to identify and capture metrics that clearly align learning with bottom-line business impact. But, for it to be truly valuable, learning metrics must first be clearly aligned to business performance.

Leadership Analytics

Your Training Edge

First, behavioral profiling is an excellent analytical tool. There are two ways to approach behavioral analytics for leaders. First, you can identify behavioral characteristics of well-known leaders, either in the world at large or within the organization itself.

How Does Learning Affect Franchise Success? Measuring What Matters

Talented Learning

Working together, they can help you tie learning behavior to performance outcomes, and provide insights that inform your business decisions. By which metrics? LMS Reporting: Metrics That Matter. Measure learning progress and tie metrics to business results.

Data Driven

Tony Karrer

Will the retail sales training change behavior in ways that improve customer satisfaction? Understanding this model is important in order to be able to apply it within different situations in order to help drive behavior change that ultimately leads to improvement in metrics.

Alternative to the Kirkpatrick Model of Training Evaluation

LearnDash

For many of us in this industry, it is the go-to methodology for gathering training related metrics and reporting on training success. Behavior: evaluate how far your trainees have changed their behavior, based on the training they received.