Clark Quinn

NOVEMBER 21, 2023

The problem here is that we’re using unreliable metrics. Sure, it’s much easier if we can reliably group people into segments that mean we have a reliable basis to do different things. Marketers do this with psychographics, for instance. Demographics can also matter. First, there are assumptions that turn out to be flawed.

Metrics 207

Metrics Apple vendor Research 207

Clark Quinn

FEBRUARY 6, 2019

If it’s in sales, we should see more proposals generated, higher success rates, lower closing times, lower closing costs, and other such metrics. Whatever method, whether xAPI or proprietary, we should be tracking activity and correlating with business metrics. With a little thought, we. What has that done ?

Metrics 170

Metrics Innovation xapi Problem 170

Clark Quinn

JUNE 14, 2022

If you are running out of time and money before you’re achieving your metrics, you can adjust them, but now you’re doing it on consciously, not implicitly. It doesn’t have to be ‘adrenaline in the blood’ or even galvanic skin response, subjective evaluations by your learners is just fine.

Cognitive 286

Cognitive Metrics Exercise Instructional Design 286

Clark Quinn

JULY 28, 2020

We use visuals to tap into our powerful visual processing system, not because they have any particular metric improvement. Yes, we look to engage multiple senses, but for comprehending and encoding information. And variety. We also use audio when appropriate. And while text is visual, we use it as appropriate too.

Design 245

Design Cognitive Metrics Learning 245

Clark Quinn

APRIL 26, 2022

People’s opinion is a useful metric for success. It, however, creates barriers when you’re trying to create learning that actually works. Have people look at the things they learned outside of school (sports, hobbies, crafts, etc) for clues.

Metrics 262

Metrics Performance Support Pedagogy Behavior 262

Clark Quinn

SEPTEMBER 28, 2022

For instance, to expect due diligence in analysis, with either clear metrics of success, or expectations of an appropriate process. Ideally, RFPs would be expecting a good process. That includes a number of steps, from analysis through to deliver.

Metrics 147

Metrics Quiz Analysis Design 147

Clark Quinn

DECEMBER 22, 2020

We also consider the use of metrics in the organization, both to evaluate and to improve. We should move from just looking at the cost of a butt in a seat for an hour to whether that time is benefiting the org.

Performance Support 295

Performance Support Performance Metrics Organizational Learning 295

Clark Quinn

OCTOBER 19, 2021

Against an objective metric, of course, not comparative to others. This includes having people not just knowing their purpose but getting feedback on how they’re doing to achieve it. Recognition matters, with positive recognition of accomplishment or support to improve.

Metrics 282

Metrics Performance Support Mentoring Culture 282

Clark Quinn

DECEMBER 1, 2020

If it’s like what I saw in (then) ASTD’s State of the Industry report, it’s metrics like employees served per L&D employee or cost/seat/hour for training. Moving needles like fewer errors, more revenue, reduced costs, happier employees and customers, etc. So, first, what is general training output data?

Metrics 260

Metrics ROI ASTD Cost 260

Clark Quinn

JANUARY 14, 2014

Sure, we also might affect indirect metrics – retention, workplace satisfaction, or customer satisfaction – with tangible value, but our real focus should be on direct metrics. Of course, if you can correlate them, all the better.

ROI 169

ROI Social Metrics Social Networks 169

Clark Quinn

MAY 4, 2021

If they’re not reporting on measurable changes in the improvement of business metrics, like sales, customer service, operations,e tc, they’re not demonstrating their worth. is the same or better than the industry average, so we’re doing good. No, this is all about efficiency, not effectiveness. It’s a waste of money.

Metrics 275

Metrics LMS Job Innovation 275

Clark Quinn

APRIL 27, 2021

Depending on whether that’s internal or external, it might show up (at least in aggregate) in either 360 eval scores, or some observable metric like customer sat scores. 2) The ‘customers’ of the learner should notice the improvement. It may be harder to collect this data, but of course it’s also more valuable. .

Evalution 210

Evalution Skills Metrics Lecture 210

Clark Quinn

JULY 2, 2013

In other words, we need to take the time to identify what business problem this is solving that a course will affect, and the associated metric. That takes time. This is not trivial: a poorly formed objective about knowledge, not behavior, isn’t going to have an impact on the business.

Metrics 196

Metrics Simulations Behavior Rapid eLearning 196

Clark Quinn

MARCH 20, 2019

And I think we should be comparing ourselves to a principled metric about where we could and should be. In fact, as I’ve written before, I think we shouldn’t benchmark ourselves against others. That’s a bad practice. Because then we’re comparing ourselves against a relative measure.

Metrics 146

Metrics Performance Support Instructional Design Evalution 146

Clark Quinn

OCTOBER 26, 2011

The plan you take (your sequence of prioritized goals), the metrics you use, and your schedule, will be individual. However, the other elements will share some characteristics.

Strategy 150

Strategy Metrics Performance Support Policies 150

Clark Quinn

DECEMBER 11, 2013

Organizations are not doing root cause analysis or aligning with business metrics, but instead are serving as ‘order takers’ Organizations are not looking to using performance support even though it’s likely a better value than courses, let alone looking to the network as a systematic component of the solution.

Virtual Classroom 187

Virtual Classroom Case Study Develop Metrics 187

Clark Quinn

APRIL 4, 2012

And you want to align what you’re doing with organizational goals, define metrics that will impact key business metrics, provide governance with partners both fundamental and strategic, leverage other organizational initiatives (oh, you’re putting in a CMS?

Social 183

Social Social Learning Metrics Social Media 183

Clark Quinn

DECEMBER 27, 2017

The second one is also problematic, in their standard for evaluation: Reports typical L&D metrics such as Kirkpatrick levels, experimental models, pre- and post-tests and utility analyses. Yet here we’re seeing someone conveying legitimacy by communicating this message. This one’s a little harder to see.

Problem 116

Problem Metrics Kirkpatrick Learning Styles 116

Clark Quinn

OCTOBER 25, 2011

Multiple things go along with this: the tactics that achieve the goals, the metrics that you use to measure your progress and success, the partners you need to work with, the resources you’ll need, the continual development of capability of the resources, and the messaging you’ll use to get others to buy in and assist.

eLearning Strategy 173

eLearning Strategy Strategy Metrics DevLearn 173

Clark Quinn

JANUARY 8, 2015

But stakeholders don’t know, we don’t worry enough about quality in our metrics (quantity per time is not a quality metric), and we don’t invest enough in learning. If it looks good, presents content, has some interaction, and some assessment, it’s learning, right?

Metrics 100

Metrics Corporate eLearning eLearning Tools Quality 100

Clark Quinn

AUGUST 31, 2017

Similarly, the number of L&D units actually measuring their impact on organizational metrics seems to be lagging those that, for instance, just use ‘ smile sheets ‘ And even those are done badly. There’s also an argument that L&D could and should be considering performance support as well.

Metrics 111

Metrics Organizational Learning Performance Support Theory 111

Clark Quinn

OCTOBER 6, 2016

They might meet one particular metric, but when you look at the big picture, aligning improvement with respect, you need to have a rich solution. We need to recognize that changing what is arguably the most complex thing in the known universe (the mind) in persistent and predictable ways is not simple. And I think awareness is growing.

Quality 166

Quality Metrics Predictions eLearning Strategy 166

Clark Quinn

OCTOBER 13, 2016

The categories were Culture, Formal Learning, Performance Support, eCommunity, Metrics, and Infrastructure. The premise of the chart was that there are stages of maturity across the major categories of areas L&D should be aware of. And for each of those, I had two subcategories. And I mapped each at four stages of maturity.

Integrate 100

Integrate Metrics DevLearn Performance Support 100

Clark Quinn

APRIL 3, 2014

And , we should set performance metrics and measure against them! We should share our work at things like DemoFest, we should measure ourselves against quality criteria, and we should get expert reviews. Of course, that alone isn’t good enough.

Design 151

Design Cognitive Metrics eLearning Strategy 151

Clark Quinn

FEBRUARY 5, 2015

They didn’t seem too eager to try to quantify that relative to other known metrics, and I understand it’s hard, particularly in the time they had.

Agile 100

Agile Metrics Synchronous Social Networks 100

Clark Quinn

NOVEMBER 21, 2018

I’d like to see workers pushing more for real impact via metrics, leaders asking for business cases not order taking, and I’d like to see vendors pushing solutions, not resource savings. Work smarter! Get smart about learning science, about business, and about what technology can (and can’t) do.

Trends 169

Trends Social Networks Cognitive Metrics 169

Clark Quinn

APRIL 2, 2015

If there is a gap, you have a natural metric. Second, don’t you want to attach the outcome to the intervention? I mean, if you’re doing performance consulting, there should be a gap you’re trying to address or why are you bothering?

Case Study 100

Case Study Metrics Kirkpatrick xapi 100

Clark Quinn

MARCH 21, 2017

I asked about both survey data, and business metrics, and she indicated both (and anything else ;). Interestingly, an HR Director sitting next to me was nodding her head during that response about the data. So afterward I asked her what sort of data she had in mind. And I think that’s a good basis. But not a sufficient one.

Strategy 101

Strategy Metrics Director Performance Support 101

Clark Quinn

APRIL 11, 2017

We continue to see practices like yearly reviews, micromanagement, incentives for limited performance metrics, and curtailed communication. And typical business thinking is still visible in ways that are hierarchical and mechanical. And, let me add, these old practices are not aligned with what we know about how our brains work.

Metrics 102

Metrics Theory Sun Methods 102

Clark Quinn

NOVEMBER 29, 2016

It’s also your review approach, and metrics. I had in mind the approach taken by an organization to their learning design. Attendees suggested it’s your goals and approach, ensuring you are delivering effectively. These are all elements that indeed contribute to strategy. What gaps are we seeing in learning design strategy?

eLearning Strategy 100

eLearning Strategy Strategy Social Networks Design 100

Clark Quinn

NOVEMBER 8, 2011

Delivered, for instance, through mobile devices. The goal is to use the events in your life as learning opportunities as much as possible (or preferable).

Metrics 167

Metrics Simulations Calendar Learning 167

Clark Quinn

FEBRUARY 13, 2012

Well, if you really are looking to move needles on key business metrics. But I’d argue that it’s the best investment an L&D organization could make, as it will likely have the biggest impact on the organization. So, where do you think it could, and should reside?

Social Media 174

Social Media Budget Media Social 174

Clark Quinn

JUNE 20, 2012

Here we’re emphasizing the ‘where’ and the ‘business’ What’s important is thinking about meeting real business needs, with metrics and everything. The third key phrase emphasis taking a strategic approach: Where’s the business need? What do the folks who are performing away from their desks need?

Mobile 187

Mobile Metrics Performance Support eLearning Guild 187

Clark Quinn

JANUARY 28, 2013

If it’s not tied to impacting a business metric, it’s probably not the right topic. There are several important components: Making it meaningful: focus on changes that will impact the workplace and help convey to the learner that this is real and really needed. Making it personal: this includes several things.

Metrics 190

Metrics Project Learner Format 190

Clark Quinn

JANUARY 14, 2016

I’m also pretty lax about looking at the metrics. I haven’t (yet) followed a formula to drive business traffic, and only occasionally mention my upcoming events (though hopefully that’s a public service :). There’re other places to track that. This is, largely, for me. And for you if your interests run this way.

Metrics 100

Metrics Google Analytics Conference 100

Clark Quinn

NOVEMBER 30, 2015

The advice goes on: understand how learners are learning, create a participatory culture, and use real business metrics. The recommendation is to break down silos so as to achieve the conversations that will achieve meaningful impact. All grounded in what successful organizations are doing.

Report 100

Report Benefits Metrics Performance Support 100

Clark Quinn

APRIL 8, 2015

The important point is starting with a business metric. You go back to the behavior change you need in the workplace to address that measure, and from there to the changes in training and/or resources to create that behavior change.

Kirkpatrick 100

Kirkpatrick Cognitive Metrics PDF 100