Clark Quinn

NOVEMBER 8, 2018

For sins in my past, I’ve been thinking about assessments a bit lately. You can ask learners to develop meaningful artifacts, but getting them assessed at scale is problematic. To be fair, there are more and more approaches (largely machine-learning powered), that can do a good job of assessing complex artifacts, e.g. writing.

Alternatives 171

Alternatives Assessment Images Knowledge 171

Clark Quinn

JULY 25, 2023

Thus, I posit that it takes humans to write the introduction to learning experiences, to set the ‘ hook ‘ Similarly, it takes humans to make practice activities (aka assessment) that have an engaging context, appropriate challenge, and naturally embed the task. Essentially, making the practice meaningful.

Cognitive 185

Cognitive Embed Roles Picture 185

Clark Quinn

SEPTEMBER 19, 2019

It’s about creating clear definitions of performance, and aligning those with assessments. This, in the talk, was mapped to three different segments: engaging the learners in multiple ways, communicating concepts in multiple ways, and allowing assessment in multiple ways. Maybe I missed some nuance? I try to be open-minded.

Mash-up 100

Mash-up Mashups Cognitive Learning Styles 100

Clark Quinn

JULY 11, 2019

Each situation will require an assessment of the mental task. Still, we need to be aware of, and assessing, the dimensions of difficulty as part of our solution. Low consequences suggest low investment obviously. Complexity and infrequency suggest more spacing of practice. It may be that there’s no one answer.

Brain 174

Brain Blended Learning Performance Support Pattern 174

Clark Quinn

MAY 21, 2019

Assessment : an independent assessment of where you are in your processes, and what are the opportunities for change. the assessment, a strategy session for improvements, and a termed coaching engagement to support success. This brings a shared vocabulary and understanding of what needs to change and why.

Change 158

Change eLearning Guild DevLearn Coaching 158

Clark Quinn

APRIL 5, 2022

Assessing confidence is an extra step, but there seems to be a valid reason to incorporate it in your learning design. If they’re wrong but confident, you give them feedback (and arguably ramp them backwards).

PDF 214

PDF Assessment Authoring System 214

Clark Quinn

JUNE 3, 2021

As I’ve been developing online workshops, I’ve been thinking more about the type of assessment I want. Previously, I made the case for gated submissions. Now I find another type of interaction I’d like to have. So here’s the case for model answers (and a rubric). As context, many moons ago we developed a course on speaking to the media.

CD-ROM 283

CD-ROM Case Study Evalution Asynchronous 283

Clark Quinn

APRIL 21, 2022

Patti Shank, PhD Author of Write Better Multiple-Choice Questions to Assess Learning. “… the notion of engagement, and its true meaning, is like the mysterious fifth element waiting to be discovered and summoned through three words in this book: Make. The book explains why and how, with good examples.”.

Cognitive 272

Cognitive Write Blog eBook Press 272

Clark Quinn

DECEMBER 7, 2021

As a presenter, if you don’t have a good basis for assessing your likely length (e.g. Have a practice for signaling if things are getting close, e.g. signs for # of mins left, colored lights, messages in chat (tho’ some people seem unable to process them; beware), what have you.

Guidelines 266

Guidelines Diversity Training Slides Personal 266

Clark Quinn

DECEMBER 15, 2020

Hopefully, we’ll see tool vendors aligning their content and assessment capabilities towards designing scenarios and contextualized practice, along with specific feedback for each wrong answer and support for reflection. Thus, the push for Short Sims, and better written multiple choice questions, and in general a focus on ‘do’, not know.

Trends 220

Trends Predictions Portal vendor 220

Clark Quinn

JULY 31, 2014

That is, when you’re developing a curriculum, you have opportunities to require using those skills, but they need to be explicitly included and better yet, assessed. Development would require assessing performance and providing feedback. Development would require assessing performance and providing feedback.

Scanning 154

Scanning Assessment Performance Support Problem 154

Clark Quinn

JULY 19, 2016

While there are a number of steps to take (including how you work with SMEs, the details you attend to in your content, etc), their internal vocabulary talks about ‘knowledge checks’ and the goal was to do those better as they migrate existing courses to a new platform with a suite of assessment types.

Evalution 100

Evalution Format Learning Assessment 100

Clark Quinn

DECEMBER 22, 2020

The intent is to provide a tool whereby organizations can understand what the possibilities are, assess themselves, and prioritize directions to move and improve. In the book I had a set of six categories, each with two components. So I created a ‘maturity model’. Let’s be clear, this is conceptual, not empirical.

Performance Support 295

Performance Support Performance Metrics Organizational Learning 295

Clark Quinn

MAY 25, 2021

Don’t forget task analysis and needs assessment skills, making content accessible and engaging. “sometimes I wonder how to best juggle everything that my role requires: project management, design and ux/ui skills, basic coding, dealing with timelines and SMEs and managers. And staying on top of a variety of software.” .

DevLearn 276

DevLearn Asynchronous Performance Support Rapid eLearning 276

Clark Quinn

FEBRUARY 29, 2012

The Stanford model, as I understand it (and I haven’t taken one), features a rigorous curriculum of content and assessments, in technical fields like AI and programming. Assessment comes from participation and reflection, without explicit contextualized practice. The connectivist MOOCs, on the other hand, are highly social.

Cognitive 183

Cognitive Theory Learning Theory Social Media 183

Clark Quinn

MARCH 11, 2013

The xMOOCs that I’ve seen have a good focus on quality assessment aligned to the learning goal, but there’s a caveat. Consequently, it occurs to me, that you simply cannot make a quality learning experience that can be auto-assessed. There’s more. It needs to be rich, and mentored, scaffolded, and evaluated.

Cognitive 172

Cognitive Poll Quality Mentoring 172

Clark Quinn

JANUARY 30, 2012

I recently wrote about elearning garbage , and in case I doubted my assessment, today’s task made my dilemma quite clear. Importantly, it could easily be argued that several were appropriately instructionally designed, in that they had clear objectives, and presented information and assessment on that information.

Examples 186

Examples eLearning Instructional Design Assessment 186

Clark Quinn

APRIL 10, 2018

I replied that it’s role wasn’t evaluating the effectiveness of the learning design on the learning outcome, it was assessing the impact of the learning outcome on the organizational outcome. Will attacked that the model didn’t really evaluate learning. Fortunately, this discussion is now resolved.

Evalution 150

Evalution Kirkpatrick Attention Job 150

Clark Quinn

OCTOBER 23, 2018

I think you can see that successfully integrating these is non-trivial, and I haven’t even gotten into how to evaluate this, particularly to make it a part of an overall assessment. Yet, we know that multiple constraints help make the design easier (at least until you constrain yourself to an empty solution set ;).

Activities 157

Activities Integrate Classes Evalution 157

Clark Quinn

JANUARY 9, 2019

This naturally includes application-based instruction, as well as meaningful (and minimal) content , and good assessment design. There have been several instances in the past year or two that have really pushed my thinking in this space. It’s been handy for this!

Mobile 160

Mobile Design Mobile Learning Assessment 160

Clark Quinn

APRIL 27, 2021

The question is how to assess them reliably. This is a point that others have made, that these skills have hard to observe criteria. . There’s some argument about so-called 21C skills, and yet I can agree that these four things would be good. Rackham argues that perhaps AI can help here. Perhaps, but at this point I’d argue for two things.

Evalution 210

Evalution Skills Metrics Lecture 210

Clark Quinn

SEPTEMBER 15, 2015

Here’s my first stab, for your consideration: Assess : here we determine our situation. Guide : then we need to assess how we’re doing and look for interventions needed. The principle of ‘ trojan mice ‘ suggests small focused steps, and there are reasons to think small steps make sense.

Evalution 100

Evalution Assessment Guide Support 100

Clark Quinn

MAY 3, 2011

And LMSs don’t care what the form of assessment is, if it can be recorded. What we should be looking for are competency assessments, based upon real performance, not knowledge test. We can make meaningful tests, either computer-administered (simulations), or real performance. What doesn’t work are knowledge tests.

Compliance 180

Compliance Simulations Portal Classes 180

Clark Quinn

JANUARY 23, 2013

The pragmatic barriers to creating simulations are falling down, and we now know that knowledge test isn’t an adequate assessment of ability to apply. We no longer have to have separate summative assessments, as digital environments can store performance as part of a portfolio of ability. Test -> Simulation .

Simulations 179

Simulations Mentoring Performance Support Search 179

Clark Quinn

JUNE 30, 2020

Asking folks for their assessments of tools they’ve invested in introduces a clear source of bias. And, yes, there are voices that cry out for the tools. For instance a TD article claimed that such tools popular. Under the guise of saying they’re effective.) Which is problematic. So it’s a problem.

Voice 220

Voice vendor Twitter Learning Styles 220

Clark Quinn

MARCH 12, 2019

And I shudder at the thought of a pre-college test in the old style trying to assess this new model!) I don’t want teachers facilitating the old failed curricula, and I don’t want current pedagogies working on the new curricula. I welcome your thoughts! The post Curriculum or pedagogy? appeared first on Learnlets.

Pedagogy 165

Pedagogy Project Conversation Conference 165

Clark Quinn

MARCH 8, 2012

These products are portfolio items, going forward, and assessable items. The assessment could be self, peer, or mentor. This is also part of your portfolio, and assessable. The underlying thinking needs to be visible for inspection. However, the granularity of the activities is at issue.

Portfolio 188

Portfolio Cognitive Learning Simulations 188

Clark Quinn

JANUARY 22, 2013

I’d want to track activity , not just content and assessment. I think that the way things are going: changing faster, dealing with more ambiguity ,and requiring more ingenuity and innovation, require a different approach than the assess, prepare, rollout model.

Cognitive 180

Cognitive Performance Support Screencast Compliance Training 180

Clark Quinn

JANUARY 31, 2018

The solution includes continuous assessment, mobile performance support, and coaching. The problem was too much hierarchy. Using a Human Performance Improvement approach, they decentralized the work to more self-directed teams. Coaching also played a role in the case study Jane Bozarth provided. The issue was solving workplace problems.

Case Study 135

Case Study Social Networks Communities of Practice Social Network 135

Clark Quinn

APRIL 22, 2020

These include an online learning competition, advising other orgs, and creating an online learning quality assessment. At the same time, I was assisting and leading other initiatives. I came back to the US to lead the development of an adaptive learning platform for online courses.

Online 178

Online Course Cognitive eLearning Guild 178

Clark Quinn

APRIL 11, 2019

Combined with greater emphasis on teaching quality, even a movement towards competencies, and rigor in assessment, there’s a hope to get meaningful outcomes from our higher education investment. We need faculty and support staff to ‘get’ what good learning design is. Ultimately, this is a good push forward.

Change 160

Change Cognitive Tools Pedagogy 160

Clark Quinn

JANUARY 16, 2019

Helping your designers switch to good assessment writing is going to be useful. From there, the most meaningful and valuable step is to focus on the practice. What are you having learners do , and how can you change that? Of course, to support good application of the content to develop abilities, you need the right content!

Design 146

Design Analysis eLearning Consultant Learning 146

Clark Quinn

MARCH 1, 2012

Yet: There’s no psychometrically-valid learning styles assessment out there. And, as a conversation with someone reminded me, it helps for learners to look at how they learn, so as to find ways to optimize their chances for success. There’s no evidence that adapting learning to learning styles is of use. So what to do?

Learning Styles 176

Learning Styles Brain Problem Conversation 176

Clark Quinn

JUNE 4, 2019

That is, with a rigorous focus on content and assessment, and less pragmatic approaches to spacing and flexibility. And purists will say they do (at least, ones influenced by Keller ). But I will suggest that the typical vision is of a behavioristic approach.

Engineering 206

Engineering Instructional Design DevLearn Instructional 206

Clark Quinn

MARCH 6, 2019

I finished with a 3 hour strategy session where I walked people through each element of the ecosystem (as I cut it), giving them examples, providing self-assessment, and items to add to their strategy for that element. Useful feedback. . I closed by suggesting that it was up to them to sequence, based upon their particular context.

eLearning Strategy 133

eLearning Strategy Strategy Training Train 133

Clark Quinn

MARCH 16, 2011

I have long advocated, in consonance with sound learning principles, that in a good design process works backwards: start with the desired outcomes as capabilities, align assessment to the outcomes, and then design the learning experience to achieve those outcomes. This shouldn’t be new.

Design 145

Design Taxonomy Sound Assessment 145

Clark Quinn

JULY 30, 2013

The Learning & Performance Institute research suggests that L&D practitioners don’t assess themselves as having all the skills they might need. Some are saying that things are largely okay, while others are suggesting that things must improve. Where are we at?

Survey 172

Survey ASTD Suite Forum 172