Tony Karrer

AUGUST 15, 2011

For example, if I look at July's Top eLearning Posts , I find (among others): eLearning and Fun: Two Words Not Normally Seen Together Lurking or Legitimate Peripheral Participation 6 Alternatives To Bullet Lists Flash in eLearning - Seven Traps to Avoid Evaluating Social Learning The site is categorized in various topics such as concepts like Instructional (..)

Rapid Intake 182

Rapid Intake Rapid eLearning Examples eLearning 182

Tony Karrer

AUGUST 27, 2007

I often find myself in the speaker room at conferences trying to get a look at my session evaluations. It's often the case that conference organizers don't get evaluations back to you for 3-4 months. I personally would love to see this happen. I'm trying to find out what went right or wrong. So, having real-time feedback is great.

Conference 100

Conference eLearning Guild ASTD Evalution 100

Tony Karrer

APRIL 18, 2008

I just pulled a report as part of an LMS Evaluation and saw an interesting pattern: The pattern shows that the larger the audience the lower the satisfaction scores. My guess is that Learning Management Systems that target enterprise solutions and larger audiences will come out lower in LMS Satisfaction surveys.

LMS 100

LMS RFP Pattern Learning Management System 100

Tony Karrer

NOVEMBER 25, 2008

Time to evaluate my options? I can't tell if this is something that is intentional, but it's been happening for a while. I actually left Technorati for Google because Google appeared to be doing a better job. Any suggestions on what to use for this? Learning Trends 2008 - Online - Free [link]

Search 100

Search Google Blogging Problem 100

Tony Karrer

NOVEMBER 25, 2008

Someone asked me for an example of a conference using a Wiki both for organizers during planning, evaluating proposed sessions, etc. and for attendees with session pages, participant lists, that kind of stuff. Certainly we did parts of this for Corporate Learning Trends 2007. It was more aimed at the attendee side.

Wiki 100

Wiki Conference Examples Google Docs 100

Tony Karrer

DECEMBER 18, 2007

Also, I've been evaluating various clipping, note taking tools such as Zotero, Clipmarks, Google Notebook and my frank opinion is that it forces me to use an interface that is limited as compared to putting it into a large document to play with. In other words, it would combine steps 2 & 3. Any suggestions on that?

Help 100

Help Firefox Web Google 100

Tony Karrer

OCTOBER 31, 2007

people, 2 months Note: people aren't spending enough time during evaluation doing hands-on evaluation. Maybe you should have gone with a Starter LMS. 1 - Gather and Specify Requirements Median - 3 people, 5 months 2 - Research Vendors Requirements Median - 3.5 people, 4 months 3 - Meet with Vendors Median - 3.5

LMS 100

LMS Teams eLearningGuild RFP 100

Tony Karrer

NOVEMBER 24, 2008

I've recently been talking to people about evaluating performance of Concept Workers. Evaluating concept worker performance is an interesting challenge: No right answer - Most often there is no single right answer. I want to thank Dave who has provided thoughts in several posts such as Getting to Exemplary. Is my answer reasonable?

Evalution 100

Evalution Performance Knowledge Worker Social Media 100

Tony Karrer

MAY 8, 2008

Of course, you always evaluate how easy it is to report the issue. And this extends beyond the online world. If I'm at a restaurant, I will try to tell the manager about an issue - most of the time not to fix it, just to make them aware. If the manager is not around or there's no contact mechanism on the site, then I don't report it.

Report 100

Report Site Issue Evalution 100

Tony Karrer

FEBRUARY 16, 2010

The real question here is probably more about how you work with your management to get them to understand the challenge, how you might approach it, the risks of not doing a more thorough evaluation. Still are there good ways that you can short-circuit the LMS Selection Process to reduce the length of time?

LMS 117

LMS Virtual Classroom Moodle WebEx 117

Tony Karrer

MAY 27, 2008

Most of our activity is looking up information, so the most common use case is search, evaluate, keep, organize. Instead of dawdling on websites many users want simply to reach a site quickly, complete a task and leave. Hardly selfish really. We don't want fluff. In 1999 this figure stood at 60%.

Search 100

Search Design Site Web 100

Tony Karrer

MAY 18, 2007

I've both used some of these tools with different membership groups I belong to and I've recently gone through an evaluation process for a customer who does a large trade show. Based on my personal results, I've not found a lot of value in these tools.

Network 100

Network Conference Tools Security 100

Tony Karrer

FEBRUARY 23, 2007

It gives some interesting indications: Number of evaluations by eLearningGuild Members of the use of the types of tools: Courseware authoring tools - 4,000 Rapid eLearning authoring tools - 3,000 MediaWiki - 40 users This analysis is very crude as compared to the rich data. Heidi Fisk suggested I look at the eLearningGuild research reports.

Wiki 100

Wiki eLearningGuild MediaWiki Tools 100

Tony Karrer

JUNE 26, 2007

Distributed Cognition â€" the ability to interact meaningfully with tools that expand mental capacities Collective Intelligence â€" the ability to pool knowledge and compare notes with others toward a common goal Judgment â€" the ability to evaluate the reliability and credibility of different information sources Transmedia Navigation â€" the ability (..)

Scanning 108

Scanning Media Skills Cognitive 108

Tony Karrer

DECEMBER 10, 2008

That message tells you that the call center is recording calls so that quality monitoring evaluations can be done on each agent each month. The agent is also being evaluated based on other metrics such as time on the call, time to resolution, number of contacts to resolve, etc.

Metrics 100

Metrics Performance Support Score Survey 100

Tony Karrer

MAY 5, 2009

Enterprise: List of 40 Social Media Staff Guidelines , April 23, 2009 NYTimes OpEd | End the University as We Know It , April 27, 2009 The future of e-learning is social learning , April 25, 2009 OpenGov: One big challenge? 4) Social Networks (23) Adoption (8) eLearning Technology.

Social Networks 100

Social Networks Social Network Analysis Social Network Social Media 100

Tony Karrer

JULY 2, 2008

How do I evaluate info from one. She lists the tools and what you should know as: Wikis : How to edit, how to read, how to link to RSS Feeds : What are they, how do I read one, once I have a reader set up how do I scan info collecetd, how do I share info using one Blogs : How do I write one. Why SHOULD I write one. How do I use.

Scanning 189

Scanning Wiki PBwiki Google Docs 189

Tony Karrer

FEBRUARY 7, 2008

This really relates to the questions being discussed in this month's Big Question ( Instructional Design - If?

Diversity Training 108

Diversity Training Online eLearning Instructional Design 108

Tony Karrer

FEBRUARY 28, 2008

I read the evaluations from both sessions before I left. By in large I got very favorable evaluations on the first session and a mixed bag on the second. I need to go back and look at Better Conferences , Be an Insanely Great Professional Conference Attendee to see if there were suggestions.

ASTD 100

ASTD Wiki eLearning 2.0 Social Bookmarking 100

Tony Karrer

MARCH 27, 2007

But when I looked back at my post, I realized that I had cut off quite a few authoring tools because I had only included reports where the number of evaluations was 15 or more. The answer is that I've only seen it demoed. So, I've redone the graphics to include those with more than 5 responses.

KnowledgePlanet 100

KnowledgePlanet eLearning Tools RapideL Elicitus 100

Tony Karrer

JUNE 23, 2009

Business of Learning - eLearning Technology , June 15, 2009 New online book on mobile learning -available for free download - Ignatia Webs , June 12, 2009 Phases of the 3PD Approach: Discovering Instructional Design 15 - The E-Learning Curve , June 16, 2009 Google Wave as a Learning Tool - Learning and Technology , June 12, 2009 Student Guide: Introduction (..)

Google Wave 109

Google Wave Google Social Learning Social 109

Tony Karrer

APRIL 7, 2009

My Top 25 blogs for 2008 Blogging as Reflective Practice The Elearning Apprentice Part 2: A four-level framework for evaluating social network ROI. Not – Pictorally Social Networking in Education Informal learning - what is it?

Social Networks 139

Social Networks Blended Learning Authoring Tools Corporate eLearning 139

Tony Karrer

APRIL 16, 2009

In Value from Social Media , I looked at a scenario where I'm evaluating a particular solution for my company / organization. Search's Limit The limit of search and need for conversation is a common topic here and as part of Work Literacy. Through Google, I find a lot of information. What’s really going to happen?

Conversation 100

Conversation Case Study Search Social Media 100

Tony Karrer

JUNE 8, 2009

Now consider how we Evaluate the Performance of Concept Workers by looking at signals such as: Process - They went through a reasonable process to arrive at their conclusions. Granted you need a base level of knowledge to understand what you are getting, but you certainly don't need to be a true expert.

Social Networks 100

Social Networks Social Network Network Expert 100

Tony Karrer

AUGUST 26, 2009

You will evaluate using much the same way that we Evaluate Concept Work. I might use the analogy of the thesis associated with an advanced degree. You are not testing for content, rather you are expecting the completion of a process leading to something that is fairly well defined.

Wiki 100

Wiki Social Networks Blended Learning Yammer 100

Tony Karrer

JANUARY 27, 2009

In Networks and Communities , I discuss the limits of search and how Evaluating Performance of Concept Workers leads us to needing to derive Value from Social Media.

Social Media 100

Social Media Wikipedia Social Networks LinkedIn 100

Tony Karrer

JANUARY 7, 2009

Find - Includes Evaluate, Narrow / Adjust Keep / Organize / Refind / Remind Leverage / Present Network Collaborate I do all of this in a Word document - capturing it as a series of notes. (Opportunities) I generally look back at the Knowledge Work Framework and its task categories as a trigger to remind me of these things.

eLearning Strategy 100

eLearning Strategy Strategy Scanning eLearning 2.0 100

Tony Karrer

JANUARY 4, 2007

11% said they did NO evaluation 26% said they did Level 1 smile sheets 48% said they measured Level 2 learning 15% said they measured Level 3 on-the-job performance 0% said they measured Level 4 business results (or ROI) His discussion further points out that doing Level 2 assessment immediately at the end of training (i.e., Among them.

Assessment 100

Assessment Metrics Develop Survey 100

Tony Karrer

DECEMBER 14, 2010

Social Learning Tools Should Not be Separate from Enterprise 2.0 Performance Support in 2015 What Makes an LMS Easy to Use?

Text-to-Speech 200

Text-to-Speech Compliance Training Diversity Training SharePoint 200

Tony Karrer

JUNE 2, 2009

Here's a few of the evaluation comments from a recent one: Awesome!! Its good to hear of the solid business and learning applications for these technologies." " Director of Learning, WellPoint Tony gets great reviews from his presentations and workshops. Enjoyed being able to see live examples.

Services 100

Services Social Networks Case Study eLearning Guild 100

Tony Karrer

FEBRUARY 23, 2007

Courseware Authoring Tool Satisfaction - Rapid eLearning Tool Satisfaction - I'm only showing tools with 15 or more evaluations. Unfortunately, my blog is not wide enough for these images, so click on the image to go to a page with the full size image. List of Tools and Vendors: Keynote - KnowledgePlanet On-Demand.

Rapid eLearning 100

Rapid eLearning Authoring Tools KnowledgePlanet Cornerstone OnDemand 100

Tony Karrer

FEBRUARY 12, 2009

The good news these days for my kids is that there is often a rubric (set of evaluation criteria) that are used to grade their writing. And best of all, his biggest mantra was to stop using extra words that were not required. Shorter was better. Extra words were bad. To this day, I thank him.

Scanning 113

Scanning Write Blog IM IMS 113

Tony Karrer

FEBRUARY 27, 2007

Further, I would highly recommend that you don't evaluate by only looking at these blogs periodically, rather - sign up for an RSS reader, e.g., Bloglines or Google Reader and subscribe to each blog. That said, I still cheated (see below). I think a better list to use is in my Blog Roll in the right column of my blog.

Blogging 119

Blogging Corporate eLearning Scanning eLearning Strategy 119

Tony Karrer

MARCH 3, 2009

I'm constantly evaluating where I'm going to focus. I think everyone has to evaluate what works for them. Q : Do you ever feel too " spread out " between LinkedIn, Facebook, blogging, twittering, etc.? Fantastic question. I'm still somewhat unsure about Twitter and Facebook. Blogging is a different animal.

Social Networks 102

Social Networks Social Ning LinkedIn 102

Tony Karrer

MAY 4, 2007

2005 2006 2007 Change %Chg results 9 0 2 2 wiki 0 0 2 2 assessment 3 1 3 2 200% virtual classroom 5 1 3 2 200% align/ment 8 1 3 2 200% strategy/ic 10 3 8 5 167% trainer 6 7 14 7 100% performance 17 9 18 9 100% lms 2 3 5 2 67% rapid 3 4 5 1 25% roi 9 4 5 1 25% shoestring 0 3 3 0 0% collaboration 1 2 2 0 0% accelerated 3 2 2 0 0% enterprise 8 1 1 0 0% (..)

Blended Learning 100

Blended Learning Wiki Virtual Classroom Authoring Tools 100

Tony Karrer

OCTOBER 25, 2007

LMS Satisfaction Features and Barriers LMS Dissatisfaction on the Rise Topic #2 - LMS Selection Process I'm going to break the process into a few bigger buckets: Start Up Form a core selection team and define stakeholders Define business and learning strategy Agree to process with key stakeholders Evaluation Capture requirements and differentiating (..)

RFP 100

RFP LMS eLearningGuild Brandon Hall 100

Tony Karrer

JUNE 8, 2010

Each of these parts has a specific role and by understanding a bit more about what they do, you can better evaluate quality of the result. Natural Language Processor (NLP) and Quality The natural language processor is what knows the rules of English grammar and word formation (morphology).

Text-to-Speech 149

Text-to-Speech Quality Virtual Classroom Voice 149