Posted by A funny thing happened on the way to using GPT-4 last week, which I suspect that the vendors who have implemented GPT-4 and are using it as a statement/Q and A to the learners were not paying attention to. Equally, my vibe says that companies and organizations that use Enterprise GPT (GPT-4) may have been unaware because the bug also hit there.
The bug caused anyone who was asking questions or statements in GPT-4 to receive outputs of garbage, bizarre, and just downright weird. The bug did not appear in either GPT 3.5 or 3.5 Turbo, which many vendors use that have OpenAI.
As I wrote on LinkedIn a week ago, another bug appeared when using GPT-4 – regarding images. When you asked it to create an image of whatever or a picture of whatever – it outputted. One problem, though. The output file was a web page. To change it to a PNG, You had to download JPG as a web page image and then change it in whatever software you use to do so. The issue, which folks posted about, appeared in the OpenAI Developer’s forum. How many providers and vendors with GPT-4 on the learner or admin side that use the image angle were aware?
What if you, as someone overseeing L&D, Training, HR, or whatever department, were unaware, and your employees were using GPT-4 when these bugs appeared? The employees would have no idea what to do. I wonder how many reached out to IT or, let’s say, the folks who are supposed to provide training and learning to them to find out how to resolve it? I doubt they went to the OpenAI Developer’s Forum or jumped over to Reddit.
The point here is that any company who seriously believes that AI, in this case GPT-4, is ready to be a smart assistant, or personal agent/assistant, to help with productivity should recognize that we have a long way to go. AI is in the infant stage, and whoever added, let’s say, GPT-4 as your go-to LLM into your company, organization, university, association, etc. – needs to understand and let the folks at the exec level know that there will be issues.
Copilot from Microsoft is not ready for primetime. I test it weekly, and each time, I think to myself, “Underwhelming.” A copilot is, in essence, an essential aspect, a personal assistant to the end user. Microsoft is not the only vendor that offers copilots. The premise is strong, but we are at an infant stage again.
It continues to baffle me how companies, even providers in our space, regardless if it is learning tech, learning systems, authoring solutions, 3rd party content, and yes, even talent management systems, are unaware if they are using GPT-4, or any other LLM whereas none of them are perfect.
The Latest Facts – What you might have heard, but…
- The vendor mentions they are using/implementing RAG, which will increase accuracy levels.
There is no proof (across the board) that it increases the accuracy of responses. It helps, but even with fine-tuning and guardrails, you will still get hallucinations. I have heard from vendors that use RAG, imply that it nearly gets perfect with their usage. Not true. Nevertheless, I am a fan of having a RAG.
- Private AI within a platform ensures higher accuracy results
Oh boy, this was a doozy. The basic premise to understand what Private AI means is that whether you are using a system that espouses this, a learning system, or learning tech (one prominent vendor notes that their learning tech solution is Private AI) – think of a bubble.
Your content, whatever it may be that is in the platform/solution and stays within it, is wrapped within this bubble. Your content is safe as long as you stay in the bubble. In the private AI angle, the statement that the data is not being scraped off the Internet is usually in the message, ignoring the fact that LLMs that need to be trained, to begin with, pull the context of words, images, and so forth from the net. Equally, vendors that have private AI and push it heavily to prospects and so forth, and mention the non-scraping of the net, may or may not be aware (and I have found some that know fully well) that many LLMs in systems do not scrape the net for information after it has been trained.
The exceptions are GPT 3.5 (Chat GPT) or freebies that the public readily uses. The majority use ChatGPT.
I digress. Going back to private AI, yes, you are in a bubble, but the moment you leave that bubble, say to link to 3rd party content outside of the bubble – hypothetically LinkedIn Learning, you no longer are within Private AI.
Oh, on the topic of private AI, you will still get hallucinations. You will likely have AI bias. As for the accuracy, I have heard anywhere from 2% to 5% inaccuracy. It sounds low until you consider that the cut-and-paste job an employee did for some essential document they sent up the chain might negatively impact the company.
- OpenAI is the best for LLMs, and thus, we should use them because many others do, or we did our due diligence and found this company to be the best.
I often wonder how much due diligence went into this regarding learning system vendors, learning tech, and other ilk. I am surprised that vendors are unaware of the players beyond, say, Google Cloud and Amazon, with various LLMs. More LLMs are appearing (and yes, I have found nearly weekly). Some are 100% open source, and others are open but commercial, where you pay token fees.
There is one vendor that I am aware of that is using Bedrock from AWS. That makes sense. I see solutions like Bedrock, even Google Cloud’s modal garden – where you need to use Vertex AI as the initial foundation (it is machine learning – that is the essential piece for the model as a service solution – such as Bedrock and others).
A few vendors have multiple LLMs – which I strongly recommend as the best route, even for companies that have added an LLM to be used for their employees, customers, or whomever.
Just today (Feb 26), Mistral AI announced a new LLM to compete against GPT-4. They call it Mistral Large. Mistral’s other LLMs are available in Bedrock too. There is no word yet on whether this new LLM will also end up.
I bring up all of this because when it comes to learning and training, who at your company – with your workforce is keeping up to date and pushing out content to their workforce that covers the latest when it comes to skills impact with AI, with how to use whatever LLM the company has implemented, including specific statements or approaches that will provide a more robust response, or that the employee needs to review everything that is outputted from their inquires. Who at your company is creating the content and knows even the basics of AI (which, in this case, is what you hear when folks say AI is generative AI)?
The worst-case scenario is that the person creating the content uses a learning system with an AI content/course creator (i.e., an authoring tool) to speed up the process. To date, I have yet to find one vendor in the entire industry who has prompts on the admin side, whether a person is creating content or assessments, that if he says something wrong, you can identify it and provide what it should be. Not one vendor.
I’ve seen the editing piece, but that is not the same as rectifying what was wrong and providing what is correct within the AI. AI learns from itself, so if it produces hallucinations or downright garbage, and your system doesn’t have prompts, whereas you can change it, what do you think will happen the next time someone creates that content or assessment? The same crummy garbage – at least a higher probability.
In this scenario, you create content covering what employees need to know, make the edits, or in one, you can’t (how nice), and then out it goes. Maybe you can add some images or videos from YouTube (oh, say so long to Private AI if your system has the links to YouTube – okay, the premise of private AI per se), and zing it rumbles.
I’ve seen ones that produce only text. Boring text. Static content is a failure. Nobody reads it, and if they do, how many people can recall it after one week, let alone three or six months? Those who do read it are bored. Then next, and here we go again. Boring.
I put the all text output at the same level of those worthless manuals we all remember back in the day (actually some L&D, Training and HR people still provide them), that nobody reads. Ditto on the content that goes into an intranet for employees or, nowadays, slack or teams. Download, maybe look, and go on.
I shudder to think what those fine folks in marketing are creating for their customers around AI and how it benefits them with best practices. Sales? Yowsa. If you oversee an association education for members (which is training), are you staying abreast of what is taking place and how it can help or let folks be aware of the issues? It isn’t easy to do. It requires a lot of reading and publications on a nightly basis to stay current (I read between 10-20 a night).
Let’s Play a Game
I wanted to see what kind of outputs various LLMs that folks are familiar with, and even one they likely are not, when it comes to this inquiry:
Write two paragraphs for a proposal on purchasing a learning management system in a personal and professional tone.
Copilot
Copilot decided to present two versions, one with a personal tone and the other with a professional tone.
Copilot’s Results
Personal Tone:
Dear Team,
As we continue to enhance our educational offerings, I propose that we invest in a robust Learning Management System (LMS). An LMS will not only streamline our training processes but also empower our learners with a user-friendly platform. Imagine a space where course materials, assessments, and collaboration tools seamlessly come together. With an LMS, we can create personalized learning paths, track progress, and foster engagement.
Picture this: learners logging in from their devices, accessing interactive modules, participating in discussions, and receiving timely feedback. Our instructors will appreciate the ease of content creation, automated grading, and analytics. Moreover, an LMS ensures compliance with industry standards and data security. Let’s take this step toward modernizing our learning environment and providing an exceptional experience for both learners and educators.
Professional Tone:
Dear Stakeholders,
I am writing to propose the adoption of a Learning Management System (LMS) for our organization. An LMS is a strategic investment that will revolutionize our training and development processes. Here’s why:
- Efficiency and Scalability: An LMS centralizes course content, assessments, and communication. It streamlines administrative tasks, allowing us to allocate resources more effectively. As our organization grows, the LMS scales effortlessly.
- Data-Driven Insights: With an LMS, we gain valuable insights into learner behavior, completion rates, and performance. These analytics inform decision-making, enabling us to tailor training programs and address skill gaps.
- Compliance and Security: An LMS ensures compliance with industry regulations and data privacy standards. Our content remains secure, accessible only to authorized users.
- Engagement and Accessibility: Learners benefit from a dynamic, interactive platform. They can access materials anytime, anywhere, fostering continuous learning.
I recommend that we explore LMS options, evaluate their features, and select a solution aligned with our organizational goals. Let’s invest in our workforce’s growth and elevate our learning ecosystem.
Reality
With the professional tone – the results are inaccurate. An LMS does not ensure compliance with industry regulations and data privacy standards. The first statement is dependent on any learning system and industry regulations. This will depend on what server farm they are using. Most vendors are on AWS. Some use Google Cloud or Microsoft Azure. Overall, data-driven insights, analytics, and performance vary from vendor to vendor. For example, customer training is worthless—Ditto for an association. The premise here is that an LMS is specifically for employees and those companies who see it as an L&D-specific offering (which it is not).
On a personal note, I won’t cover it here because a lot isn’t entirely accurate. And grading? What am I? 10 years old?
I loved the stakeholder’s angle – so personal or, wait, professional. Let’s see our next player.
Google Geminii – This was Bard, but now it is the Gemini Pro version – thus they call it Gemini
Write two paragraphs for a proposal on purchasing a learning management system in a personal and professional tone.
Gemini Results – And yes, it presented it with CAPS -and if you are saying, hey, this grammar is incorrect – blame Gemini – I am just publishing what I published.
Personal Impact:
Imagine a world where learning is just a click away, accessible 24/7, and tailored to your individual pace and needs. A Learning Management System (LMS) would bring this world to life for all of us. It would empower us to explore new skills, expand our knowledge base, and advance our careers at our own convenience. Whether you’re a seasoned professional looking to refresh your skills or a new employee eager to learn the ropes, an LMS would be an invaluable tool for personal and professional growth.
Business Benefits:
From a business perspective, an LMS is not just an investment in employees, it’s an investment in the future of our organization. By streamlining training processes, centralizing learning materials, and providing data-driven insights into employee progress, an LMS can significantly improve efficiency, reduce costs, and foster a culture of continuous learning. This, in turn, translates to a more skilled and engaged workforce, ultimately contributing to increased productivity and achieving our organizational goals.
Reality
Where does this note, the customer’s angle? Or if I am using it for an association? As noted, I never said a specific audience – Gemini, just like our buddy Copilot decided it must be for an employee although Copilot did add students.
Oh, Gemini Ultra has been rebranded. It is now Gemini Advanced, and it is fee-based.
Pro is the freebie.
One other item around Gemini Pro:
Google does present the following before you start to write anything in their prompt:
“Your conversations are processed by human reviewers to improve the technologies powering Gemini Apps. Don’t enter anything you wouldn’t want reviewed or used.”
GPT-4 – from OpenAI (I use the paid version)
In our continuous pursuit of excellence and innovation in education, I am thrilled to propose the acquisition of a state-of-the-art Learning Management System (LMS) for our institution. The integration of such a platform is more than a technological upgrade; it’s a transformative step towards fostering a more engaging, accessible, and personalized learning environment for our students and faculty. By embracing this change, we’re not just keeping pace with educational advancements; we’re positioning ourselves at the forefront, ready to unlock the full potential of our academic community.
From a professional standpoint, the benefits are manifold. An LMS will streamline course management, facilitate seamless communication, and provide invaluable insights through data analytics, allowing us to make informed decisions to enhance educational outcomes. Moreover, it will empower our educators with a suite of tools to create dynamic, interactive content, thus enriching the learning experience. This strategic investment in our infrastructure is a testament to our commitment to excellence and our belief in the transformative power of education. It’s an exciting opportunity to redefine what’s possible in our classrooms and beyond, and I am confident that together, we will usher in a new era of educational innovation and success.
Reality
Educators? Hey, everyone over at L&D or training, congrats. You are now an educator. Make sure you get to class on time to present this week’s lessons. Actually, the entire output is for education. Classrooms? Students and Faculty?
Perplexity.ai
Dear [Recipient’s Name],
I am excited to present a proposal for the purchase of a cutting-edge Learning Management System (LMS) that will revolutionize our educational and training processes. As we strive for excellence in both personal and professional development, investing in a robust LMS will not only streamline our learning programs but also enhance the overall learning experience for our students and employees. With features such as customizable course content, interactive assessments, progress tracking, and seamless communication tools, this LMS will empower us to deliver engaging and effective learning experiences tailored to individual needs.
By adopting this advanced LMS, we can create a dynamic learning environment that fosters continuous growth and skill development. The system’s user-friendly interface and comprehensive analytics will enable us to monitor progress, identify areas for improvement, and adapt our learning strategies accordingly. With the ability to access learning materials anytime, anywhere, our learners can take control of their own development and achieve their personal and professional goals with greater efficiency and effectiveness. Together, let’s embrace this opportunity to elevate our learning initiatives and unlock the full potential of our educational and training programs.
Warm regards,
[Your Name]
Reality
This one hits the nail – if you love to place students with employees and our “educational and training programs.”
Interestingly, nearly all of them include “communication tools.” I assume they are referring to a chat room or forum? Many learning systems, not just an LMS, have it, and there are LMS vendors who have dumped the forum and are slowly removing chat rooms.
Otherwise, I have no clue what a communication tool is within an LMS.
Just for laughs, I tweaked my inquiry to see the outputs:
Write one paragraph on purchasing a learning management system in a snarky tone
GPT-4
Oh, joy, another day, another dollar to be spent on the latest educational fad—this time, a shiny new Learning Management System (LMS). Because, clearly, what our academic life was desperately missing was yet another platform promising to ‘revolutionize’ learning, as if the sheer act of digitizing coursework could magically imbue students with the wisdom of Socrates. Surely, the allure of streamlined course management and ‘interactive’ content will compensate for the hours spent navigating the labyrinth of customer support when the system inevitably decides to take a day off. But fear not, for in this digital Eden, every click, every login, and every midnight submission will lead us to the promised land of educational excellence—or, at the very least, keep us entertained with the illusion of progress.
Gemini Pro
So, you’re ready to ditch the carrier pigeons and transparencies for the thrilling world of Learning Management Systems. Buckle up, buttercup! Get ready for a wild ride filled with confusing demos, feature sets that sound impressive but are utterly useless, and price tags that’ll make your accountant faint. Just remember, the learning curve for purchasing an LMS might be steeper than Mount Everest, but hey, at least your employees will have something engaging to do while you navigate this bureaucratic nightmare.
Perplexity.ai
Well, folks, it’s time to drag ourselves into the 21st century and consider investing in a Learning Management System (LMS) because apparently carrier pigeons and smoke signals aren’t cutting it anymore. With an LMS, we can finally bid farewell to the days of lost paperwork, chaotic training sessions, and the endless hunt for missing course materials. Let’s embrace technology for once and give ourselves a chance to join the ranks of modern organizations that actually know what they’re doing. Who knows, maybe we’ll even manage to impress someone with our newfound tech-savvy ways.
Copilot
Ah, the thrilling quest for a Learning Management System (LMS)—a journey akin to navigating a labyrinth of corporate bureaucracy, where the prize at the end is… well, more bureaucracy. Picture this: you, the valiant decision-maker, armed with spreadsheets and a steely resolve, wade through a sea of vendor websites. Some generously display their pricing like a neon sign in Times Square, while others play coy, whispering, “Contact us for a quote,” as if they’re guarding the secret formula for Coca-Cola. But fear not! You shall decipher the cryptic hieroglyphs of payment models: the elusive Pay-per-Learner, the enigmatic Perpetual Licensing, and the ever-mysterious Subscription Plans. And lo, you shall emerge victorious, clutching your LMS like a grail, ready to embark on the noble quest of… mandatory compliance training. 🏰🍌
The sources they produce are, well, all over the place. But I recognized one line that stood out, “as if they are guarding the secret formula for Coca-Cola.” I know that from somewhere, oh wait, I wrote the guarding the secret formula for Coca-Cola. Wow, I’m famous.
Anyway, Copilot adds a couple of icons at the bottom, which have nothing to do with anything. Maybe a castle game?
What does the Game mean?
Excluding the latter parts of the snarky, the outputs for the personal and professional tone regarding the LMS question differed. Each produced a different outcome.
And therein lies the challenge. None of them were 100% accurate. One produced it in two tones. The others correctly wrote it using both tones in one response.
And if you, the person overseeing L&D or Training, or even HR went to any of these, the probability that you would go to at least Gemini and Copilot and perhaps, let’s say your company is using Enterprise ChatGPT (which is 4), is highly unlikely. You will use one.
Picking out what you want, OR in many cases, just using what is published because of the assumption it is all correct. This is true if you oversee the process without background or knowledge regarding any learning system, such as an LMS.
Some people say employees would never use this scenario, so it doesn’t truly show reality.
I wrote something asking for a summary (assuming the employee knew to stipulate short as part of the wordage). I debated whether it should be written by someone who has never used or slightly used three of the following (I left out perplexity.ai). Most people in their initial stages will inquire at such a level that it does not dig deep enough – think high level, whereas you should go pointed and say specifics.
I need a workflow for Salesforce
Next, I wrote it in this manner (for the other LLMs, I will use the latter here): Create a workflow for Salesforce.
GPT-4
I need a workflow for Salesforce
Output
Implementing an efficient workflow in Salesforce can significantly enhance productivity and ensure that your sales processes are streamlined and effective. Here’s a basic workflow to get you started, which you can customize according to your organization’s specific needs:
- Lead Capture: Begin by setting up web-to-lead forms on your website to automatically capture leads directly into Salesforce. This eliminates manual data entry and ensures no lead falls through the cracks.
- Lead Assignment Rules: Use Salesforce’s lead assignment rules to automatically distribute leads among your sales team based on specific criteria such as geographic location, lead source, or product interest. This ensures that leads are immediately directed to the most appropriate sales rep, speeding up the follow-up process.
- Lead Scoring and Prioritization: Implement a lead scoring system within Salesforce to prioritize leads based on their engagement level, demographic information, and behavior. This helps your sales team focus on leads that are more likely to convert.
- Task Automation: Set up automated tasks for follow-ups, reminders, and other activities. For example, you can create a task for a sales rep to call a lead a certain number of days after the initial contact or after a specific action, like downloading a whitepaper.
- Opportunity Management: Once a lead is qualified, convert it into an opportunity. Customize your opportunity stages to reflect your sales process, and use them to track progress and manage your sales pipeline effectively.
- Email Templates and Sequences: Utilize Salesforce’s email templates and sequences for consistent and efficient communication. Tailor your messaging for different stages of the customer journey to maintain engagement and move leads through the sales funnel.
- Dashboards and Reporting: Leverage Salesforce dashboards and reports to gain insights into your sales activities, pipeline health, conversion rates, and team performance. Use this data to make informed decisions and to continuously refine your sales strategy.
- Integration with Other Tools: Ensure that Salesforce is integrated with your marketing automation platform, customer service software, and any other tools your team uses. This provides a 360-degree view of each customer and streamlines cross-departmental workflows.
- Feedback Loop: Establish a feedback loop where sales reps can provide input on the lead quality and the effectiveness of the sales process. Use this feedback to adjust your lead scoring, assignment rules, and follow-up strategies.
Remember, the key to a successful Salesforce workflow is continuous optimization. Regularly review and adjust your processes as needed to ensure they remain aligned with your sales goals and organizational changes.
Second Statement –
Create a workflow for Salesforce in a short summary
Output
To streamline your sales process in Salesforce, follow this concise workflow:
- Lead Capture: Automatically import leads into Salesforce via web forms, social media, or direct entry.
- Lead Assignment: Use rules to automatically distribute leads among sales reps based on criteria like location or product interest.
- Lead Qualification: Score and prioritize leads based on engagement and fit to focus on high-potential prospects.
- Task Automation: Set up automated tasks for follow-ups and other key sales activities to ensure timely engagement.
- Opportunity Conversion: Convert qualified leads into opportunities, tracking them through customized stages in your sales pipeline.
- Communication Templates: Utilize email templates for consistent and efficient communication throughout the sales cycle.
- Monitoring and Reporting: Use Salesforce dashboards to track sales performance, pipeline health, and activity metrics for informed decision-making.
- Feedback and Optimization: Regularly collect sales team feedback to refine lead management, scoring, and follow-up processes for continuous improvement.
This workflow is designed to maximize efficiency, ensuring that your team focuses on the most promising leads and opportunities, leading to better conversion rates and sales outcomes.
To save your reading time, I just went with Copilot as the other LLM to test out my statement
Create a workflow for Salesforce in a short summary
Certainly! Here’s a concise summary of a Salesforce workflow:
- Trigger Event: A record is created, updated, or deleted in Salesforce.
- Rule Criteria: Define conditions (e.g., field values, record type) that must be met for the workflow to execute.
- Immediate Actions: Perform actions immediately (e.g., field updates, email alerts) based on the rule criteria.
- Time-Dependent Actions: Schedule actions for a future time (e.g., reminders, follow-ups).
- Approval Processes: Route records for approval based on predefined criteria.
- Outbound Messages: Send data to external systems via SOAP or REST API.
- Field Updates: Modify field values dynamically.
- Tasks and Alerts: Assign tasks or send alerts to users.
And there you have it—a Salesforce workflow, where automation dances with data, and users… well, they click “Refresh” and hope for the best. 🚀🔍
You will know whether this information is correct or incorrect for those who use Salesforce.
Finally, one last scenario – Manager Time!
Write an e-mail to my manager asking when we should have our performance review
Copilot
Subject: Performance Review Meeting Schedule
Dear [Manager’s Name],
I hope this email finds you well. As we approach the end of the quarter, I wanted to discuss scheduling our performance review. Could you please let me know your availability for the review? I’m eager to receive feedback and discuss my progress.
Thank you for your attention to this matter.
Best regards, [Your Name]
GPT-4
Subject: Scheduling Our Performance Review
Dear [Manager’s Name],
I hope this message finds you well. As we approach the end of the current review period, I wanted to touch base with you regarding our upcoming performance review. Understanding that these discussions play a crucial role in both personal and professional development, I’m eager to gain insights into my performance and discuss potential areas for growth.
Given your busy schedule, I’d like to propose scheduling our review at a time that’s most convenient for you. I believe this meeting will be a valuable opportunity for constructive feedback and setting clear objectives for the coming period.
Please let me know your available times, and I’ll do my best to accommodate. I’m looking forward to our conversation and am keen on continuing to contribute positively to our team’s goals.
Thank you for your attention to this matter.
Best regards,
[Your Name]
Gemini Pro
Subject: Requesting Performance Review Meeting
Dear [Manager’s Name],
I hope this email finds you well.
I am writing to request a meeting to schedule my upcoming performance review. I am eager to discuss my progress in the role, receive your feedback on my performance, and explore any areas for improvement and development.
Would you be available sometime in the next [suggested timeframe, e.g., two weeks] to schedule our review meeting? I am flexible with my schedule and happy to adapt to your availability.
Please let me know what time works best for you. In the meantime, if there is any information you would like me to prepare before the meeting, please do not hesitate to let me know.
Thank you for your time and consideration.
Best regards,
[Your Name]
Lastly, I decided to retest GPT-4 to see if it would produce the same results.
The first time I re-asked the question, GPT-4 did not respond. I had to ask it once again.
Subject: Request to Schedule Performance Review Meeting
Dear [Manager’s Name],
I hope this email finds you in good spirits. As we’re moving forward in the year, I realized that we haven’t yet scheduled our annual performance review. I’m keen on receiving your feedback and discussing my contributions and areas for improvement, as these insights are invaluable for my professional growth and alignment with our team’s objectives.
Could you kindly suggest a convenient time for you in the coming weeks? I’m flexible and willing to adjust my schedule to ensure we can have this important discussion.
Thank you very much for your consideration. I’m looking forward to our meeting and to continuing to advance our team’s success.
Warm regards,
[Your Name]
Compare them. What do you realize right away? If you say differently – you are 100% correct. Again, I have to ask those in L&D or training who are hopefully creating content or materials on AI with employees. Do you explain that results may vary?
For those who are seeing this for the first time, i.e., repeating the question, were you surprised to see the results and the differences? What about when GPT-4 failed to respond when I asked the same question as prior, and thus, I had to ask it again?
Bottom Line
The presumption that AI in the Workforce is running smoothly or is already at the productivity stage for your company, association or organization – isn’t presenting an accurate story.
Even for those in L&D, Training, etc., where you are seeking the LMS proposal angle, the results vary widely, and each produces erroneous information.
Toss in the learning system vendors and learning tech vendors and wonder whether they are aware of the variance of responses if they are using, say, GPT-4 or whatever LLM that is outputting information.
What is their strategy? How do they address this?
My guess – by doing nothing.
Because ignorance for some companies is bliss.
For others, it isn’t ignorance,
It is just not knowing.
E-Learning 24/7