A chatbot used by Air Canada hallucinated an inaccurate bereavement discount policy, and a customer who flew based on this information sued the company over being misled. The small claims court sided with the deceived customer, arguing that the chatbot was acting as an official agent of Air Canada, and that there was no reason a customer should have to double check resources from one part of the Air Canada website against different parts of the same website.
This was inevitable and will instantly kill AI chatbots. I tried to explain this to my marketing team when they were all excited about an AI chatbot on our company website. Wonder if this will change their tune
will instantly kill AI chatbots
This case may have cost the airline a few grand. Sure you’ll get a few losses like this (but many more situations where the customer just eats it), but if the cost savings of the chatbot are enough…
According to Air Canada, Moffatt never should have trusted the chatbot and the airline should not be liable for the chatbot’s misleading information because Air Canada essentially argued that “the chatbot is a separate legal entity that is responsible for its own actions,” a court order said.
Prepare for more of that, applied to weaponized drones
Oh that wedding? The drone just did that sorry
Actually the human AI helper making $1/h has legal responsility for that strike
Is this how we also give AiChatbots personhood by accident?
It’s not a “hallucination” you dorks it’s a random number generator that you used to replace labor.
Yeah why is it a “hallucination” when the AI just makes shit up, but when a person does it they’re either lying or just plain wrong.
I didn’t lie on my tax returns it was a hallucination due to poorly curated traing matieral.
Because the person knows and the AI is dumb as dirt
I like to call it a hallucination, because while yes the thing isn’t smart enough to experience thoughts, it really gets at how absolutely unreliable these things are. People are talking to the thing and taking it seriously, and it’s just watching the pink dragons circle around
Idea: how about we replace all our typists with a bunch of monkeys? They’ll eventually type the right thing!
I remember a state recently passed a law barring lawyers from using AI programs to generate legal documents, and this right here is why. Remove the possibility of lawyers appealing to “well it’s not our fault the document is wrong, the AI did it!”
I heard about someone doing that from Leonard French. Some old boomer thought the AI could actually search for court cases, ended up getting tricked into citing a bunch of non-existent caselaw and got into a lot of trouble.
I’m wishing so hard it was a Sovereign Citizen…
The OG chatbot
I extremely approve of describing everything AI does as hallucinations, dreaming, etc
HAHAHAHAHAH fucking amazing
