Tech companies have been promising that online shopping or booking a hotel can soon be handled by AI. Just tell it the different standards you're setting and to pick the cheapest price, and off you go. We've seen agentic AI spectacularly fail; email inboxes cleared out, databases and hard drives deleted, and more. Where a few might really be down to hallucination or inexplicable actions, others have also happened due to vague instructions, no safeguards, no confirmations and too many permissions/too broad access. Still, this clearly needs to be refined before the general public, especially less tech savvy folks, intellectually disabled members of our communities, or children use it. Who's on the hook if the bot buys into a scam product, or if it agrees to buy 500 live ducks on your behalf, when you just wanted to order a bathtub duck? When websites will be optimized around how a bot navigates and crawls it, will we have dark patterns ("consent optimization") for bots? Compared to…
No comments yet. Log in to reply on the Fediverse. Comments will appear here.