Monday, March 4, 2024
HomeStartupGoogle's and Microsoft's chatbots are making up Tremendous Bowl stats

Google’s and Microsoft’s chatbots are making up Tremendous Bowl stats


In case you wanted extra proof that GenAI is susceptible to creating stuff up, Google’s Gemini chatbot, previously Bard, thinks that the 2024 Tremendous Bowl already occurred. It even has the (fictional) statistics to again it up.

Per a Reddit thread, Gemini, powered by Google’s GenAI fashions of the identical title, is answering questions on Tremendous Bowl LVIII as if the sport wrapped up yesterday — or weeks earlier than. Like many bookmakers, it appears to favor the Chiefs over the 49ers (sorry, San Francisco followers).

Gemini ornaments fairly creatively, in no less than one case giving a participant stats breakdown suggesting Kansas Chief quarterback Patrick Mahomes ran 286 yards for 2 touchdowns and an interception versus Brock Purdy’s 253 working yards and one landing.

It’s not simply Gemini. Microsoft’s Copilot chatbot, too, insists the sport ended and supplies misguided citations to again up the declare. However — maybe reflecting a San Francisco bias! — it says the 49ers, not the Chiefs, emerged victorious “with a remaining rating of 24-21.”

Copilot Super Bowl

Picture Credit: Kyle Wiggers / TechCrunch

It’s all moderately foolish — and presumably resolved by now, on condition that this reporter had no luck replicating the Gemini responses within the Reddit thread. (I’d be shocked if Microsoft wasn’t engaged on a repair as effectively.) Nevertheless it additionally illustrates the foremost limitations of at this time’s GenAI — and the risks of putting an excessive amount of belief in it.

GenAI fashions don’t have any actual intelligence. Fed an infinite variety of examples often sourced from the general public internet, AI fashions learn the way seemingly knowledge (e.g. textual content) is to happen based mostly on patterns, together with the context of any surrounding knowledge.

This probability-based strategy works remarkably effectively at scale. However whereas the vary of phrases and their chances are seemingly to lead to textual content that is smart, it’s removed from sure. LLMs can generate one thing that’s grammatically right however nonsensical, for example — just like the declare in regards to the Golden Gate. Or they will spout mistruths, propagating inaccuracies of their coaching knowledge. 

It’s not malicious on the LLMs’ half. They don’t have malice, and the ideas of true and false are meaningless to them. They’ve merely realized to affiliate sure phrases or phrases with sure ideas, even when these associations aren’t correct.

Therefore Gemini’s and Copilot’s Tremendous Bowl falsehoods.

Google and Microsoft, like most GenAI distributors, readily acknowledge that their GenAI apps aren’t good and are, in actual fact, susceptible to creating errors. However these acknowledgements come within the type of small print I’d argue might simply be missed.

Tremendous Bowl disinformation actually isn’t probably the most dangerous instance of GenAI going off the rails. That distinction in all probability lies with endorsing torture, reinforcing ethnic and racial stereotypes or writing convincingly about conspiracy theories. It’s, nonetheless, a helpful reminder to double-check statements from GenAI bots. There’s an honest probability they’re not true.

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments