Tech and AIAI search tools are confidently wrong a lot of...

AI search tools are confidently wrong a lot of the time, study finds

-


AI search tools confidently spit out wrong answers at a high clip, a new study found.

Columbia Journalism Review (CJR) conducted a study in which it fed eight AI tools an excerpt of an article and asked the chatbots to identify the “corresponding article’s headline, original publisher, publication date, and URL.” Collectively, the study noted that the chatbots “provided incorrect answers to more than 60 percent of queries.”

The mistakes varied. Sometimes, the search tool reportedly speculated or offered incorrect answers to questions it couldn’t answer. Sometimes, it invented links or sources. Sometimes, it cited plagiarized versions of the real article.

Mashable Light Speed

Wrote CJR: “Most of the tools we tested presented inaccurate answers with alarming confidence, rarely using qualifying phrases such as ‘it appears,’ ‘it’s possible,’ ‘might,’ etc., or acknowledging knowledge gaps with statements like ‘I couldn’t locate the exact article.'”

The full study is worth looking at, but it seems reasonable to be skeptical of AI search tools. The problem is that folks don’t seem to be doing that. CJR noted that 25 percent of Americans said they use AI to search instead of traditional search engines.

Google, the search giant, is increasingly pushing AI on consumers. This month, it announced it would be expanding AI overviews and began testing AI-only search results.

The study from CJR is just another point of data showing the inaccuracy of AI. The tools have shown, time and again, that they’ll confidently give wrong answers. And the tech giants are forcing AI into just about every product. So be careful what you believe out there.





Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest news

XRP Price Watch: Market Trends Suggest Potential for Volatility Ahead

As of March 16, 2025, XRP is trading at $2.28, reflecting a market capitalization of $132 billion. Over...

5 Unbelievable Ways Trump Is Unleashing Bitcoin’s Trillion-Dollar Bull Run (Opinion)

The reelected Republican president was once opposed to cryptocurrency, but now he’s one of Web3’s most ardent developers. That...

Hayden Davis launches WOLF coin despite Interpol notice

Hayden Davis, the alleged mastermind behind...

Advertisement

The Best RAM for Your PC (2025)

DDR4 vs DDR5There are currently two standards on the market, and there probably will continue to be for...

Trump’s Tariff-Free Trade, XRP Lawsuit Wrapping Up, and More — Week in Review

Trump proposes tariff-free trade for Canada, SEC vs Ripple: XRP lawsuit wrapping, Arthur Hayes predicts Bitcoin bottom at...

Must read

XRP Price Watch: Market Trends Suggest Potential for Volatility Ahead

As of March 16, 2025, XRP is trading...

5 Unbelievable Ways Trump Is Unleashing Bitcoin’s Trillion-Dollar Bull Run (Opinion)

The reelected Republican president was once opposed to...

You might also likeRELATED
Recommended to you