AI hallucinations are nothing new, but a recent investigation found that Google's AI Overviews search results have an accuracy rate of 90%. Although that's a high margin, it also means tens of millions of search results every hour are potentially flat-out wrong.

A report from The New York Times and AI startup Oumi found that one in 10 Google queries produced at least one summary with incorrect information, and in half of the cases where information was correct, there was a link to a source that didn't support the summary's claims.

Things have improved, but not by much. Oumi's analysis found that of the 4,326 searches conducted in October 2025, Gemini 2 produced accurate responses around 85% of the time. In February, when the same test was conducted using Gemini 3, accuracy improved to 91%.

Summary sourcing, however, degraded with Gemini 3. Oumi's data suggests that Gemini 2 produced erroneous source links 37% of the time last year, but now does it more than 56% of the time in 2026. Oumi suggests this may be because two of the most commonly cited sources by Gemini's AI summaries are Facebook and Reddit.