Google promised its new artificial intelligence search tools would “do the work for you” and make finding information online quicker and easier. But just days after the launch, the company is already walking back some factually incorrect results.
Google earlier this month introduced an AI-generated search results overview tool, which summarizes search results so that users don’t have to click through multiple links to get quick answers to their questions. But the feature came under fire this week after it provided false or misleading information to some users’ questions.
For example, several users posted on X that Google’s AI summary said that former President Barack Obama is a Muslim, a common misconception. In fact, Obama is a Christian. Another user posted that a Google AI summary said that “none of Africa’s 54 recognized countries start with the letter ‘K’” — clearly forgetting Kenya.
Google confirmed to CNN on Friday that the AI overviews for both queries had been removed for violating the company’s policies.
“The vast majority of AI Overviews provide high quality information, with links to dig deeper on the web,” Google spokesperson Colette Garcia said in a statement, adding that some other viral examples of Google AI flubs appear to have been manipulated images. “We conducted extensive testing before launching this new experience, and as with other features we’ve launched in Search, we appreciate the feedback. We’re taking swift action where appropriate under our content policies.”
The bottom of each Google AI search overview acknowledges that “generative AI is experimental.” And the company says it conducts testing designed to imitate potential bad actors in an effort to prevent false or low-quality results from showing up in AI summaries.