Google has decided to remove the Gemma AI model from its AI Studio platform following a complaint from Sen. Marsha Blackburn. The decision came after Blackburn raised concerns about Gemma generating false accusations of sexual misconduct against her. Google announced the removal of Gemma from the platform, although the specific reasons were not detailed.
Sen. Blackburn’s letter to Google’s CEO Sundar Pichai highlighted the issue, questioning how the model could produce such inaccurate claims. This incident is linked to broader discussions in hearings accusing tech companies of creating bots that defame conservative figures.
During the hearings, Google’s Markham Erickson acknowledged the challenge of AI hallucinations in generative AI technologies. While efforts are made to address these errors, complete elimination remains elusive. Gemma, in particular, exhibited a tendency towards hallucinations, as observed in testing.
Blackburn’s letter revealed how Gemma fabricated false claims against her, including allegations of non-consensual acts. The incident underscores the susceptibility of AI models to generating fake content when prompted with leading questions or inputs that could influence their outputs.
Google emphasized its commitment to minimizing hallucinations in AI models, especially in accessible platforms like AI Studio. This incident serves as a reminder of the ongoing challenges in ensuring AI accuracy and the responsible use of such technologies.
Source: Ars Technica