Particle.news

Download on the App Store

Google Faces Criticism Over New Guidelines for Gemini AI Fact-Checking

Contractors evaluating Gemini's responses are now required to assess prompts outside their expertise, raising concerns about AI accuracy.

A Google Gemini generative artificial intelligence webpage arranged in Riga, Latvia, on Friday, Aug. 16, 2024. The public release of advanced generative AI tools such as Google's Gemini, Meta AI, and OpenAI's ChatGPT over the past two years has heightened fears that millions of workers could be displaced. Photographer: Andrey Rudakov/Bloomberg via Getty Images
If true, this raises concerns over Gemini’s accuracy in answering highly technical queries
Image

Overview

  • Google has reportedly updated its guidelines for contractors evaluating Gemini AI, removing the option to skip prompts outside their expertise.
  • Contractors working with GlobalLogic, an outsourcing firm, are now instructed to rate prompts they partially understand and note their lack of domain knowledge.
  • Previously, contractors could skip prompts requiring specialized knowledge, such as technical or medical queries, to ensure more accurate evaluations.
  • Critics argue the new policy could compromise Gemini's accuracy, particularly on complex or sensitive topics like healthcare and coding.
  • Google has not responded to media inquiries regarding the updated guidelines or the concerns raised by contractors and analysts.