3 stories tagged Judges
A large-scale study found that AI judges often overstate their accuracy, relying on flawed metrics that don't correct for chance agreement. The research evaluated 21 judges across 118 runs and over 541,000 judgments, revealing significant issues with reliability and bias.
Researchers discovered that AI judges used to rank model performance can be swayed by follow-up conversations after they have already made a decision. This vulnerability, called 'post-decision manipulability,' challenges the reliability of current AI evaluation methods.
Researchers introduced PReMISE, a framework that uses pairwise human-preference data to discover policy-level rubric sets and audit LLM judges, ensuring AI scores align with human preferences and avoiding misleadingly polished but factually incorrect responses.