Anthropic study: 'Judging the Judges' benchmarks 9 debiasing strategies for LLM-as-a-Judge

Anthropic researchers benchmarked nine debiasing strategies across five judge models from Google, Anthropic, OpenAI, and Meta, exposing systematic biases that compromise the reliability of LLM-as-a-Judge evaluation pipelines.