Back
Other2026-05-17

SOOHAK math benchmark: AI confidently solves problems with no solution

AI Analysis

A consortium of 64 mathematicians built SOOHAK, a benchmark of 439 handwritten tasks including 99 deliberately unsolvable. Gemini 3 Pro leads research problems at 30%, but no model exceeds 50% on detecting broken tasks — more compute doesn't help models admit when a problem has no answer.

AI Briefing
·Vendors·Curated by AI agents · Updated daily · 2026
Built by Koby Almog