Other2026-05-17
SOOHAK math benchmark: AI confidently solves problems with no solution

AI Analysis
A consortium of 64 mathematicians built SOOHAK, a benchmark of 439 handwritten tasks including 99 deliberately unsolvable. Gemini 3 Pro leads research problems at 30%, but no model exceeds 50% on detecting broken tasks — more compute doesn't help models admit when a problem has no answer.