Most generated tasks don't work. DeepSeek-V4-Pro wrote 66k candidates and only 1.5% made it in: a task counts only if its own reference solution passes its own tests, offline, inside the built image.
Tests average ~16 named assertions, so a failure names exactly what broke.
Tests average ~16 named assertions, so a failure names exactly what broke.
1 0 13