Yağız Çalık on X: “Most generated tasks don't work. DeepSeek-V4-Pro wrote 66k candidates …”

A fast, private reader for public X posts. No account, no tracking, no pop-ups.

PeekX is an independent tool and is not affiliated with, endorsed by or sponsored by X Corp. “X” and “Twitter” are trademarks of their respective owners. We only show posts that their authors made public and never access private or protected accounts. Downloaded media belongs to its creators — please respect their rights.

Yağız Çalık on X: “Most generated tasks don't work. DeepSeek-V4-Pro wrote 66k candidates …” | PeekX

Username or post link

Home / @Weyaxi / Post

Yağız Çalık

@Weyaxi

Oct 8

We're releasing TermGrade at @aiand_: high-quality RL environments for terminal agents, fully open source, along with the full story of how we built and graded them, and the RL recipe we trained with.

That's 1k executable environments, each verified by execution and graded

0:09

33 45 311

Yağız Çalık

@Weyaxi

Replying to @Weyaxi

Most generated tasks don't work. DeepSeek-V4-Pro wrote 66k candidates and only 1.5% made it in: a task counts only if its own reference solution passes its own tests, offline, inside the built image.

Tests average ~16 named assertions, so a failure names exactly what broke.

0:10

Oct 8, 2026, 5:20 PM UTC

1 13

Download media

Every quality X serves, straight from X's media CDN. No watermark, no wait.

674pBEST

Video · 1200×674 · 0:10

360p

Video · 640×360 · 0:10

270p

Video · 480×270 · 0:10

Audio · MP3

0:10 ·

Save & share

Turn this post into a clean image, or copy it as text or Markdown.

Open on X