JB on X: “If a model’s inference is closer to the inference speed it had during …”

A fast, private reader for public X posts. No account, no tracking, no pop-ups.

PeekX is an independent tool and is not affiliated with, endorsed by or sponsored by X Corp. “X” and “Twitter” are trademarks of their respective owners. We only show posts that their authors made public and never access private or protected accounts. Downloaded media belongs to its creators — please respect their rights.

JB on X: “If a model’s inference is closer to the inference speed it had during …” | PeekX

Username or post link

Home / @JasonBotterill / Post

@JasonBotterill

If a model’s inference is closer to the inference speed it had during RL does it actually perform better? Like for retarded reasons like the system time between each tool use was probably a heuristic the model picked up during its rollouts.