Carlo Sferrazza
@carlo_sferrazza
Turns out the FastTD3 recipe transfers really well to flow policies, and you keep all their benefits. Check out QF3, the new algorithm @ChungMinKim developed during her internship at FAR!
Chung Min Kim@ChungMinKim · Oct 6Excited to introduce QF3: Fast Flow RL with Filtered Q-Gradients!
Train humanoids from scratch, fine-tune VLAs, even fine-tune image models... all with one simple off-policy update ✨
Train humanoids from scratch, fine-tune VLAs, even fine-tune image models... all with one simple off-policy update ✨
1:05 3 54