Value-based RL matters for robot policies because we can't condition on everything, at training time or at inference time. Conditioning picks from what's in the data; a value function can find something better. QF3 shows efficient behaviors emerging in manipulation from simple