Next YC Paper Club: Inference

Inference is no longer just: y = model.forward(x)

It has now become as complex and important as training. The difference between naive inference and well tuned could be 100X in latency and cost. So we gather some of the best researchers on SOTA