1/5 The case for diffusion language models: "A lot of the [early] gains in language modeling performance have come from scaling pre-training...[the training algorithm] was designed to be very parallelizable across GPUs," said @volokuleshov of @Cornell at the Simons Institute