If I had to bet on LLM infrastructure impact, this might become the most important paper from my lab. This ICLR paper intrinsically parallelizes language models, building on ideas from normalizing flows. 🚀
LLMs are autoregressive and slow? No! Parallel Token Prediction decodes multiple consistent tokens in one model call. PTP allows arbitrary dependencies in one call, unlike discrete diffusion. Practical: 2.4x speedup github.com/mandt-lab/ptp ICLR: Apr 23, morning poster P3-#608