After finishing my papers for my PhD, I spent some time exploring new directions. I ended up working on Diffusion Language Models with @haoyuhe.bsky.social (he made it work 🚀), @yongcao.bsky.social, @andreasgeiger.bsky.social. I learned a lot of new things and I am very excited about the results. 🥳
MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
Diffusion language models, as a promising alternative to traditional autoregressive (AR) models, enable faster generation and richer conditioning on bidirectional context. However, they suffer from a ...
arxiv.org
🚀 Introducing our new paper, MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models. 📄 Paper: www.scholar-inbox.com/papers/He202... arxiv.org/pdf/2508.13148 💻 Code: github.com/autonomousvi... 🌐 Project Page: cli212.github.io/MDPO/