In arxiv.org/abs/2303.00848, @dpkingma.bsky.social and @ruiqigao.bsky.social had suggested that noise augmentation could be used to make other likelihood-based models optimise perceptually weighted losses, like diffusion models do. So cool to see this working well in practice!

Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation

To achieve the highest perceptual quality, state-of-the-art diffusion models are optimized with objectives that typically look very different from the maximum likelihood and the Evidence Lower Bound (...

arxiv.org

Michael Tschannen@mtschannen.bsky.social · 2y ago

Have you ever wondered how to train an autoregressive generative transformer on text and raw pixels, without a pretrained visual tokenizer (e.g. VQ-VAE)? We have been pondering this during summer and developed a new model: JetFormer 🌊🤖 arxiv.org/abs/2411.19722 A thread 👇 1/

It's 2024 and microwave ovens still heat food unevenly. I need a phased array microwave oven that warms food evenly, adaptively. Who is building this?

I don't usually talk about politics, but if I could change one thing in the US democracy, it might be replacing winner-takes-all representation with proportional representation. Would fix a lot of issues. Agree or disagree that this would be a net positive change?