Pieter-Jan Hoedt

@hoedt.bsky.social

Not sure yet...

1/5 🚀 Introducing TiRex-2 — our next-generation time series foundation model. Time series forecasting in the real world is streaming: • new observations continuously arrive, • variables interact, • some covariates are known into the future, • models must update predictions efficiently.

Comparison of sub-quadratic architectures xLSTM, Mamba-2, and Gated DeltaNet: arxiv.org/abs/2606.12364 Comparison of xLSTM, Mamba-2, and Gated DeltaNet on code pre-training, distillation, and time-series. xLSTM outperforms the others due to its gating scheme and state tracking.

Bild

We unlocked the working memory of LLMs 💥 Reasoning in Memory (RiM) replaces autoregressive "thinking out loud" with fixed memory blocks that form a task-specific workspace for latent reasoning. The key idea is simple: reasoning should happen inside the LLM, not in its output!