Wish LM could plan—not just guess the next word? TRACE lets LM see all endings before each move. – Global control at inference time – Tractable lookahead via an HMM LM-proxy – Linear classifier per constraint Outperform RL, DPO, FUDGE—at just +20% decoding over base LM. #ICML2025 @guyvdb.bsky.social