Kai Sandbrink

@ackaisa.bsky.social

Computational cognitive neuroscience PhD Student, Oxford & EPFL

Reward models (RMs) are the moral compass of LLMs – but no one has x-rayed them at scale. We just ran the first exhaustive analysis of 10 leading RMs, and the results were...eye-opening. Wild disagreement, base-model imprint, identity-term bias, mere-exposure quirks & more: 🧵

Bild