Coding agents are evaluated with unit tests: more tests passed = better model. But if tests or feedback are accessible, models may learn to game them. We introduce CapCode to detect suspiciously high scores, and CapReward to discourage them during RL. 🧵1/10
skythanawat.bsky.social
@skythanawat.bsky.social
machine learning https://skydddoogg.github.io/