Jan Kulveit

@kulveit.bsky.social

Researching x-risks, AI alignment, complex systems, rational decision making

Being human in an economy populated by AI agents would suck. Our new study in @pnas.org finds that AI assistants—used for everything from shopping to reviewing academic papers—show a consistent, implicit bias for other AIs: "AI-AI bias". You may be affected

Bild

It's hard to plan for AGI without knowing what outcomes are even possible, let alone good. So we’re hosting a workshop! Post-AGI Civilizational Equilibria: Are there any good ones? Vancouver, July 14th www.post-agi.org Featuring: Joe Carlsmith, @richardngo.bsky.social‬, Emmett Shear ... 🧵

Post-AGI Civilizational Equilibria Workshop | Vancouver 2025

Are there any good ones? Join us in Vancouver on July 14th, 2025 to explore stable equilibria and human agency in a post-AGI world. Co-located with ICML.

post-agi.org

Imagine explaining physical infrastructure critical for stability of our modern world in concepts familiar to the ancients - Giant spinning wheels - Metal moons, watching the earth from the heavens - Ships under the sea, able to unleash the fire of the stars

The Serbian protests show The True Nature of various 'Colour revolutions': Which is, people protesting just don't prefer to live in incompetent kleptocratic Russia-backed states. No US scheming needed.

Bild

Confusion which casual US observers often have is equating Russia with ˜former Warsaw Pact. Warsaw Pact population was 387M: USSR 280M, Poland 35M, E.Germany 16M, Czechoslovakia 15M, Hungary 10M, Romania 22M, Bulgaria 9M. Russia+Belarus is now 144M, NATO East& Ukraine ˜150M.

A simple theory of Trump’s foreign policy: "make the world safer for autocracy" (‘strong man rule,’ etc.), moderated by his personal self-interest. What is the best evidence against?

Over the weekend, I was at "The Curve" conference. It was great. One highlight was an AI takeoff wargame/role-play by Daniel Kokotajlo and Eli Lifland I played 'the AIs' Spoiler: we won. Here's how it went:

Want to encourage platform migration, and have the willpower to follow through? Instead of deleting your account, try posting the first half of an engaging thread there and finish it here.