This looks awesome! We need benchmarks that consider coordination between agents. Also super cool to see cross comparison between LLM/ VLM and MARL agents! Congrats to @kale-ab.bsky.social & co. 👏

Kale-ab Tessera@kale-ab.bsky.social · 3w ago

Can LLM agents coordinate in long-horizon, open-ended worlds? We test 13 LLMs in Alem, a new benchmark. Most struggle, averaging ~6% normalised return. Yet on Hard, zero-shot Gemini 3.1 Pro matches the best MARL agent after 1B training steps. Our ablations show communication matters most. 🧵

At @icmlconf.bsky.social and still some energy left? If you’re interested in imitation learning/ world action models, checkout our poster this afternoon 2:30pm where we explain - theoretically and empirically - how future modelling introduces an explicit trade off that can improve performance! 👇

Lukas Schäfer@lukaschaefer.bsky.social · last mo.

I will be at @icmlconf.bsky.social in Seoul over the next week - first time in South Korea and at ICML so looking forward to an exciting week! I'll be co-presenting our work on PIDMs for offline imitation learning - Poster Session 7 - Hall A #304 - Thu, Jul 9 at 2:30pm - details 👇 See you there!

I will be at @icmlconf.bsky.social in Seoul over the next week - first time in South Korea and at ICML so looking forward to an exciting week! I'll be co-presenting our work on PIDMs for offline imitation learning - Poster Session 7 - Hall A #304 - Thu, Jul 9 at 2:30pm - details 👇 See you there!

Lukas Schäfer@lukaschaefer.bsky.social · 6mo ago

Super excited to be able to share more about this project! At MSR, we have looked into PIDMs as alternative architectures for imitation learning to understand when and why they offer promise! Learn more at the blog post: msft.it/6047QMkd3 and the arXiv preprint: arxiv.org/abs/2601.21718

Super excited to be able to share more about this project! At MSR, we have looked into PIDMs as alternative architectures for imitation learning to understand when and why they offer promise! Learn more at the blog post: msft.it/6047QMkd3 and the arXiv preprint: arxiv.org/abs/2601.21718

Rethinking imitation learning with Predictive Inverse Dynamics Models

This research looks at why Predictive Inverse Dynamics Models often outperform standard Behavior Cloning in imitation learning. By using simple predictions of what happens next, PIDMs reduce ambiguity...

msft.it

Microsoft Research@msftresearch.bsky.social · 6mo ago

This research looks at why Predictive Inverse Dynamics Models often outperform standard Behavior Cloning in imitation learning. By using simple predictions of what happens next, PIDMs reduce ambiguity and learn from far fewer demonstrations. Learn more: msft.it/6018QMkdO

I'll be giving a talk at Cohere Labs about my research on decision making agents and world models at Microsoft Research! 📅 January 20th (Tomorrow!) 5pm GMT/ 6pm CET/ 9am PST 📍 Online (link below) Everyone is welcome! Link via calendar invite and more details: cohere.com/events/coher...

Cohere Labs - Lukas Schäfer, Postdoc Researcher, Microsoft Research

Cohere Labs - Lukas Schäfer - Decision-Making in Modern Video Games: From Human Play to World Models

cohere.com

It’s a wrap for me. Thanks a lot to the organisers for putting #EurIPS together, it’s been a fantastic week and one of my favourite conference experiences. Looking forward to seeing how this experiment will continue!🤞

📣We're hiring new research interns for 2026 at MSR Cambridge! If you're interested in ML research (esp. generative AI and/ or decision making agents), please consider applying. It's a great collaborative environment with a very kind and capable team! apply.careers.microsoft.com/careers/job/...

Research Intern - Machine Learning - People Centric AI | Microsoft Careers

In collaboration with your mentor and a diverse team, contribute to solving an ambitious research challenge and translate your results into actionable insights that are relevant to potential applicati...

apply.careers.microsoft.com

I'm in Copenhagen for #EurIPS this week, please reach out if you'd like to chat about decision-making research! I'm also on the academic job market for assistant professorship positions in Europe - if you believe I could be a good fit, please reach out, I'd love to connect and chat over☕!

Thrilled to present HyperMARL at #NeurIPS2025 in San Diego next week! 🚀 (Amos will present at @euripsconf.bsky.social too.) TL;DR: Coupling obs and agent IDs can hurt performance in MARL. Agent-conditioned hypernets cleanly decouple grads and enable specialisation. 📜: arxiv.org/abs/2412.04233

Kale-ab Tessera@kale-ab.bsky.social · last yr.

📜🤖 Can a shared multi-agent RL policy support both specialised & homogeneous team behaviours -- without changing the learning objective, requiring preset diversity levels or sequential updates? Our preprint “𝘏𝘺𝘱𝘦𝘳𝘔𝘈𝘙𝘓: 𝘈𝘥𝘢𝘱𝘵𝘪𝘷𝘦 𝘏𝘺𝘱𝘦𝘳𝘯𝘦𝘵𝘸𝘰𝘳𝘬𝘴 𝘧𝘰𝘳 𝘔𝘶𝘭𝘵𝘪-𝘈𝘨𝘦𝘯𝘵 𝘙𝘓” explores this!

It was great to visit @sheffielduni.bsky.social today to give an invited talk on work from my PostDoc at MSR, and have a chance to talk to students and faculty at the CS department. Thanks a lot to Robert Loftin for the kind invitation and for hosting me!

🇨🇦 Heading to @rl-conference.bsky.social next week to present HyperMARL (@cocomarl-workshop.bsky.social) and Remember Markov (Finding The Frame Workshop). If you are around, hmu, happy to chat about Multi-Agent Systems (MARL, agentic systems), open-endedness, environments, or anything related! 🎉

Kale-ab Tessera@kale-ab.bsky.social · last yr.

📜🤖 Can a shared multi-agent RL policy support both specialised & homogeneous team behaviours -- without changing the learning objective, requiring preset diversity levels or sequential updates? Our preprint “𝘏𝘺𝘱𝘦𝘳𝘔𝘈𝘙𝘓: 𝘈𝘥𝘢𝘱𝘵𝘪𝘷𝘦 𝘏𝘺𝘱𝘦𝘳𝘯𝘦𝘵𝘸𝘰𝘳𝘬𝘴 𝘧𝘰𝘳 𝘔𝘶𝘭𝘵𝘪-𝘈𝘨𝘦𝘯𝘵 𝘙𝘓” explores this!

Will be at ICML and looking to hire a postdoc to help us scale up and deploy RL in self-driving. So, hit me up to chat.

The Edinburgh RL Reading group is back with a fresh new website 👏 Anyone is welcome to attend!

RL & Agents Reading Group@rl-agents-rg.bsky.social · last yr.

Hello world! This is the RL & Agents Reading Group We organise regular meetings to discuss recent papers in Reinforcement Learning (RL), Multi-Agent RL and related areas (open-ended learning, LLM agents, robotics, etc). Meetings take place online and are open to everyone 😊

Eugene is awesome! — if you are interested in autonomous driving and RL, and New York sounds like an exciting place for a postdoc then this is an amazing opportunity! 👇

Eugene Vinitsky 🍒@eugenevinitsky.bsky.social · last yr.

Hiring a postdoc to scale up and deploy RL-based planning onto some self-driving cars! We'll be building on arxiv.org/abs/2502.03349 and learn what the limits and challenges of RL planning are. Shoot me a message if interested and help spread the word please! Full posting to come in a bit.

Hiring a postdoc to scale up and deploy RL-based planning onto some self-driving cars! We'll be building on arxiv.org/abs/2502.03349 and learn what the limits and challenges of RL planning are. Shoot me a message if interested and help spread the word please! Full posting to come in a bit.

Robust Autonomy Emerges from Self-Play

Self-play has powered breakthroughs in two-player and multi-player games. Here we show that self-play is a surprisingly effective strategy in another domain. We show that robust and naturalistic drivi...

arxiv.org

Our textbook “Multi-Agent Reinforcement Learning: Foundations and Modern Approaches” has sold out! Another print round with minor corrections is in production with @mitpress.bsky.social and coming 👏 An errata of these corrections and the updated book PDF can already be found at www.marl-book.com

Lukas Schäfer@lukaschaefer.bsky.social · 2y ago

📚🧵1/7 It is finally here!! Only one more week until the print release of our textbook “Multi-Agent Reinforcement Learning: Foundations and Modern Approaches” with @mitpress.bsky.social! What you get, why you should be interested and more, all below in a short 🧵👇

📜🤖 Can a shared multi-agent RL policy support both specialised & homogeneous team behaviours -- without changing the learning objective, requiring preset diversity levels or sequential updates? Our preprint “𝘏𝘺𝘱𝘦𝘳𝘔𝘈𝘙𝘓: 𝘈𝘥𝘢𝘱𝘵𝘪𝘷𝘦 𝘏𝘺𝘱𝘦𝘳𝘯𝘦𝘵𝘸𝘰𝘳𝘬𝘴 𝘧𝘰𝘳 𝘔𝘶𝘭𝘵𝘪-𝘈𝘨𝘦𝘯𝘵 𝘙𝘓” explores this!

Today, I’ll be presenting our work on exploration in MARL using ensembles here! 👇 Multiagent Learning Session Where: Ambassador Ballroom 1 & 2 When: 14:00 - 14:13 I’ll also present the poster later at the Learn track of the poster session at 15:45 - 16:30

Lukas Schäfer@lukaschaefer.bsky.social · last yr.

At the main conference, I'll be presenting our work on using ensembles of value functions for multi-agent exploration! I'll be presenting the oral at the Multi-agent Learning 1 session on Wednesday (2:00 - 3:45pm), and the poster after 3:45pm! Paper: arxiv.org/abs/2302.03439

On my way to Detroit for @aamasconf.bsky.social! Looking forward to presenting the last work from my PhD at the main conference, and work from @msftresearch.bsky.social at the Adaptive and Learning Agents Workshop. More info 👇 If you'd like to chat, feel free to DM me!

We are making available an experimental and interactive real-time gameplay experience in Copilot Labs, powered by our Muse family of world models. Learn more about the research underpinning this experience: www.microsoft.com/en-us/resear...

WHAMM! Real-time world modelling of interactive environments. - Microsoft Research

Today we are making available an interactive real-time gameplay experience in Copilot Labs, powered by our Muse family of world models. This blog post provides a deeper look at the research underpinni...

microsoft.com

Call for papers! 🎉 If you have felt confused about evaluation in explainable AI, this workshop is for you! We are excited to go to Bologna @ ECAI'25 as we try to build better methods for evaluating XAI. Can't wait to see what ideas the community will bring! sites.google.com/view/excd-20...

My group @FLAIR_Ox is recruiting a postdoc and looking for someone who can get started by the end of April. Deadline to apply is in one week (!), 19th of March at noon, so please help spread the word: my.corehr.com/pls/uoxrecru...

What happens when we train generative AI models to predict everything that happens in a modern video game? In my TED AI talk I share insights from how AI can learn the physics of a game, and how this research could empower game creatives: www.ted.com/talks/katja_...

Why we're training AI on video games

AI is already a powerful tool for collaboration — but this is just the tip of the iceberg, says AI researcher Katja Hofmann. She describes her team's work training AI on years of human gameplay data f...

ted.com

Today in Nature: our research on world and human action models (WHAM) - generative ai models of video games, aimed towards supporting game creatives in gameplay ideation : nature.com/articles/s41... - huge congrats to everyone who made this happen, I couldn't be more proud 🥳

World and Human Action Models towards gameplay ideation - Nature

A state-of-the-art generative artificial intelligence model of a video game is introduced to allow the support of human creative ideation, with the analysis of user study data highlighting three neces...

nature.com

Awesome to see this released and out in the world now. Huge congrats to the entire team! It was super cool to see the vision come to life as an intern and everything coming together now after re-joining the team 👏

Microsoft Research@msftresearch.bsky.social · last yr.

Nature published Microsoft research detailing our WHAM, an AI model that generates video game visuals & controller actions. We're releasing the model weights, sample data & WHAM Demonstrator on Azure AI Foundry to enable researchers to build on this work. www.microsoft.com/en-us/resear...

An exciting new internship opportunity in my team: Generative AI for Human Creativity - in the context of a multi-disciplinary internship with a fantastic set of mentors 🤩

I had an awesome experience at the AAMAS doctoral consortium (despite virtual format) and would highly recommend it to any PhD student. @sharky6000.bsky.social has been an amazing mentor who gave me lots of motivation and advice for my journey forward! Deadline in 7 days so apply soon 👇

Marc Lanctot@sharky6000.bsky.social · 2y ago

As a PhD student, would you like the opportunity to interact closely with established researchers and other students, receive feedback on your work, and get advice on managing your career? Check out the Doctoral Consortium at #AAMAS 2025! Deadline: Jan 17th. aamas2025.org/index.php/co...

The first textbook on multi-agent reinforcement learning is out - a landmark for the field, the first textbook covering game-theoretic foundations with state-of-the-art deep learning! Congrats to its authors Stefano Albrecht , LukasSchaefer and Filippos Christianos More details: www.marl-book.com

Multi-Agent Reinforcement Learning: Foundations and Modern Approaches

Textbook published by MIT Press (2024)

marl-book.com

📚📢Christmas came early 🎅 Our new textbook on multi-agent reinforcement learning with @mitpress.bsky.social is out NOW! The book is available from MIT Press (mitpress.mit.edu/978026204937...) or your bookstore nearby. Why you should be interested, what you get, and more all in a 🧵👇

Lukas Schäfer@lukaschaefer.bsky.social · 2y ago

📚🧵1/7 It is finally here!! Only one more week until the print release of our textbook “Multi-Agent Reinforcement Learning: Foundations and Modern Approaches” with @mitpress.bsky.social! What you get, why you should be interested and more, all below in a short 🧵👇

My team at Waymo is hiring two London-based interns for Summer 2025. Please consider applying! careers.withwaymo.com/jobs/2025-su... careers.withwaymo.com/jobs/2025-su...

2025 Summer Intern, MS/PhD, Research - Simulation Agents - London, England, United Kingdom

Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waym...

careers.withwaymo.com