Brazil shows how it’s done in a democracy

Brazil’s supreme court finds Bolsonaro guilty of plotting military coup

Former president faces decades-long jail sentence for seeking to forcibly cling to power after losing 2022 election

theguardian.com

Excited to announce that our work on Reinforcement Learning for Arachnophobia treatment has been accepted at ACM Transactions on Interactive Intelligent Systems! We found that an RL agent could more effectively adapt VR spiders to achieve specified anxiety levels in users compared to current SOTA.

Was talking to a student who wasn't sure about why one would get a PhD. So I wrote up a list of reasons! www.eugenevinitsky.com/posts/reason...

Previous work has shown that programmatic policies—computer programs written in a domain-specific language—generalize to out-of-distribution problems more easily than neural policies. Is this really the case? 🧵

Previous work has shown that programmatic policies—computer programs written in a domain-specific language—generalize to out-of-distribution problems more easily than neural policies. Is this really the case? 🧵

If like me your Discover feed has been even worse lately and you are here for ML/AI news and discussion, check out these two feeds: - Paper Skygest - ML Feed: Trending Links below 👇

As AI agents face increasingly long and complex tasks, decomposing them into subtasks becomes increasingly appealing. But how do we discover such temporal structure? Hierarchical RL provides a natural formalism-yet many questions remain open. Here's our overview of the field🧵

As hot as this summer is, it’s also one of the coolest we’ll ever enjoy again. Just how much hotter and deadlier summers will get is still up to us. Right now we’re working hard to make them worse 🎁 link to my @opinion.bloomberg.com column: www.bloomberg.com/opinion/arti...

The Heat Dome Wants a Word With Climate-Change Deniers

The temperatures gripping the US this week were made up to five times more likely by the fact that the atmosphere is simply hotter.

bloomberg.com

Hiring a postdoc to scale up and deploy RL-based planning onto some self-driving cars! We'll be building on arxiv.org/abs/2502.03349 and learn what the limits and challenges of RL planning are. Shoot me a message if interested and help spread the word please! Full posting to come in a bit.

Robust Autonomy Emerges from Self-Play

Self-play has powered breakthroughs in two-player and multi-player games. Here we show that self-play is a surprisingly effective strategy in another domain. We show that robust and naturalistic drivi...

arxiv.org

We’re extending the AIIDE deadline! Partially due to author requests, partially due to a significant increase in submissions meaning I need to increase the PC!

AIIDE@aiide.bsky.social · last yr.

🚨#AIIDE25 full paper deadline extended! Due to requests from authors, we have extended the deadline for full paper submission to June 27, 2025! 🔗 More information: sites.google.com/ualberta.ca/...

🧵1/ New paper! 📄 Subgoal-Guided Policy Heuristic Search with Learned Subgoals, led by my PhD student @tuero.ca. arxiv.org/pdf/2506.07255 This paper follows the Levin tree search (LTS) research line and focuses on learning subgoal-based policies.

Jake Tuero@tuero.ca · last yr.

Excited to share our paper "Subgoal-Guided Policy Heuristic Search with Learned Subgoals" has been accepted to #icml2025! Paper Preview: arxiv.org/pdf/2506.07255 I'll be attending ICML-25 in Vancouver, and I'm looking forward to chatting with anyone who is interested in our work!

I enjoyed reading this and the comments within it.

Eugene Vinitsky 🍒@eugenevinitsky.bsky.social · 2y ago

Does everyone in your community agree on some folk knowledge that isn’t published anywhere? Put it in a paper! It’s a pretty valuable contribution

After literal years of being down due to security issues, my blog is now back up, including my one post on "How to Write an AIIDE Paper" www.guzdial.com/blog/how-to-...

We are very happy to report that the second edition of our textbook on Artificial Intelligence and Games is now finally published! This book is a thorough update of our popular textbook, trying to provide a comprehensive coverage of the many aspects of and use cases for AI in games.

Excited to announce that the second edition of the PCGML textbook by @sampsnodgrass.bsky.social, @autumnsburg.bsky.social, and myself is up! This version is a major update of the first, with a new chapter on GenAI and updates on the last two years of research. link.springer.com/book/10.1007...

Procedural Content Generation via Machine Learning

This book updates and expands upon the first beginner-focused guide to procedural content generation via machine learning (PCGML)

link.springer.com

We have extended the submission deadlines for these workshops. Programmatic Representations for Agent Learning (ICML) - Vancouver. - Deadline: May 30, 2025 (pral-workshop.github.io) Programmatic Reinforcement Learning (RLC) - Edmonton. - Deadline: June 6, 2025 (prl-workshop.github.io)

Levi Lelis@programsynthesis.bsky.social · last yr.

Are you interested in programmatic representations in machine learning? Please consider submitting your work to these workshops: one at ICML and another at RLC. 🧵

📢 I'm very excited to release AgarCL, a new evaluation platform for research in continual reinforcement learning‼️ Repo: github.com/machado-rese... Website: agarcl.github.io Preprint: arxiv.org/abs/2505.18347 Details below 👇

🧵1/ New paper! 📄 InnateCoder: Learning Programmatic Options with Foundation Models This is Rubens Moraes' final chapter of his PhD thesis from Universidade Federal de Viçosa, Brazil, in collaboration with Quazi Sadmine and Hendrik Baier. arXiv: arxiv.org/abs/2505.12508

📢 I'm happy to share the preprint: _Reward-Aware Proto-Representations in Reinforcement Learning_ ‼️ My PhD student, Hon Tik Tse, led this work, and my MSc student, Siddarth Chandrasekar, assisted us. arxiv.org/abs/2505.16217 Basically, it's the SR with rewards. See below 👇

🧵1/ New paper! 📄 InnateCoder: Learning Programmatic Options with Foundation Models This is Rubens Moraes' final chapter of his PhD thesis from Universidade Federal de Viçosa, Brazil, in collaboration with Quazi Sadmine and Hendrik Baier. arXiv: arxiv.org/abs/2505.12508

🎉 Super excited: today @sharky6000.bsky.social is presenting our new algorithm Progressive Hiding at #AAMAS2025! It's a learning method for games with imperfect information. 🔗 See his post: bsky.app/profile/shar... Wish I could be there! 😢 1/6

Marc Lanctot@sharky6000.bsky.social · last yr.

Day #5 and last day 😭 @aamasconf.bsky.social We'll be presenting one more paper called "Learning in Games with Progressive Hiding" by @benhey.bsky.social and myself. Poster @ 10am, talk @ 11:30am. arxiv.org/abs/2409.03875 This is an application of progressive hedging to learning in games: 1/2

Are you interested in programmatic representations in machine learning? Please consider submitting your work to these workshops: one at ICML and another at RLC. 🧵

Wow! Great list of papers on the computational capability of neural networks.

Kimon Fountoulakis@kfountou.bsky.social · last yr.

Computational Capability and Efficiency of Neural Networks: A Repository of Papers I compiled a list of theoretical papers related to the computational capabilities of Transformers, recurrent networks, feedforward networks, and graph neural networks. Link: github.com/opallab/neur...

🎓 PhD position available! Join our interdisciplinary research project on causal agent-based modelling! 🔍 Looking for curious minds with a MSc degree (or near to completing one) in CS/AI/related fields. 📍 Location: Utrecht University, NL 🗓️ Deadline: 16 June 2025 📩 Info: www.uu.nl/en/organisat...

PhD Position in Causal Agent-based Modelling of Complex Social Systems

Join this exciting interdisciplinary research project at the Centre for Complex Systems Studies and study causal agent-based modelling!

uu.nl

I enjoyed reading this thread.

Subbarao Kambhampati (కంభంపాటి సుబ్బారావు)@rao2z.bsky.social · last yr.

Solving Single Agent Fully Observable Deterministic (SAFODP) Problems with Dec-POMDP approaches #SundayHarangue #allegory x.com/rao2z/status...

A bit of an old paper but I'm still excited about it, I've never posted about it, and we just released code for the main algorithm: Population RL (PopRL). 👇 Population-based Evaluation in Repeated Rock-Paper-Scissors as a Benchmark for Multiagent Reinforcement Learning, accepted (TMLR '23) 🧵 1/N

So happy to see that ICLR will go to Brazil next year!

ICLR Conference@iclr-conf.bsky.social · last yr.

That's a wrap for #ICLR2025! See you all next year in Brazil! Please all welcome @bharathhariharan.bsky.social as the new Senior Program Chair! (With @cvondrick.bsky.social continuing on as General Chair.)

rlhfbook also available on arxiv for SEO 😀 happy friday arxiv.org/abs/2504.12501

Reinforcement Learning from Human Feedback

Reinforcement learning from human feedback (RLHF) has become an important technical and storytelling tool to deploy the latest machine learning systems. In this book, we hope to give a gentle…

arxiv.org

We have a new open position for a PhD student to work on Reinforcement Learning for Cyber Security! Check out vacancies.maastrichtuniversity.nl/job/Maastric... for details, and feel free to contact me for any info as well. Application deadline: May 11 Reposts much appreciated.

Three postdoc positions in HCI & Videogame Theory at the IT University of Copenhagen. Deadline May 15. "Candidates will investigate current theory use in HCI/games research and practice, develop approaches to make theory more usable, and evaluate the effectiveness of such interventions"