Glen Berseth

@glenberseth.bsky.social

Assistant Prof at @UMontreal @mila-quebec.bsky.social @MontrealRobots . CIFAR AI Chair, RL_Conference chair. Creating generalist problem-solving agents for the real world. He/him/il.

What a person can accomplish with LLMs and other recent tools is amazing. I am looking for new project ideas for a data science course to help people understand where LLMs can be used instead of traditional methods and how to use them for real industry projects. Any ideas?

Paid LLMs were down this morning. Again. So I did what any prof does — I open-sourced my whole local LLM setup. Remote GPU via SSH, Ollama, OpenCode, benchmarking scripts. For private docs, planning, learning, and when the cloud flakes out. It's like a spare tire for AI.

Bild

This has been a wild week! I have been planning to take my lecture recordings from 3 years + my slides and turn them into a book on #RobotLearning! It seemed like the perfect 12 days to push! I got about halfway through before Fable was disrupted. Stay tuned for updates.

Bild

Compositional generalization is hard enough without being restricted to the limited availability of robotics data. In our new paper we use VLMs to autonomously decompose long-horizon demonstrations into diverse, language-labeled sub-tasks boosting VLA robustness!

Exciting news! I am delighted to share the wonderful news that I have been granted tenure! This milestone marks the completion of my time as an Assistant Professor, and I am profoundly grateful for the support, collaboration, and inspiration I have received from this incredible community.

Bild

After a busy start to the year, I have a new lecture to share. Generalist models have been making good progress, but #sim2real just works. In this lecture, I explain domain randomization, simulation limitations, and connections to generalization.

Bild

I am rerunning my class on robot learning this year, and I plan to push many code examples to help others get to the ugly details fast. One of these details is how BC gets off track as network sizes change. Blog and notebook below.

Bild

I have updated my tutorial on making Vision Language Action models. This tutorial starts with a basic Transformer and walks people through the steps to transform it into a full VLA that uses PaliGemma as the pretrained VLM. Links below.

Bild

I am finally fully benefiting from making my lecture content in LaTeX. Creating new content powered by LLMs to make examples and translate my content to a webpage and a book is a breeze. Just need to figure out how to add references faster.

Bild

I'll be giving a talk tomorrow in the Embodied World Models for Decision Making workshop at #NeurIPS. I will present a number of recent works from my lab on combining foundational models with planning and RL. When: 11:30-noon Where: Level Room 30A-E

Bild

My lab is looking for new students who are very passionate about foundational models and planning/RL/robotics. Apply via Mila. I will also be at #NeurIPS to discuss research ideas and opportunities. See notes below for application advice.

Bild