โก In the last few weeks, I had the great chance to present our recent work on embodiment-aware reinforcement learning for robot control and design ๐ค
Intelligent Autonomous Systems
@ias-tudarmstadt.bsky.social
Intelligent Autonomous Systems Group @TUDarmstadt working on Robot Learning, the intersection of robotics and machine learning. Led by Prof. Jan Peters https://www.ias.informatik.tu-darmstadt.de
๐ Tim Faust received the Freudenberg award for his thesis on Model Simplification in Value-based Deep RL!! ๐ Tim did his thesis at our lab supervised by @theo-vincent.bsky.social This award rewards the best master's thesis across all fields of research TU Darmstadt with 10kโฌ
The RL4VLA Workshop has come to an end after an incredible Friday at #RSS2026 in Sydney ๐ฆ๐บ We brought together researchers to discuss how RL can advance VLA models, the remaining challenges, and what it will take for robotics to have its own "RL moment" as we've seen with LLMs.
I had a lovely time in Seoul presenting Trust Region Inverse RL (arxiv.org/pdf/2605.11020) at @icmlconf.bsky.social! Also got a chance to visit and give a talk at the Robot Learning Lab at SNU (rllab.snu.ac.kr). Theyโre doing amazing work on RL for robotics ๐ฆพ
The progression. Three balls on the first attempt, four and five by the second.
I had a great time visiting Prof. Kevin S. Luck at @vuamsterdam.bsky.social and to present our recent works on embodiment-aware learning for robot control and design! So much cool work here in Amsterdam about Robot Co-Design! There is huge potential in the data-driven way of designing robots!
๐จ Less than 24 hours to submit your work to our RL4VLA workshop @rss #RSS2026
๐จ Deadline Extension Alert! The RL4VLA Workshop submission deadline has been extended by one week! ๐๏ธ New deadline: June 15 (AoE) Still time to submit your work. See you at #RSS2026
๐จ Deadline Extension Alert! The RL4VLA Workshop submission deadline has been extended by one week! ๐๏ธ New deadline: June 15 (AoE) Still time to submit your work. See you at #RSS2026
Enjoying #ICRA2026? ๐ค Submit to the ๐ฅ๐๐ฐ๐ฉ๐๐ ๐ช๐ผ๐ฟ๐ธ๐๐ต๐ผ๐ฝ @ #RSS2026 ๐ฆ๐บ ๐ Deadline: ๐๐๐ป๐ฒ ๐ด (๐๐ผ๐) ๐ Sydney ๐๏ธ ๐๐๐น๐ ๐ญ๐ณ RL ร VLA ร Robotics ๐ค OpenReview: openreview.net/group?id=rob... Reviewers welcome: ๐ docs.google.com/forms/d/e/1F... #RSS2026 #RL #Robotics #VLA
Submit your work to the RL4VLA Workshop @ #RSS2026 Deadline is June 8 (AoE)
Enjoying #ICRA2026? ๐ค Submit to the ๐ฅ๐๐ฐ๐ฉ๐๐ ๐ช๐ผ๐ฟ๐ธ๐๐ต๐ผ๐ฝ @ #RSS2026 ๐ฆ๐บ ๐ Deadline: ๐๐๐ป๐ฒ ๐ด (๐๐ผ๐) ๐ Sydney ๐๏ธ ๐๐๐น๐ ๐ญ๐ณ RL ร VLA ร Robotics ๐ค OpenReview: openreview.net/group?id=rob... Reviewers welcome: ๐ docs.google.com/forms/d/e/1F... #RSS2026 #RL #Robotics #VLA
Excited to be at @icra2026 this week in Vienna ๐ Looking forward to lots of interesting conversations and meeting great people throughout the week. Catch our work here:
See you at #ICRA2026! ๐ Our lab will be presenting exciting new work across robotics, control, learning. Check out our papers below ๐
Check out the newest work by @nicobohlinger.bsky.social on using value gradients from multi-embodiment RL for robot design!
โก๏ธWhat if we could design robots with gradients? ๐ค Introducing Shape Your Body: we train one multi-embodiment policy + value function, then optimize new robot designs through value gradients. ๐ Try out our interactive demo here: nico-bohlinger.github.io/shape-your-b...
Are semi-gradient updates the way to go?๐ค Turns out new gradient TD methods can compete with semi-gradient methods on complex benchmarks!
Why do we keep using semi-gradient methods when they can diverge?๐คจ Gradient TD methods are often overlooked, while they have convergence guarantees! @rl-conference.bsky.social, we will present the first gradient TD method shown to be competitive against semi-gradient methods on deep RL benchmarks๐
๐ข Excited to share that our paper ๐ง๐ฟ๐๐๐ ๐ฅ๐ฒ๐ด๐ถ๐ผ๐ป ๐๐ป๐๐ฒ๐ฟ๐๐ฒ ๐ฅ๐ฒ๐ถ๐ป๐ณ๐ผ๐ฟ๐ฐ๐ฒ๐บ๐ฒ๐ป๐ ๐๐ฒ๐ฎ๐ฟ๐ป๐ถ๐ป๐ด (๐ง๐ฅ๐๐ฅ๐) has been accepted at @icmlconf.bsky.social 2026! ๐ Project page: lnkd.in/dqNi68Mk ๐ Paper: lnkd.in/dzbcCbjU #ICML2026 #ReinforcementLearning #InverseRL #ImitationLearning #Robotics
๐ Excited to announce the ๐ฅ๐๐ฐ๐ฉ๐๐ Workshop @ #RSS2026 in Sydney, Australia ๐ฆ๐บ Bringing together researchers working on reinforcement learning for Vision Language Action (VLA) systems, embodied AI, and scalable robot learning. ๐ Submission deadline: June 8th, 2026 (AoE)
The deadline for this workshop is coming up soon ๐ May 15th (AoE)
We are proud to have an amazing line-up of speakers! They will present their works, which incorporate the constraint that the world is bigger than the agent and impossible to anticipate, observe, or model perfectly. We are also looking forward to the panel discussion!
I had an amazing time today visiting Professor Luiz Chaimowicz's lab in Belo Horizonte! I really enjoyed discovering the research being done at UFMG. It seems to be an amazing place to do some research! See you @iclr-conf.bsky.social in Rio
I'm in Rio ๐ง๐ท for #ICLR! Catch me presenting MINTO ๐ฟ this Friday, April 24 | Afternoon | Pavilion 4 #4603. MINTO ๐ฟ uses the online network when it helps speed up RL training without sacrificing stability. Let's chat about RL and your research. DM me or simply come say hi!
I will be presenting 3 papers @iclr-conf.bsky.social this week ๐ง๐ท Looking forward to some interesting exchanges!
Interested in world models? Join the conversation @iclr-conf.bsky.social ๐
๐World models can play an important role towards building general agents, but what should be their role in decision-making?๐น๏ธ @joemwatson.bsky.social and I are organizing a Social @iclr-conf.bsky.social on this topic๐๏ธ ๐๏ธFeel free to join the conversation on Friday 24th April, at noon!!
Working with constrained agents in complex environments? Do not hesitate to submit your latest work to this workshop! See you in Montrรฉal @rl-conference.bsky.social ๐จ๐ฆ
RL in Big Worlds is a workshop at @rl-conference.bsky.social about ideas that enable agents to achieve goals in environments vastly more complex than themselves. This requires giving agents the ability to learn continually and use approximate value functions, models, and policies effectively.
Benchmarking always takes a ton of time๐ฎโ๐จ and we often hear about it๐ฃ๏ธ But we rarely report the carbon footprint of experiments, which better reflects their weight! Here is the electricity emission of the experiments in each paper of my PhD๐
Excited to release FeLaN open-source: โ JAX training & evaluation pipelines โ Baselines: MJX, DeLaN, MLP โ Differentiable RNEA in MJX โ Open datasets (sim + real): Go2, Talos, Spot, HyQReal2 ๐ป github.com/schulze18/felan ๐ schulze18.github.io/felan_website ๐ arxiv.org/abs/2510.17270
GitHub - Schulze18/felan: Open-source code of Floating-Base Deep Lagrangian Networks (FeLaN).
Open-source code of Floating-Base Deep Lagrangian Networks (FeLaN). - Schulze18/felan
github.com
Proud to share our latest work, accepted at @iclr-conf.bsky.social 2026: APPLE! ๐ TL;DR: APPLE is a novel reinforcement learning framework for solving active perception problems. #ICLR2026 #Robotics #MachineLearning #ActivePerception #RL @ias-tudarmstadt.bsky.social
Should we use a target network in deep value-based RL?๐ค The answer has always been YES or NO, as there are pros and cons. @iclr-conf.bsky.social, I will present iS-QN, a method that lies in between this binary view, collecting the pros while reducing the cons๐
๐งต Accepted at @iclr-conf.bsky.social! Target networks stabilize bootstrapping in RL ๐ก๏ธ But induce slow-moving targets ๐ข Online networks adapt fast โก But can diverge with function approximation ๐ฅ ๐ ๐๐ก๐ง๐ข ๐ฟ uses the online network ๐ผ๐ป๐น๐ ๐ถ๐ณ ๐ถ๐ ๐ฐ๐ฎ๐ป โ yielding faster ๐ข๐ฏ๐ฅ more stable RL. Hereโs how ๐
๐ฅณ Accepted @iclr-conf.bsky.social ๐ฅณ ๐ก This paper shows an easy way to halve the memory footprint of the critic of any temporal-difference learning algorithm while maintaining good performance ๐ชถ
Should we use a target network in deep value-based RL?๐ค The answer has always been YES or NO, as there are pros and cons. @iclr-conf.bsky.social, I will present iS-QN, a method that lies in between this binary view, collecting the pros while reducing the cons๐
๐ฅณOur paper "Floating-Base Deep Lagrangian Networks (FeLaN)" has been accepted to #ICRA2026. FeLaN: a grey-box approach for physically consistent SysID of floating-base robots (humanoids, quadrupeds). ๐ arxiv.org/abs/2510.17270 ๐ป Soon! ๐ schulze18.github.io/felan_website/