🤹 New blog post! I write about our recent work on using hierarchical trees to enable sparse attention over irregular data (point clouds, meshes) - Erwin Transformer, accepted to ICML 2025 blog: maxxxzdn.github.io/blog/erwin/ paper: arxiv.org/abs/2502.17019 Compressed version in the thread below:
AMLab
@amlab.bsky.social
The official account of the Amsterdam Machine Learning Lab (AMLab) at UvA, co-directed by Max Welling and Jan-Willem van de Meent.
Don's miss this exciting opportunity! 🔥 🚨Application deadline on the 15th of June
New PhD position at the University of Amsterdam in @amlab.bsky.social on learning concepts with theoretical guarantees using #causality and #RL with me, Frans Oliehoek (TU Delft) and Herke van Hoof 💥 Deadline: 15 June werkenbij.uva.nl/en/vacancies...
One more week to apply to this exciting position... and another position on #CausalRepresentationLearning and #ReinforcementLearning for learning provably correct #concepts from raw data opening up soon!
Exciting new PhD position at Utrecht University on the #causal effects of communication in #multi-agent #RL with Shihan Wang, Mehdi Dastani and me 🎉 This is part of www.hybrid-intelligence-centre.nl, which aims at combining human and machine intelligence. Deadline 20 May www.uu.nl/en/organisat...
New PhD position at the University of Amsterdam in @amlab.bsky.social on learning concepts with theoretical guarantees using #causality and #RL with me, Frans Oliehoek (TU Delft) and Herke van Hoof 💥 Deadline: 15 June werkenbij.uva.nl/en/vacancies...
Vacancy — PhD Position on Learning Concepts with Theoretical Guarantees Using Causality and RL
Are you interested in improving the interpretability, robustness and safety of current AI systems? If the answer is yes, please continue reading!
werkenbij.uva.nl
Exciting news: AMLab is happy to have 7 papers accepted at #ICML2025! 🎉 See the thread below for the full list 📝 and meet us in Vancouver to discuss them further! 🇨🇦 🧵1 / 8
🥇 3 Best Paper Awards for AMLab members! 1. Towards Variational Flow Matching on General Geometries by @olgatticus.bsky.social et al. 2. Generative Uncertainty in Diffusion Models by @metodjazbec.bsky.social et al. 3. SDE Matching by @gbarto.bsky.social et al. Congrats to everyone! 🔥
Test of Time Winner Adam: A Method for Stochastic Optimization Diederik P. Kingma, Jimmy Ba Adam revolutionized neural network training, enabling significantly faster convergence and more stable training across a wide variety of architectures and tasks.
🤹 Excited to share Erwin: A Tree-based Hierarchical Transformer for Large-scale Physical Systems joint work with @wellingmax.bsky.social and @jwvdm.bsky.social preprint: arxiv.org/abs/2502.17019 code: github.com/maxxxzdn/erwin
A few weeks ago, I presented SNAP at the wonderful #Bellairs Workshop on Causality in Barbados🐢 This Friday 🫰meets 🤌 as I will get to present SNAP again at the kick-off of the newest season of @causalclub.di.unipi.it! Check out this, and their other amazing upcoming talks at causalclub.di.unipi.it
Here's a talk you can't miss! 🔨 Next Friday, @matyasch.bsky.social will discuss how to efficiently estimate causal effects on large unknown graphs. 🤌 See you in Pisa on March 7 at 15:00 (CET) or live at meet.google.com/cqt-ufji-xfz 🗓️ Click here to add it to your calendar: tinyurl.com/snapcausclub
Variational Flow Matching goes Riemannian! 🔮 In this preliminary work, we derive a variational objective for probability flows 🌀 on manifolds with closed-form geodesics, and discuss some interesting results. Dream team: Floor, Alison & Erik (their @ below) 💥 📜 arxiv.org/abs/2502.12981 🧵1/5
Congratulations to "my" first PhD student Dr. @rmassidda.it who defended today at the University of Pisa *with honours* a thesis on "Methodological Advancements for Causal Abstraction Learning" 🎉 Riccardo is an amazing @ellis.eu PhD co-supervised w/ Davide Bacciu @ellisamsterdam.bsky.social
💡 ➡️ 🧠 ➡️ 🚀
Do you want to estimate causal effects for a small set of target variables without knowing the causal graph, but discovering it takes too long? Now you can get adjustment sets in a SNAP🫰accepted at #aistats2025! 📜 arxiv.org/abs/2502.07857 🧩 matyasch.github.io/snap/ 🧵 1/10
The Christmas spirit has arrived at AMLab! 🎄✨ Yesterday we kicked off the holidays with a festive group dinner and a fun Secret Santa exchange. 🎅 Wishing everyone a restful and joyful winter break and a happy new year! ❄️💫
Yesterday, we had the honor of hosting 2021 Nobel Laureate in Economics, Guido Imbens, at our Lab! 🤩 We had the chance to attend his inspiring talk on Experimental Design in Marketplaces 📈👩💻 A big thank you to @smaglia.bsky.social for making this event possible 💥
🧑🏫Neural Flow Diffusion Models at #NeurIPS2024 tomorrow! Discover how to build learnable noising processes for straight-line generative trajectories end-to-end and without simulations!🤯 📍West Ballroom A-D #6809 ⏰Fri 13 Dec 4:30 pm — 7:30 pm 🔗https://neurips.cc/virtual/2024/poster/94656
Here are the dapper @metodjazbec.bsky.social and Alexander Timans, presenting their work on early-exit with risk control.
🚪Fast yet Safe: Early-Exiting with Risk Control by @metodjazbec.bsky.social*, Alexander Timans*, Tin Hadži Veljković, Kaspar Sakmann, Dan Zhang, @canaesseth.bsky.social, Eric Nalisnick 🪪https://neurips.cc/virtual/2024/poster/94477 📜https://arxiv.org/abs/2405.20915 🧵6 / 12
Come see @eijkelboomfloor.bsky.social and @gbarto.bsky.social present their work on variational flow matching now in West Ballroom A-D #7103!
🐑 Come and check out Variational Flow Matching for Graph Generation next week at @neuripsconf.bsky.social ! 🐑 Wed 11 Dec 11 a.m. PST — 2 p.m. PST West Ballroom A-D #7103 arxiv.org/abs/2406.04843
François Cornet and @gbarto are presenting their work on Equivariant Neural Diffusion now at East Exhibition #2403!
🦠Equivariant Neural Diffusion for Molecule Generation by François Cornet, @gbarto.bsky.social, Mikkel Schmidt, @canaesseth.bsky.social 🪪https://neurips.cc/virtual/2024/poster/96702 🧵4 / 12
Come talk to @zmheiko.bsky.social about his work on sample-efficient black box variational inference! (East Exhibition Hall #4105)
🪪VISA: Variational Inference with Sequential Sample-Average Approximations by @zmheiko.bsky.social, @canaesseth.bsky.social, @jwvdm.bsky.social 🪪https://neurips.cc/virtual/2024/poster/93819 📜https://arxiv.org/abs/2403.09429 🧵8 / 12
Congrats to @smaglia.bsky.social for now being an ELLIS Scholar! 🤩🥳🎉
🎉 Congratulations to our newly accepted ELLIS Fellows & Scholars in 2024! Top researchers in #MachineLearning join the network to advance science & mentor the next generation. #ELLISforEurope #AI 🌍 Know someone on the list? bit.ly/3ZJd9Cz Tag them in a reply with congratulations.
If you are attending #NeurIPS2024🇨🇦, make sure to check out AMLab's 11 accepted papers ...and to have a chat with our members there! 👩🔬🍻☕ Submissions include generative modelling, AI4Science, geometric deep learning, reinforcement learning and early exiting. See the thread for the full list! 🧵1 / 12
Congratulations to @mvmacfarlane.bsky.social for the 3rd place in ARC Prize 2024! :) 📄 Paper link: arxiv.org/abs/2411.08706 🏆 Details: arcprize.org/2024-results
Searching Latent Program Spaces
Program synthesis methods aim to automatically generate programs restricted to a language that can explain a given specification of input-output pairs. While purely symbolic approaches suffer from a c...
arxiv.org
I will be at NeurIPS this week. @amlab.bsky.social will be presenting 10 papers in total, and I myself am involved with 3 (see thread). I am also *hiring* for a postdoc position on data-efficient surrogate models for fluid dynamics. Come talk to me if you are on the market!
Yesterday the Amsterdam Causality Meeting took place at LAB42, hosted by @ellisamsterdam.bsky.social and co-organized by @smaglia.bsky.social 💥 We attended inspiring talks by @rmassidda.it , currently visiting AMLab, and @phillip-lippe.bsky.social 🤩 👩💻 Slides: amscausality.github.io/upcoming/ 👩💻
🚨 Happening today! 🚨 Don't miss the upcoming talks of @rmassidda.it and @phillip-lippe.bsky.social for the Amsterdam Causality Meeting, taking place this afternoon at UvA Science Park! 💥 See you there :)
📢 The next Amsterdam Causality Meeting supported by the #ELLISunitAmsterdam will take place on Wednesday! 📅 December 4th ⏰ 14.30-17.30 📍 Lab 42 in L3.36 🔗 amscausality.github.io/upcoming/ Come and join us! 🚀✨
📢 The next Amsterdam Causality Meeting supported by the #ELLISunitAmsterdam will take place on Wednesday! 📅 December 4th ⏰ 14.30-17.30 📍 Lab 42 in L3.36 🔗 amscausality.github.io/upcoming/ Come and join us! 🚀✨
Upcoming Meetings
Causality meeting 2023 with VU, UvA, Amsterdam UMC and CWI
amscausality.github.io
Yesterday @ellisamsterdam.bsky.social hosted the yearly NeurIPS-Fest, a pre-party for NeurIPS with a keynote talk, poster session, drinks and bites! 🍺🍻 The keynote was by @canaesseth.bsky.social , who talked about "Diffusion, Flows and other stories", presenting his 5 papers accepted at NeurIPS! 💥
Thanks to the organizers and the speakers for the inspiring Geometry-Grounded Representation Learning (NeurReps) seminar that happened yesterday! 🤩 🚨 In case you missed it 🚨 the talk was recorded and it will be available soon at this link: www.neurreps.org/past-seminars
Soon, @erikjbekkers.bsky.social and @davidmknigge.bsky.social will give a talk elaborating even further on geometry-grounded representation learning in a NeurReps seminar. Make sure to mark the date! :) ⏰ November 21st, 4 PM CET 🔗 www.neurreps.org/speaker-seri...
Meet our Lab's members: staff, postdocs and PhD students! :) With this starter pack you can easily connect with us and keep up to date with all the member's research and news 🦋 go.bsky.app/8EGigUy