BlackboxNLP is tomorrow at #EMNLP2026 in Budapest! 🧵 Here’s what’s on the program. We start at 9:00 in Room P3. At 9:10, our first keynote @sfeucht.bsky.social will talk about how LLMs read, mapping arbitrary symbols onto meaningful words.
Martin Tutek
@mtutek.bsky.social
Postdoc @ TakeLab, University of Zagreb | Working on interpretability & safety of LLMs. https://mttk.github.io/
Models are sycophantic, and when they do challenge faulty or incorrect inputs, they're ambiguous and ineffective. In a new paper w/ a multilingual co-author team, we find that people may view LM responses that push back, yet still end up believing false content is true. arxiv.org/abs/2610.17703
Our (objectively awesome) program is now live! Join us on October 29th for an 🎢 interpretaganza🎢 in Budapest. Come and enjoy the great talks, insightful conversations and a surprising lack of slop (except for coffee*)☕️ *jk I am actually ok with conference coffee
📣 The BlackboxNLP 2026 program is live! Join us on October 29th in Room P3 at @emnlpmeeting.bsky.social for keynotes by @sfeucht.bsky.social , Ivan Titov & @m-hahn.bsky.social, six oral presentations, and two poster sessions! Full schedule: blackboxnlp.github.io/2026/#program
Take a break from reading up on Navier-Stokes drama and add October 29th to your calendar, as we have a stellar lineup of speakers at this years' BlackboxNLP!
🎉 Thrilled to announce the keynote speakers for BlackboxNLP 2026 @emnlpmeeting, with three incredible perspectives on interpretability: 🔍 Ivan Titov 🔍 Sheridan Feucht @sfeucht.bsky.social 🔍 Michael Hahn @m-hahn.bsky.social Join us on October 29th! 🇭🇺
Due to the unprecedented amount of submissions to BlackboxNLP 2026, we will announce the decisions for Main, Special and ARR commitments on September 2 AoE. Thanks for your patience!
The @blackboxnlp.bsky.social reproducibility track is in an urgent need for reviewers! If you can review a paper (or two), these bite-sized papers deserve some attention, and reviewing them will leave you fulfilled! 🥰 Please reach out if you can help out! RTs appreciated 👐
Very happy that #IC2S22027 will be in Milan at Università Bocconi! I’m really looking forward to welcoming the computational social science community to my university and to Milan, and excited to be part of the team organizing it. See you in 2027! 🇮🇹✨
That's a wrap on IC2S2 2026... we'll see you next year in Milan! 😍
With a high volume of submissions this year, we're recruiting additional reviewers for BlackboxNLP 2026! 🗓 Review deadline: August 17 (AoE) 🗓 Review load: 2-4 papers 📝 Sign up: forms.gle/tha166UQZYqX...
For today's reading group, @veraneplenbroek.bsky.social presented "Old Habits Die Hard: How Conversational History Geometrically Traps LLMs" by Simhi et al. (2026) Paper: arxiv.org/abs/2603.03308 #NLProc
⏳ The BlackboxNLP 2026 Reproducibility Challenge deadline has been extended to July 24 (AoE) ⏳ If you've been working on a robustness check, ablation, or replication of recent NLP interpretability work, you have a bit more time to get your submission in.
⏳ One week left! The submission deadline for BlackboxNLP 2026 is July 17 (AoE). If you're working on analyzing or interpreting neural networks for NLP, now's the time to get your paper in. 📍 Co-located with #EMNLP2026 in Budapest 🔗 blackboxnlp.github.io
🏆 Announcing the NDIF Best Paper Award for the BlackboxNLP 2026 Reproducibility Challenge! @ndif-team.bsky.social Reproduce an interp. finding with nnsight + NDIF, open-source it, and push it further. Winners will receive a $500 prize, and will be invited to present at the workshop!
At ICML '26, TakeLab members are presenting three papers. Make sure to stop by if interested in language model interpretability, coding agent evaluations, or pluralistic alignment. Details below 👇🧵 @icmlconf.bsky.social #ICML2026 🇰🇷
📣 #EACL2027 updates: the Call for Papers is live, and our keynote speakers are confirmed! Main conference: 9–14 March 2027. Special theme: The Human in Language. 🧵👇 2027.eacl.org/calls/papers/
Call for Papers
Official website for the 2027 Conference of the European Chapter of the Association for Computational Linguistics
2027.eacl.org
We don’t always know what problems are hard for LLMs. So devs evaluate on tasks HUMANS find hard or on broad benchmarks. What if we could instead anticipate which scenarios a model will fail on—all without evaluating specific input examples? 🧵NEW PAPER by @jenniferlumeng.bsky.social
✨ it's coming ✨ NEMI 2026 will be lit. It will also be the new BU interp supergroup's debut ball. Come meet us!
The 3rd New England Mechanistic Interpretability (NEMI) Workshop
nemiconf.github.io
With the large influx of submissions and a faster pace of research, reproducibility is more important than ever. With this reproducibility challenge, we want to put the focus on best practices wrt. baselines🧱, ablations🌈, eval🔎 and generalizability🗺️ of interpretability!
📣 Announcing the BlackboxNLP 2026 Reproducibility Challenge! A new track dedicated to rigorous robustness checks of NLP interpretability work - stress-testing baselines, ablations, generalizability, and evaluation.
📣 Announcing the BlackboxNLP 2026 Reproducibility Challenge! A new track dedicated to rigorous robustness checks of NLP interpretability work - stress-testing baselines, ablations, generalizability, and evaluation.
Ever used a top-ranked LLM that just... felt wrong for you? You’re not alone. Instead of leaderboards, many of us turn to "vibe-testing" - manually comparing models to our own needs. But can we turn these feelings into a structured evaluation? New paper: "From Feelings to Metrics" 🧵
We are delighted to welcome @marlutz.bsky.social to our lab over the next few months! 🎉 She'll work on the representation of different demographic groups in LLMs. #NLProc
FYI #ACL2026 has an unusual registration system this year, and probably a lot of people who want to attend will not be able to. Spots are limited to 3.5k people, and only presenting authors can register during the first phase. Then, *if* there are spots left, others can try to register.
Registration
Official website for the 64th Annual Meeting of the Association for Computational Linguistics
2026.aclweb.org
📢 The workshop on Insights from negative results will be back at EMNLP'26! Your most-insightful failures can be submitted in 4 pages by June 25. It's also possible to commit short papers reviewed through ARR. insights-workshop.github.io/2026/cfp
2026 Call for Papers
Workshop on Insights from Negative Results in NLP
insights-workshop.github.io
How can generative AI better support human creativity, without limiting it? If you have thoughts, we invite submissions to our ICML workshop on Generative AI, Creativity, and Human-AI Co-Creation 📍 July 2026, Seoul 📄 Submit by: April 24 (AOE) 🔗 Submission link: openreview.net/group?id=ICM...
ICML 2026 Workshop GenAICreativity
Welcome to the OpenReview homepage for ICML 2026 Workshop GenAICreativity
openreview.net
❗The full paper submission deadline for COLM is ~14 hours from now (11:59pm AOE)! Please submit your final PDFs on the same page where you uploaded your abstracts. And please use the provided LaTeX templates; do not handwrite your manuscript like this llama is! Good luck!
Interested in pursuing a PhD in NLP/cog-sci? Studying language learning in LMs from the perspective of human language acquisition? Few more days to apply!!
📢 PhD position in Developmental Language Modelling (PLZ RT) What can human language acquisition teach us about training language models? Join us as a PhD! mpi.nl/career-education/vacancies/vacancy/fully-funded-4-year-phd-position-developmental-language @carorowland.bsky.social @mpi-nl.bsky.social
A piece co-authored by an old friend (Divya Saini, a psychiatrist at Massachusetts General Hospital) www.nytimes.com/2026/03/29/o...
Opinion | Your Chatbot Isn’t a Therapist
nytimes.com
Check out works on sequence repetition 🔁 and evaluating synthetic data 🧮 from our lab in Rabat! @eaclmeeting.bsky.social #EACL2026
At EACL '26, TakeLab members are presenting two papers. Feel free to stop by if you'd like to chat about simple tricks to improve LLM token embeddings, principled evaluation of synthetic data, coffee, or life in general. Details below 👇🧵 @eaclmeeting.bsky.social #EACL2026 #NLProc 🇲🇦
To ease my FOMO from not attending @eaclmeeting.bsky.social, I skimmed the proceedings while playing the Tangier episode of Parts Unknown. I'll do something different and shout out 5 (subjectively) interesting works of authors I'm *not* closely related to, in no specific order:🧵⬇️
Thinking of applying for an #MSCA Postdoctoral Fellowship in 2026? I’m open to supervising at Bocconi! Feel free to reach out. By submitting an expression of interest to Bocconi, selected applicants will receive full proposal support. 🗓️ Deadline: April 15 👉 www.unibocconi.it/en/horizon-e...
Horizon Europe - Marie Skłodowska-Curie Actions Postdoctoral Fellowships 2026 - Bocconi University
unibocconi.it