We are delaying general registration to Aug 10 to carefully manage author registration and make sure that all authors (main + workshops) get to register. We appreciate the patience
Yoav Artzi
@yoavartzi.com
LM/NLP/ML researcher ¯\_(ツ)_/¯ yoavartzi.com / associate professor @ Cornell CS + Cornell Tech campus @ NYC / nlp.cornell.edu / visiting researcher @ Google DeepMind / building @colmweb.org / previously associate faculty director @ arXiv.org
Camera ready deadline is Aug 8! Also, financial assistance form is up: forms.gle/HhXhv8ND38X1... Deadline is July 31 Author registration is ongoing (authors, get on it!) Non-author registration will follow up in (very) early August
COLM 2026 will host 16(!) workshops: colmweb.org/workshops.html CFPs are all online, and deadlines are coming up, so check the CFP of your workshops of interest
Very excited about @nthngdy.bsky.social's new work! It really gets to the bottom (or top, depends where the head in LMs is 😜) and fundamentals of contemporary LLMs. A real treat of a paper: solid theory, and very cool experiments.
Nathan Godey@nthngdy.bsky.social · 5mo ago🧵New paper: "Lost in Backpropagation: The LM Head is a Gradient Bottleneck" The output layer of LLMs destroys 95-99% of your training signal during backpropagation, and this significantly slows down pretraining 👇
This call is still open. I am looking to recruit, as well as many other faculty at Cornell. We review folders as they come, and will send offers until all positions are filled. Please share with your network 🙏
Yoav Artzi@yoavartzi.com · 9mo agoCornell is recruiting for multiple postdoctoral positions in AI as part of two programs: Empire AI Fellows and Foundational AI Fellows. Positions are available in NYC and Ithaca. Deadline for full consideration is Nov 20, 2025! academicjobsonline.org/ajo/jobs/30971
We have a mailing list for big announcements: groups.google.com/g/colm-annou... We use it very sparingly, roughly 1-2 times a year
About
groups.google.com
Call for papers -- due March 31, 2026 (abstracts due March 26) colmweb.org/cfp.html Call for workshops -- due April 14, 2026 colmweb.org/cfw.html
COLM 2026: Call for Papers
colmweb.org
Conference on Language Modeling@colmweb.org · 9mo agoCOLM is going to San Francisco for 2026! 🗓️Dates: October 6-9, 2026 🏨Venue: Hilton San Francisco Union Square Website and CFPs for papers and workshops coming up soon!
Submit to COLM! Deadline of March 31. This llama gets to enjoy his holidays and isn't stressed out just yet...
Conference on Language Modeling@colmweb.org · 8mo agoCOLM 2026 is just around the corner! Mark your calendars for: 💡 Abstract deadline: Thursday, March 26, 2026 📄 Full paper submission deadline: Tuesday, March 31, 2026 Call for papers (website coming soon): docs.google.com/document/d/1...
Zoe presented this paper at NeurIPS D+B: it's all knots(🪢🪢🪢!?), no language tokens were harmed (or reinforced) in the process It's such a fun and creative paper, a real mind twist ;) You really get to think carefully about visual intelligence looking at these knots 🪢
Zizhao Chen@ch272h.bsky.social · 8mo ago🧩Natural language isn’t all you need. We’re great at evaluating text-based reasoning (MATH, AIME…) but what about long-horizon visual reasoning? Enter 𝗞𝗻𝗼𝘁𝗚𝘆𝗺: a minimalistic testbed for evaluating agents on spatial reasoning along a difficulty ladder
Hi all, I will be at #NeurIPS2025 to present my work on stress-testing looooooong visual reasoning with KnotGym🥨 Let's talk, whether or not your VLM that can see 14 million possible futures like Doctor Strange
COLM is going to San Francisco for 2026! 🗓️Dates: October 6-9, 2026 🏨Venue: Hilton San Francisco Union Square Website and CFPs for papers and workshops coming up soon!
Pushed a big update to LM-class (v2025.2) -- this second version makes a much more mature resource Many refinements of lecture slides + significant improvements to the assignments Many thanks to @ch272h.bsky.social, Yilun Hua, and Shankar Padmanabhan for their work on the assignments
I am potentially recruiting a postdoctoral fellow through this program. If interested, name me as a mentor, and ping me to let me know that you are applying! The process includes some sort of interview, so I can try to squeeze a few of these in advance (it will help a lot!)
Yoav Artzi@yoavartzi.com · 9mo agoCornell is recruiting for multiple postdoctoral positions in AI as part of two programs: Empire AI Fellows and Foundational AI Fellows. Positions are available in NYC and Ithaca. Deadline for full consideration is Nov 20, 2025! academicjobsonline.org/ajo/jobs/30971
Cornell is recruiting for multiple postdoctoral positions in AI as part of two programs: Empire AI Fellows and Foundational AI Fellows. Positions are available in NYC and Ithaca. Deadline for full consideration is Nov 20, 2025! academicjobsonline.org/ajo/jobs/30971
Cornell (NYC and Ithaca) is recruiting AI postdocs, apply by Nov 20, 2025! If you're interested in working with me on technical approaches to responsible AI (e.g., personalization, fairness), please email me. academicjobsonline.org/ajo/jobs/30971
Cornell University, Empire AI Fellows Program
Job #AJO30971, Postdoctoral Fellow, Empire AI Fellows Program, Cornell University, New York, New York, US
academicjobsonline.org
Recent IVADO talk is now on YouTube: www.youtube.com/watch?v=ozHk... Paper here: Pre-training Limited Memory Language Models with Internal and External Knowledge Linxi Zhao et al. arxiv.org/abs/2505.15962
Pre-Training LLMs to Externalize Knowledge - Yoav Artzi
YouTube video by IVADO
youtube.com
i believe ours is the only paper discussing this. enjoy arxiv.org/abs/2502.20273
How Much is Enough? The Diminishing Returns of Tokenization Training Data
Tokenization, a crucial initial step in natural language processing, is governed by several key parameters, such as the tokenization algorithm, vocabulary size, pre-tokenization strategy, inference st...
arxiv.org
How much data people use to train tokenizers nowadays? Trying to figure out, but so often people just use a trained tokenizer, so a bit tricky cc @soldaini.net and the OLMo folks
Closing session for #COLM2025! There will be #COLM2026! @yoavartzi.com and @gregdnlp.bsky.social will be organizing. Location TBD. Full day of workshops tomorrow, check the program.
We are excited to announce 4 outstanding papers 🏆🏆🏆🏆 --> 🧵
My feed is on 🔥🔥🔥🔥 Can't wait to meet you all It's C-11 hours!
Maria Antoniak@mariaa.bsky.social · 10mo agoHere’s a #COLM2025 feed! Pin it 📌 to follow along with the conference this week!
Just found out the @IVADO_Qc summer bootcamp has published shiny top-notch videos of the talks. Here's mine: www.youtube.com/watch?v=b5OR... Covering @ch272h.bsky.social's ReSpect work, and Giovanni Monea's ICRL work
Research Talk - Post-Training via Agent Interraction
YouTube video by IVADO
youtube.com
