I'll be defending my dissertation at NYU next Monday, June 16 at 4pm ET! I've definitely missed inviting some people who might be interested, so please email me if you'd like to attend (NYC or Zoom)
William Merrill
@lambdaviking.bsky.social
Will irl - PhD student @ NYU on the academic job market! Using complexity theory and formal languages to understand the power and limits of LLMs https://lambdaviking.com/ https://github.com/viking-sudo-rm
As we’ve been working towards training a new version of OLMo, we wanted to improve our methods for measuring the Critical Batch Size (CBS) of a training run, to unlock greater efficiency. but we found gaps between the methods in the literature and our practical needs for training OLMo. 🧵
✨How does the depth of a transformer affect its reasoning capabilities? New preprint by myself and @Ashish_S_AI shows that a little depth goes a long way to increase transformers’ expressive power We take this as encouraging for further research on looped transformers!🧵
Wow, authors' copies have just arrived! So cool (and kinda strange lol) to see our work in print! Amazing job from @commonnotions.bsky.social! Love the cover design from Josh MacPhee <3 Get a copy here: www.commonnotions.org/why-we-fear-ai
Excited to announce that the (stellar!) program for NASSLLI is out now: nasslli25.shane.st Further details on registration and whatnot to follow in the coming weeks. Please do circulate to anyone you know who may be interested in attending!
North American Summer School on Logic, Language and Information (NASSLLI '25) @ UW
Official website for the North American Summer School for Logic, Language and Information, taking place June 23-27 at the Univeristy of Washington, Seattle.
nasslli25.shane.st
This is a call to action. The vast majority of us are furious that our constitution is being blatantly violated at the highest levels of government. Here’s a simple way to use your voice - all you need is tape and access to a printer:
eruditio olmonis est omnis divisa in partes tres: praeeruditionem, eruditionem seram, et posteruditionem
Luca Soldaini 🎀@soldaini.net · 2y agohearing reports from r/localLlama that OLMo 2 is decent at latin?… love that it’s the first thing someone thought to try
hearing reports from r/localLlama that OLMo 2 is decent at latin?… love that it’s the first thing someone thought to try
Meet OLMo 2, the best fully open language model to date, including a family of 7B and 13B models trained up to 5T tokens. OLMo 2 outperforms other fully open models and competes with open-weight models like Llama 3.1 8B — As always, we released our data, code, recipes and more 🎁
A starter pack for research on Formal Languages and Neural Networks! go.bsky.app/eKG7Ua
This is actually really cool! I used it today to surface results on a topic I’ve been curious about for a while but where conventional search failed (the complexity of the word problem for finitely generated monoids) www.semanticscholar.org/paper/On-the...
[PDF] On the complexity of the word problem of the R. Thompson group V | Semantic Scholar
It is shown that this word problem is the complement of the cyclic closure of a union of reverse deterministic context-free languages and the deterministic time-complexity of the word problem of V is ...
semanticscholar.org
Akari Asai@akariasai.bsky.social · 2y ago1/ Introducing ᴏᴘᴇɴꜱᴄʜᴏʟᴀʀ: a retrieval-augmented LM to help scientists synthesize knowledge 📚 @uwnlp.bsky.social & Ai2 With open models & 45M-paper datastores, it outperforms proprietary systems & match human experts. Try out our demo! openscholar.allen.ai