Andrea de Varda

@andreadevarda.bsky.social

Postdoc at MIT BCS, interested in language(s) in humans and LMs https://andrea-de-varda.github.io/

What makes some stimuli more memorable than others? In a new paper w/ @davogelsang.bsky.social, we show that the magnitude of a stimulus's ANN representation predicts both image and word memorability Stimuli that activate more features, more strongly, leave a stronger memory trace Out now in JML⬇️

Bild

The human brain is strikingly modular: distinct networks for language, formal reasoning, social reasoning, physical reasoning. Is this fundamental to intelligent systems, or an accident of evolution? In our new preprint, we find the same modular organization emerges in LLMs.

New preprint! w/@drhanjones.bsky.social Adding human-like memory limitations to transformers improves language learning, but impairs reading time prediction This supports ideas from cognitive science but complicates the link between architecture and behavioural prediction arxiv.org/abs/2508.05803

Human-like fleeting memory improves language learning but impairs reading time prediction in transformer language models

Human memory is fleeting. As words are processed, the exact wordforms that make up incoming sentences are rapidly lost. Cognitive scientists have long believed that this limitation of memory may, para...

arxiv.org

Next week I’ll be in Vienna for my first *ACL conference! 🇦🇹✨ I will present our new BLiMP-NL dataset for evaluating language models on Dutch syntactic minimal pairs and human acceptability judgments ⬇️ 🗓️ Tuesday, July 29th, 16:00-17:30, Hall X4 / X5 (Austria Center Vienna)

The BLiMP-NL dataset consists of 84 Dutch minimal pair paradigms covering 22 syntactic phenomena, and comes with graded human acceptability ratings & self-paced reading times. 

An example minimal pair:
A. Ik bekijk de foto van mezelf in de kamer (I watch the photograph of myself in the room; grammatical)
B. Wij bekijken de foto van mezelf in de kamer (We watch the photograph of myself in the room; ungrammatical)

Differences in human acceptability ratings between sentences correlate with differences in model syntactic log-odds ratio scores.

Many LM applications may be formulated as text generation conditional on some (Boolean) constraint. Generate a… - Python program that passes a test suite. - PDDL plan that satisfies a goal. - CoT trajectory that yields a positive reward. The list goes on… How can we efficiently satisfy these? 🧵👇