Tessera

Folgen

Sam Blouir

@samblouir.bsky.social

Thanks for coming to “Foundation Models for Biological Discoveries” (FMs4Bio) @ AAAI 2025!

21 Posts1987 Follower 3852 Folgt

Mete @mismayil.bsky.social · last yr.

I am attending @naaclmeeting.bsky.social this week to present our paper. Come check out our poster at 14:00, Apr 30 in Hall 3 . @defnecirci.bsky.social and Hale Sirin will also be there to answer your questions!

Mete@mismayil.bsky.social · last yr.

Are LLMs linguistically productive and systematic in morphologically-rich languages as good as humans? No 🤨 Our new NAACL 2025 paper (arxiv.org/abs/2410.12656) reveals a significant performance gap between LLMs and humans in linguistic creativity and morphological generalization.

Sam Blouir @samblouir.bsky.social · last yr.

#ICLR2025 & #ACMHCI are a wrap! 🎉 Couldn't ask for better vibes, conversations, and food. 🧬 BirdieDNA 🗣️ SLP Sidekick 🤖 Agents for Genomics Big thanks to my co-authors @defnecirci.bsky.social, Flavia Negrete, Celeste Watkins, Asher Moldwin & Amarda Shehu, absolute rockstars 🤝🙏

Sam Blouir @samblouir.bsky.social · 2y ago

Meet Birdie 🐤! Our EMNLP 2024 paper boosts SSMs like Mamba and Hawk on long-range, context-heavy tasks, closing the gap with Transformers. Proud to work with @jimmysmith1919.bsky.social, @antonisa.bsky.social, & Amarda Shehu. 📄 Paper: arxiv.org/abs/2411.01030 💻 Code: github.com/samblouir/bi...

The multi-number phonebook retrieval task entails retrieving several phone numbers from a phonebook at once, given names.

Hawk trained using Birdie strongly outperforms Hawk trained using Next Token Prediction on the multi-number phonebook retrieval task.

Hawk trained using Next Token Prediction performs just above random guessing when retrieving 1 and 4 phone numbers, and falls to random performance when retrieving more than 4 phone numbers.

In contrast, Hawk trained using Birdie gets 100% accuracy when retrieving 1 phone number. That 100% score slowly decays to about 80% accuracy when retrieving up to 32 phone numbers simultaneously.

Two Transformers are included, one trained using Birdie, and the other trained using Next Token Prediction. They both always achieve about 100% accuracy, even when retrieving 32 phone numbers.