Tessera
Folgen

Willie Neiswanger

@willieneis.bsky.social

Assistant Professor in CS + AI at USC. Previously at Stanford, CMU. Machine Learning, Decision Making, AI-for-Science, Generative AI, ML Systems, LLMs. https://willieneis.github.io

235 Posts7234 Follower190 Folgt
Ameya Godbole@ameyagodbole.bsky.social · 10mo ago

Announcing 🔭Hubble, a suite of open-source LLMs to advance the study of memorization! Pretrained 1B/8B param models, with controlled insertion of texts designed to emulate key memorization risks: copyright (e.g., book passages), privacy (e.g., synthetic biographies), and test set contamination

Hubble Suite logo (cloth patch with names of key organizations involved: USC, MPI, NVIDIA)
Shangshang Wang@shangshang-wang.bsky.social · last yr.

😃 Want strong LLM reasoning without breaking the bank? We explored just how cost-effectively RL can enhance reasoning using LoRA! [1/9] Introducing Tina: A family of tiny reasoning models with strong performance at low cost, providing an accessible testbed for RL reasoning. 🧵

Bild
Keenan Crane@keenancrane.bsky.social · 2y ago

Entropy is one of those formulas that many of us learn, swallow whole, and even use regularly without really understanding. (E.g., where does that “log” come from? Are there other possible formulas?) Yet there's an intuitive & almost inevitable way to arrive at this expression.

Gabriele Corso@gcorso.bsky.social · 2y ago

Thrilled to announce Boltz-1, the first open-source and commercially available model to achieve AlphaFold3-level accuracy on biomolecular structure prediction! An exciting collaboration with Jeremy, Saro, and an amazing team at MIT and Genesis Therapeutics. A thread!

Bild
Nathan Lambert@natolambert.bsky.social · 2y ago

There are a lot of discussion on if "scaling is done," with stories from the Information saying that the latest GPT models aren't showing what OpenAI wanted while Sam Altman still parades around saying AGI is near. I wanted to explain why both of these can be true.