Harry Surden

@harrysurden.bsky.social

Professor, University of Colorado Law School • Associate Director Stanford CodeX Center for Legal Informatics. Research: Artificial Intelligence and Law

I am quite impressed with @Google's Gemini Experimental 12-06 model, released today. This is the first version of Gemini that I consider fully on par with (or perhaps exceeding) GPT-4o and Claude Claude 3.5 Sonnet, in my private AI capability test suite. cc:JeffDean

Bild

I'm recruiting 1-2 PhD students to work with me at the University of Colorado Boulder! Looking for creative students with interests in #NLP and #CulturalAnalytics. Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎 Apply by December 15th!

A photo of Boulder, Colorado, shot from above the university campus and looking toward the Flatirons.

How do LLMs learn to reason from data? Are they ~retrieving the answers from parametric knowledge🦜? In our new preprint, we look at the pretraining data and find evidence against this: Procedural knowledge in pretraining drives LLM reasoning ⚙️🔢 🧵⬇️