Anyone at ICML (or in Seoul) want to play against an AI in visual quiz bowl at our workshop on the 10th, lunchtime? We have AI opponents and teammates. Reply here or send me an e-mail (jbg@umiacs.umd.edu), subject "EMMQA Expo". Leads appreciated! youtu.be/VrsEn_69Nb8

Human vs. Computer Picture Trivia Competition at ICML 2026

YouTube video by Jordan Boyd-Graber

youtu.be

Some professional news: After adding use MoreResearch as _; use MoreMentoring as _; use MoreTeaching as _; use MoreService as _; the UMD trait solver has accepted the where-clause where Rob: Professor On this occasion, some thanks and some thoughts are in order! 1/5

Very delighted to announce the next step in my career! After my postdoc at ETH, I will begin a joint appointment at TU Wien and the Complexity Science Hub Vienna as an Assistant Professor in NLP. I'm so grateful to all who helped me along the way And yes, I’m hiring! Details on PhD positions below

The first deadline for submitting a paper to our workshop is today, but there are lots of opportunities to participate: submit a trivia playing robot, play yourself, or write (multimodal) questions. Please share the word! (More details/links in the first comment.)

Can you spot when AI bluffs? Can you outguess AI or work with one to dominate trivia? Can you make an AI that can figure out tricky visual questions?

Liebe Medien, ich kann die Schlagzeile "Keine Einigung zwischen USA und Dänemark" nicht mehr sehen. Wenn ein Bewaffneter eine Bank stürmt, titelt ihr doch auch nicht: "Räuber und Kassiererin finden keinen Konsens über Geldübergabe." Hört auf, imperiale Aggression als normale Diplomatie zu framen.

Today's the deadline to apply for an AI-specific teaching track position at UMD: umd.wd1.myworkdayjobs.com/UMCP/job/Uni... Please join us!

My students and I are presenting three papers on Monday at #ACL2025 and this thread will recap them (including their videos).

The precursor to this paper "The Incoherence of Coherence" had our most-watched paper video ever, so I thought we had to surpass it somehow ... so we decided to do a song parody (of Roxanne, obviously): youtu.be/87OBxEM8a9E

ProxAnn (Sting Parody): An AI Alternative to NPMI [Research]

YouTube video by Jordan Boyd-Graber

youtu.be

Alexander Hoyle@alexanderhoyle.bsky.social · last yr.

Evaluating topic models (and document clustering methods) is hard. In fact, since our paper critiquing standard evaluation practices four years ago, there hasn't been a good replacement metric That ends today (we hope)! Our new ACL paper introduces an LLM-based evaluation protocol 🧵

We had our first human–computer cooperative AI tournament at the UMD. Key takeaways: 1) computers are getting better at trivia 2) they still suck at calibration 3) our teaming mechanic kept the games competitive and mostly fun (at least that’s what the players said).

Today is the deadline to sign up for our Human-Computer trivia competition held on June 14, 2024 in College Park, MD. $150 prize for the team who can answer the most questions with the help of an AI.

Do you like trivia? Can you spot when AI is feeding you BS? Or can you make AIs turn themselves inside out? Then on June 14 at College Park (or June 21 online), we have a competition for you.

New Pleias paper: "What the HellaSwag?" HellaSwag is currently on of the most widely LLM benchmarks in the world. We introduce a new critical method to assess the validity of standard LLM evals and show it does not accurately measure common sense reasoning. arxiv.org/abs/2504.07825

This was a really fun paper to put together with Rachel and @boydgraber.bsky.social allowing me to vent many of my frustrations working with MCQA over the past year 😪🫡 Please check out the paper, we would love to hear your feedback! 📄👇

🚨 You are only evaluating a slice of your test-time scaling model's performance! 🚨 📈 We consider how models’ confidence in their answers changes as test-time compute increases. Reasoning longer helps models answer more confidently! 📝: arxiv.org/abs/2502.13962

Is anyone in my network connected to Align to Innovate? Or know somebody who is? alignbio.org

Align to Innovate

Reproducible. Scalable. Sharable. Improving research science with programmable experiments.

alignbio.org

Hi. I'm Andrew. I own New England's oldest map store because last year I moved across the country after an old guy retired and gave it to me Willy Wonka-style. Visit my store in Rhode Island. www.mapcenter.com

In about half an hour, I'll be doing my annual Q&A session on grad admissions: youtube.com/live/jVjTbPH...

At its heart, Star Trek is a utopian fantasy about a society so advanced that they are capable of holding productive meetings that last no longer than three minutes

I just made my way to Bluesky, so I thought it might be a good opportunity to shamelessly remind people to vote in the ACL board elections (where I'm running for an at large post on a platform of improving virtual conferences). Check your e-mail for "Reminder: ACL 2024 Elections - Please Vote".