Ken Holstein

@kenholstein.bsky.social

HCI Prof at CMU HCII: thecoalalab.com Research on: - technologies to augment human thinking and learning - participatory & responsible AI - human-AI interaction

I find this chart by Anthropic about theoretical vs. actual AI usage, from @pbump.com's latest newsletter, very funny, and I think it's worth explaining why, and also please push back on any of this if you disagree, as I may write about it in the future. 🧵

"Theoretical capability and observed usage by occupational category" a chart by Anthropic, showing that (in theory I guess) management, biz and finance, computers and math, architecture and engineering life & social sciences, the law, arts and media, sales and office & admin could all be using AI a lot but somehow aren't

I am recruiting a postdoc in HCI & AI!
 Interested in augmenting human thinking and learning, futures of work & education, participatory AI, collective intelligence, or related topics? Please get in touch! This 2-year position will be based at a top university in Europe (email or DM for more info)

In case you missed it in the flurry of NeurIPS activity, @hannawallach.bsky.social and I recorded a (video) podcast on women in ML, friendship, research, and careers.

Jenn Wortman Vaughan@jennwv.bsky.social · 8mo ago

On my way to San Diego for #NeurIPS and the 20th anniversary of #WiML! To celebrate, @hannawallach.bsky.social and I recorded a podcast discussing WiML’s journey, our friendship and collaborations, research we're excited about, & advice we'd give our younger selves! www.microsoft.com/en-us/resear...

Can public involvement in AI evaluation improve the science? Or does it compromise quality, speed, cost? In @pnas.org, Megan Price & I summarize challenges of AI evaluation, review strengths/weaknesses, & suggest how participatory methods can improve the science of AI www.pnas.org/doi/10.1073/...

How public involvement can improve the science of AI | PNAS

As AI systems from decision-making algorithms to generative AI are deployed more widely, computer scientists and social scientists alike are being ...

pnas.org

A subtle aspect of predictive modeling is target variable construction: the process of translating a latent, unobservable concept like "healthcare need" into a prediction target But how does target variable construction unfold in practice, and how can we better support it going forward? #CSCW2025 🧵

Bild

LLM safety work often reasons over high-level policies (be helpful & polite), but must tackle on-the-ground cases (unsolicited money advice when stocks are mentioned). This can feel like driving on an unfamiliar road guided by a generic driver’s manual instead of a map. We introduce: Policy Maps 🗺️

There is a lot of talk and effort to figure out how genAI is different (I am also guilty of this!) -- the reality is that genAI is not that different and genAI is not that new either; it was hard to evaluate in the past, and it is still as hard to evaluate now #facct2025

Somewhat oddly, the Trump regime's initial moves to cut science funding went very broad. This is catalyzing solidarity & advocacy around the value of science (see comms featuring cancer cures & tech innovation). But their next move may be to try to drive a wedge b/w "good science" & "bad science".

🏛️ How can we ensure that AI enhances, rather than harms, public services? In our policy memo, published with the Federation of American Scientists (@scientistsorg.bsky.social), we provide recommendations for how the fed gov't could help state & local agencies make better AI procurement decisions.🧵

Expanding Local Government Capacity for AI Procurement and Use

As new waves of AI technologies continue to enter the public sector, touching a breadth of services critical to the welfare of the American people, this center of excellence will help maintain high st...

fas.org