Tessera
Folgen

@chenhaotan.bsky.social

Associate professor at the University of Chicago. Working on human-centered AI, NLP, CSS. https://chenhaot.com, https://substack.com/@cichicago

315 Posts4147 Follower310 Folgt
@chenhaotan.bsky.social · 2mo ago

It is very hard to keep up with multiple social media on multiple platforms. Allow me to share some old news. When ICML wrapped up, we used AI agents to review and replicate all 168 oral papers, including 105 full replications. The results are in this blog: sai.science/blog/how-muc...

How much science is verifiable? Results from replicating ICML 2026 oral papers

When ICML wrapped up, we used AI agents to review and replicate every oral paper to see what we can learn from actually verifying the science.

sai.science

Paperpile@paperpile.com · 8mo ago

Open AI-assisted review tools could help researchers get better feedback, improve paper quality, and make the review process more scalable. But final publication decisions should remain under human oversight, via @chenhaotan.bsky.social openaireview.github.io/blog.html

AI-assisted Reviewing is Necessary and Should be Open

Peer review is facing a death spiral. AI production tools are speeding it up. AI-assisted reviewing is necessary and should be open.

openaireview.github.io

@chenhaotan.bsky.social · 8mo ago

It is open, can and will be improved! Feedback like these is highly appreciated. The issue is here: github.com/ChicagoHAI/O...

improve overall feedback · Issue #27 · ChicagoHAI/OpenAIReview

Right now, overall feedback has not been evaluated. It can certainly be improved.

github.com

Jessica Hullman@jessicahullman.bsky.social · 8mo ago

I ran this in progressive mode w/Opus4.6 on a paper where refine.ink had given me very useful feedback. It caught many of the same minor issues! Main difference was in high level feedback-with refine it was much closer to what I'd expect from experts. But not bad for a fraction of refine cost! (~$3)

@chenhaotan.bsky.social · 8mo ago

Peer review is facing a death spiral, and AI production tools are speeding it up. AI-assisted reviewing is necessary and should be open. We built OpenAIReview: open AI reviewing for everyone, for the cost of a coffee. openaireview.github.io/blog.html 🧵

AI-assisted Reviewing is Necessary and Should be Open

Peer review is facing a death spiral. AI production tools are speeding it up. AI-assisted reviewing is necessary and should be open.

openaireview.github.io

Mourad Heddaya@mheddaya.bsky.social · 8mo ago

Local ballot measures are now on CivicChats! Local elections happen year-round, 10+ states have measures coming up in the next few months. Check your ballot and think through what you'll be voting on → civicchats.org

Mourad Heddaya@mheddaya.bsky.social · 8mo ago

Democracy depends on an informed electorate. But political issues and ballot measures can be confusing, obscuring the effects of one outcome versus another. And politics is personal. Once we make an initial decision, it can be hard to see things from "the other side."

Xiaoyan Bai@elenal3ai.bsky.social · 9mo ago

📖 ≠ 🧪 The Story is Not the Science. Code is submitted but rarely executed during peer review—an issue likely to worsen with research agents. 🧑‍🔬 We introduce 𝐌𝐞𝐜𝐡𝐄𝐯𝐚𝐥𝐀𝐠𝐞𝐧𝐭, an execution-grounded evaluation of narrative + execution. 𝐕𝐞𝐫𝐢𝐟𝐲 𝐭𝐡𝐞 𝐬𝐜𝐢𝐞𝐧𝐜𝐞, 𝐧𝐨𝐭 𝐣𝐮𝐬𝐭 𝐭𝐡𝐞 𝐬𝐭𝐨𝐫𝐲. 1/n

Bild
Johan Ugander@jugander.bsky.social · 10mo ago

I've often joked that as faculty I program in a high-level language called "graduate student". Having tried out Claude Code this morning, I (i) feel extremely at home, (ii) am realizing that research-by-graduate-student is perhaps the original vibe-coding. 1/2

David Jurgens@davidjurgens.bsky.social · 9mo ago

I've seen this message and similar echos for other writing, and I want strongly push back on this narrative. It's not that you shouldn't use ChatGPT but that you shouldn't *use ChatGPT to write it for you*. ChatGPT—and AI in general—is not a monolith. How you use it matters.

Dr. Holly Walters@manigarm.bsky.social · 9mo ago

I have some bad news. One, if you need to use ChatGPT for your graduate application letter, you are not ready for graduate school. Two, no, not "everyone is doing it" and those who don't do it aren't "losing out." ChatGPT is not an advantage.

@chenhaotan.bsky.social · 10mo ago

I certainly did not realize that this is such a controversial take: Chenhao: "Finding the equilibrium of publishing will take at least a decade." 25% agree, 75% disagree