@chenhaotan.bsky.social

Associate professor at the University of Chicago. Working on human-centered AI, NLP, CSS. https://chenhaot.com, https://substack.com/@cichicago

Open AI-assisted review tools could help researchers get better feedback, improve paper quality, and make the review process more scalable. But final publication decisions should remain under human oversight, via @chenhaotan.bsky.social openaireview.github.io/blog.html

AI-assisted Reviewing is Necessary and Should be Open

Peer review is facing a death spiral. AI production tools are speeding it up. AI-assisted reviewing is necessary and should be open.

openaireview.github.io

It is open, can and will be improved! Feedback like these is highly appreciated. The issue is here: github.com/ChicagoHAI/O...

improve overall feedback · Issue #27 · ChicagoHAI/OpenAIReview

Right now, overall feedback has not been evaluated. It can certainly be improved.

github.com

Jessica Hullman@jessicahullman.bsky.social · 5mo ago

I ran this in progressive mode w/Opus4.6 on a paper where refine.ink had given me very useful feedback. It caught many of the same minor issues! Main difference was in high level feedback-with refine it was much closer to what I'd expect from experts. But not bad for a fraction of refine cost! (~$3)

Peer review is facing a death spiral, and AI production tools are speeding it up. AI-assisted reviewing is necessary and should be open. We built OpenAIReview: open AI reviewing for everyone, for the cost of a coffee. openaireview.github.io/blog.html 🧵

AI-assisted Reviewing is Necessary and Should be Open

Peer review is facing a death spiral. AI production tools are speeding it up. AI-assisted reviewing is necessary and should be open.

openaireview.github.io

📖 ≠ 🧪 The Story is Not the Science. Code is submitted but rarely executed during peer review—an issue likely to worsen with research agents. 🧑‍🔬 We introduce 𝐌𝐞𝐜𝐡𝐄𝐯𝐚𝐥𝐀𝐠𝐞𝐧𝐭, an execution-grounded evaluation of narrative + execution. 𝐕𝐞𝐫𝐢𝐟𝐲 𝐭𝐡𝐞 𝐬𝐜𝐢𝐞𝐧𝐜𝐞, 𝐧𝐨𝐭 𝐣𝐮𝐬𝐭 𝐭𝐡𝐞 𝐬𝐭𝐨𝐫𝐲. 1/n

Bild

I've often joked that as faculty I program in a high-level language called "graduate student". Having tried out Claude Code this morning, I (i) feel extremely at home, (ii) am realizing that research-by-graduate-student is perhaps the original vibe-coding. 1/2

I've seen this message and similar echos for other writing, and I want strongly push back on this narrative. It's not that you shouldn't use ChatGPT but that you shouldn't *use ChatGPT to write it for you*. ChatGPT—and AI in general—is not a monolith. How you use it matters.

Dr. Holly Walters@manigarm.bsky.social · 7mo ago

I have some bad news. One, if you need to use ChatGPT for your graduate application letter, you are not ready for graduate school. Two, no, not "everyone is doing it" and those who don't do it aren't "losing out." ChatGPT is not an advantage.

I certainly did not realize that this is such a controversial take: Chenhao: "Finding the equilibrium of publishing will take at least a decade." 25% agree, 75% disagree

The recent days have been horrific. We can't become numb to repeated instances of illegal and unconstitutional action by government agencies. It's even worse when public officials are blatantly lying in ways that contradict dozens of pieces of video evidence.

Aaron Rupar@atrupar.com · 7mo ago

Sen. Lankford blatantly lies about what the video of Renee Good's killing shows: "A classic law enforcement moment -- they have to fire their weapon and then when you see her car crash, law enforcement is running to her to provide aid. They're never looking to be able to take a life of individuals."

We have an important #FAccT2026 update! Our new dates are June 25-June 28 and our new location is Le Centre Sheraton Montréal. We’re so sorry for any inconvenience caused by this change! Why the change? Thread --> 1/n