AIs are helping automate science, but do they uphold research integrity principles while working autonomously? Most models cave in to questionable research practice request. Paper: arxiv.org/abs/2605.29468 Data & Code: github.com/sciosci/SciI... Website: sciosci.github.io/sciintbench/

SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing

Large language models (LLMs) are increasingly used to support scientific work, but it is unclear whether they uphold responsible conduct of research (RCR) norms or help undermine them. We introduce Sc...

arxiv.org

Great piece by jeffreybrainard.bsky.social with comments from others www.science.org/content/arti...

AI tool labels more than 1000 journals for ‘questionable,’ possibly shady practices

New algorithm could help scientists avoid publishing in shady titles

science.org

Daniel Acuna@danielacuna.bsky.social · 11mo ago

🚨New paper🚨 Open access has expanded science’s reach but also fueled the rise of "questionable" journals. Manual vetting can’t keep pace with thousands of titles and bad actors who adapt quickly. Wrong incentives too strong. In a new Science Advances paper we ask: can AI help?

Can AI help identify high-volume, low-quality, “questionable” scientific journals (which some, controversially, call #predatoryjournals )? Authors of this new study emphasize aiding not replacing human evaluators of these journals. @science.org www.science.org/content/arti...

AI tool labels more than 1000 journals for ‘questionable,’ possibly shady practices

New algorithm could help scientists avoid publishing in shady titles

science.org

🚨New paper🚨 Open access has expanded science’s reach but also fueled the rise of "questionable" journals. Manual vetting can’t keep pace with thousands of titles and bad actors who adapt quickly. Wrong incentives too strong. In a new Science Advances paper we ask: can AI help?

Who are these hundreds of people who started following me recently? I mean, hi 👋, but how did you find me without any advertisement from my part? 😅 This place is starting to look great.

Excited to share a new article with Han Zhuang in Quantitative Studies of Science! "Incorporating costs and benefits to the evaluation of uncertain research results," we propose a unified framework for deciding when to continue research, even if it might be wrong 🤯. direct.mit.edu/qss/article/...

Incorporating costs and benefits to the evaluation of uncertain research results: applications to cancer research funding

Abstract. Correctness is a key aspiration of the scientific process, yet recent studies suggest that many high-profile findings may be difficult to replicate or require considerable evidence for verif...

direct.mit.edu

Tenure/tenure-track faculty positions in NLP in CS. Looking for people in science of science! Super interdisciplinary dept, great place to work and grow, amazing location. Learn more jobs.colorado.edu/jobs/JobDeta... Feel free to reach out and ask about the position and details.