Brian Nosek
@briannosek.bsky.social
Co-founder of Project Implicit, Society for Improving Psychological Science, and the Center for Open Science; Professor at the University of Virginia
Congratulations to the project “Love Replications Week,” which received🏆2026 SIPS commendation! During the Love Replications Week, the researchers gathered to learn about best practices, to get in touch with experts, and to join an open community of researchers who want to support replications.
I wrote about science funding, science reform, and anti-science agendas. scatter.wordpress.com/2026/07/31/s...
science funding and the cherry picking problem
Science publishing–like all of science–requires money. There’s no getting around it, even with the open science movement. What appears free to many authors and readers still requires money and infr…
scatter.wordpress.com
New paper in @nature.com with @lukebeehewitt.bsky.social, @isaiasghezae.bsky.social, & @robbwiller.bsky.social: Can LLMs predict results of social science experiments? Across 70 experiments, we find a strong correspondence (r=.85) between predicted and observed effects. doi.org/10.1038/s415... 🧵
More to come from @datarescueproject.org but from me it has been a huge honor to work with & get to know this group of professionals who care deeply about research & repositories. I am proud of this collective work & my effort to represent librarians, DRP volunteer comm, & soc sci data. Much ❤️!
Center for Open Science@cos.io · 6d agoCOS is working with a committee of experts through the Coalition for Resilient Research Data Infrastructure to develop a strategic plan for strengthening federally funded research data infrastructure. We want to hear from you! The draft plan is open to feedback until Sept 30:
Thank you to the strategic planning committee for this important work to advance resilient data infrastructure. Please review and offer feedback on the draft plan!
Center for Open Science@cos.io · 6d agoCOS is working with a committee of experts through the Coalition for Resilient Research Data Infrastructure to develop a strategic plan for strengthening federally funded research data infrastructure. We want to hear from you! The draft plan is open to feedback until Sept 30:
COS is working with a committee of experts through the Coalition for Resilient Research Data Infrastructure to develop a strategic plan for strengthening federally funded research data infrastructure. We want to hear from you! The draft plan is open to feedback until Sept 30:
Announcing the Coalition for Resilient Research Data Infrastructure (CRRDI) Strategic Plan
The Center for Open Science collaborated with research data infrastructure experts on a strategic plan for the Coalition for Resilient Research Data Infrastructure—a coalition working to build a more resilient ecosystem for federally funded research data. The draft is available for community comment.
cos.io
#Preregistration supports #OpenScience, but is uncommon in animal research. This Meta-Research study by @hannowuerbel.bsky.social reveals that despite known benefits, perceived bureaucracy, time costs and inflexibility hinder adoption. 🧪#AcademicSky @unibe.ch @swissrn.bsky.social plos.io/4pL0tXq
We show that LLMs are good at detecting outcome definition changes between registration versions: An automated approach to improve clinical trial registration and to identify outcome changes on ClinicalTrials.gov rdcu.be/fwHWo @ndevito1.bsky.social @mjpages.bsky.social @jamiecummins.bsky.social
An automated approach to improve clinical trial registration and to identify outcome changes on ClinicalTrials.gov
npj Digital Medicine - An automated approach to improve clinical trial registration and to identify outcome changes on ClinicalTrials.gov
rdcu.be
"If I publish something in a journal with an IF = 10, it gets more citations than if I publish it in a journal with IF = 5. Right?" With the serious game CITED_, you can explore this relationship for your own works: t1p.de/cited
CDC: Rates of cyclospora are asymptoting. Reporter: Horizontally, right? CDC: ...
Carl Zimmer@carlzimmer.com · 2w agoCyclospora asymptote cyclo-resources.pophive.org
You must acknowledge that this person exists, but not write for them:
every time you write overly defensively you should remember that you are pursuing a strategy of writing careful sentences specifically for people who demonstrably either won't or can't read them
BeijingPalmer@beijingpalmer.bsky.social · 2w agothere is literally no amount of caveats or careful wording that will protect you from stupidity or bad faith, so you might as well say things straightforwardly and strongly to begin with.
📅 Save the date! The Metascience 2027 conference will be held in Montreal on June 14–16, 2027. Metascience 2027 is a global gathering for knowledge sharing, community building, and opportunities to define research and intervention priorities to improve science.
Save the Date: Metascience 2027 Set for Montreal
The Tanenbaum Open Science Institute and Center for Open Science (COS) are bringing the Metascience 2027 conference to Montreal on June 14–16, 2027.
cos.io
🏆We are very pleased to announce the 2026 Awards Winners and Commendations recipients for the Society for the Improvement of Psychological Science! 👏Join us in celebrating the exceptional projects that have revolutionized the field of psychological science. buff.ly/2lUKGFd
SIPS 2026 Awards Announced!
We are very pleased to announce the 2026 Awards Winners for the Society for the Improvement of Psychological Science! Join us in celebrating the exceptional projects that have revolutionized the fi…
improvingpsych.org
You want lasagna? Well, sir, I am going to need to see some identification.
Aaron Rupar@atrupar.com · 2w agoScalise: "For God's sake -- you can't get pasta at Olive Garden without a picture ID! Why not be able to show a picture ID to vote?"
Metascience 2027 is scheduled for June 14-16 in Montreal. We are delighted to partner with the Tanenbaum Open Science Institute for this important meeting. Join the mailing list for updates at: metascience.info
Metascience 2027
A global gathering for knowledge sharing, community building, and opportunities to define a roadmap of research and intervention priorities to improve science.
metascience.info
Today we launch the first stable release of RegCheck: v1.0.0. RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice. A 🧵 on what's new: regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
An update from me about how COS is adapting to the destabilized moment for science to continue advancing openness, integrity, and trustworthiness of research. www.cos.io/blog/cos-mis...
COS Mission and Strategy Evolution
The Center for Open Science (COS)'s work has evolved with the maturation of the open science movement. Our strategic priorities focus on supporting the growth of lifecycle open science—making research...
cos.io
Super fun, and reflective, conversation with Randy.
Randy Ellis@randalljellis.bsky.social · 3w agoBrian Nosek has led some of the most impactful replication projects in psychology. Hear him tell the story of how he switched his undergrad focus from computer engineering to psychology, and how he ported his computational skills to his newfound research discipline.
👁️ Eye tracking comes with a distinct layer of technical infrastructure that is often underreported and not fully captured in other preregistration templates. Libby Jenke and Nicolette Sullivan developed the Eye Tracking template, now available on the OSF, to fill that gap. www.cos.io/blog/introdu...
Introducing the Eye Tracking Preregistration Template: Q&A with Libby Jenke and Nicolette Sullivan
Libby Jenke and Nicolette Sullivan created the Eye Tracking Preregistration Template, now available on the OSF, to guide researchers in decisions that precede data collection in eye tracking studies.
cos.io
For most scientific papers, coathors collaborate in the manuscript doc and someone manually enters analysis results/tables/figures into it. In this case, reproducibility effectively stops at the data and code. What this blog post presupposes is, what if it didn't? www.cos.io/blog/toward-...
Toward Collaborative Reproducible Manuscripts
The first active phase of COS's Benchmarking LLM Agents on Scientific Tasks project has produced ReplicatorBench—a benchmark for evaluating LLM agents on research replication in social & behavioral sc...
cos.io
COS submitted a public comment opposing proposed revisions in OMB’s Regulation for Federal Financial Assistance. We join 300+ orgs requesting an extension to the comment period. Request is yet to be granted; comment period closes July 13. Read our concerns & add your voice:
What OMB’s Proposed Grantmaking Revisions Could Mean for Research Integrity
The Center for Open Science (COS) submitted a public comment opposing several proposed revisions in the White House Office of Management and Budget’s proposed Regulation for Federal Financial Assistance. We share why we weighed in, our concerns, and how to add your voice.
cos.io
"Federal research funding has produced exceptional returns precisely because decisions about what to fund have rested on merit and independent expert judgment, rather than political alignment." @webmz.bsky.social comments on OMB's proposal rule for @cos.io www.cos.io/blog/what-om...
What OMB’s Proposed Grantmaking Revisions Could Mean for Research Integrity
The Center for Open Science (COS) submitted a public comment opposing several proposed revisions in the White House Office of Management and Budget’s proposed Regulation for Federal Financial Assistan...
cos.io
📢 APPLICATIONS OPEN: LMU Open Science Summer School. Deadline: July 6 Hybrid program with two tracks for early-career researchers: build practical open science skills or learn to teach open science. Keynote speakers include COS Senior Director of Research Tim Errington.
LMU OSSS26
program and application process
lmu-osc.github.io
Last fall, COS announced an initiative that systematically evaluates how well LLM agents can perform & reason through the research lifecycle. The first active phase produced ReplicatorBench—a benchmark for evaluating LLM agents on replication in social & behavioral sciences.
Benchmarking LLM Agents on Scientific Tasks: Introducing ReplicatorBench
The first active phase of COS's Benchmarking LLM Agents on Scientific Tasks project has produced ReplicatorBench—a benchmark for evaluating LLM agents on research replication in social & behavioral sciences
cos.io
I am with my daughter for her summer internship at UCLA for a few weeks. She insists their dorm food is #1 ranked nationally. I lecture that it is unlikely the proper data exist to make that claim confidently. We went to the dining hall together today. It. Was. Awesome.
Some new work on AI & science: A reporting checklist for LLMs in behavioral science Thanks to @sfeuerriegel.bsky.social for spearheading. As LLMs become more common in research, transparency is essential. We developed a reporting checklist for reporting how LLMs were used - please share! 1/4
A reporting checklist for large language models in behavioural science - Nature Human Behaviour
Large language models offer new opportunities for behavioural science, but their rapid evolution poses challenges for research rigour. We introduce a consensus-based reporting checklist to improve tra...
nature.com
⚡ Metaventory: building better science ⚡ Had many discussions about the need for mapping out all that's meta-science: people, tools, events, jobs, simulations, etc. in one place. Metaventory aims to help connect those interested in meta-science & improving science. metaventory.vercel.app
