A package of papers looking at the social and behavioural sciences shows the value of researchers collaborating to further the cause of reproducible, replicable and robust findings go.nature.com/4cjtN1X

More self-reflection in research can lead to better science

A package of papers looking at the social and behavioural sciences shows the value of researchers collaborating to further the cause of reproducible, replicable and robust findings.

go.nature.com

Replication, robustness reproducibility of results across the behavioural + social sciences www.nature.com/articles/s41... www.nature.com/articles/s41... www.nature.com/articles/s41... www.nature.com/articles/s41... @balazsaczel.bsky.social @szaszibarnabas.bsky.social @briannosek.bsky.social

Investigating the analytical robustness of the social and behavioural sciences - Nature

When 100 social and behavioural science claims were examined, 34% of reanalyses closely matched the original results, with 74% reaching the same conclusion, revealing limited robustness of single...

nature.com

📄Published Today in Nature: 500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social). Article: www.nature.com/articles/s41... Preprint: osf.io/preprints/me... TLDR: 1/11

Really excited to see this published! I contributed a small part by doing one of the "robustness replications" as my econ friends call it. Stellar coordination effort by @balazsaczel.bsky.social, @szaszibarnabas.bsky.social et al.!

Joris Frese@fresejoris.bsky.social · 4mo ago

📄Published Today in Nature: 500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social). Article: www.nature.com/articles/s41... Preprint: osf.io/preprints/me... TLDR: 1/11

Preprint alert: Simulation-based validation of Bayes Factor computation with @paulbuerkner.com and S. Stroppel. We bring lessons learned in SBC to validation of BFs. arxiv.org/abs/2508.11814 The idea is simple: simulate data from the models, fit and see if the inferences are calibrated. 1/10

Simulation-based validation of Bayes factor computation

We propose and evaluate two methods that validate the computation of Bayes factors: one based on an improved variant of simulation-based calibration checking (SBC) and one based on calibration metrics...

arxiv.org

Our lab has the capacity to test ~500 uni students each semester If you’re a researcher in cognitive psychology or metascience and need data collection support, we’d love to collaborate. We can help collect high-quality data from a large student sample. Get in touch to discuss potential projects!

Our lab has the capacity to test ~500 uni students each semester If you’re a researcher in cognitive psychology or metascience and need data collection support, we’d love to collaborate. We can help collect high-quality data from a large student sample. Get in touch to discuss potential projects!

www.reuters.com/legal/govern...

See you in Melbourne in Nov 2027, SIPSers and AIMOSers! #metascience

Society for the Improvement of Psychological Science (SIPS)@improvingpsych.org · 6mo ago

📅 Mark your calendars for #SIPS2027! The 2027 SIPS conference, organized in collaboration with the Association for Interdisciplinary Meta-Research and Open Science @aimosinc.bsky.social, will be held in November at the University of Melbourne, Australia. We are looking forward to seeing you there!

Many analysts are not always equal analysts "Should every analyst's contribution be weighted equally?" From "Ten Strategies To Improve Many-Analysts Studies" by Alexandra Sarafoglou, @balazsaczel.bsky.social et al. Preprint: osf.io/preprints/ps... #MetaSci

Published today: One of the biggest #science #communication studies to date. We asked 71,922 people in 68 countries how they #engage with information about #science and combined the data with several country-level factors: journals.sagepub.com/doi/10.1177/... #OpenAccess

📚 Core principles of responsible generative AI usage in research link.springer.com/article/10.1...

Core principles of responsible generative AI usage in research - AI and Ethics

In a rapidly evolving Generative Artificial Intelligence (GenAI) landscape, researchers, policymakers, and publishers have to continuously redefine responsible research practices. To ensure guidance o...

link.springer.com

Make an effect size prediction! @jamiecummins.bsky.social and I are replicating Balcetis & Dunning's (2010) "chocolate is more desirable than poop" (Cohen's d = 4.52) Let us known in the replies what effect size you think we'll find. Details of the study in the thread below.

@mikemorrison.bsky.social will be sharing how #scientists and #SciComm folks can combine design and psychology principles to create engaging visual science communication tools. Join this Friday, Oct 17 @ 2pm ET for this FREE webinar. Sign up for Zoom link. waterwhys.org/seminar/fall...

I am happy to announce the publication of our new work on the impact of arbitrary analytical choices on type I and type II error rates. We simulated reaction time data in a conflict task and analyzed the notable CSE effect in a multiverse manner. Worrying results: link.springer.com/article/10.3...

Multiverse simulation to explore the impact of analytical choices on type I and type II errors in a reaction time study - Behavior Research Methods

Researcher degrees of freedom in data analysis present significant challenges in social sciences, where different analytical decisions can lead to varying conclusions. In this work, we propose an exam...

link.springer.com

www.nature.com/articles/d41...

Transparent peer review to be extended to all of Nature’s research papers

From today, all new submissions to Nature that are published will be accompanied by referees’ reports and author responses — to illuminate the process of producing rigorous science.

nature.com

www.nature.com/articles/d41...

Is it OK for AI to write science papers? Nature survey shows researchers are split

Poll of 5,000 researchers finds contrasting views on when it’s acceptable to involve AI and what needs to be disclosed.

nature.com

We are live! Introducing the "Journal of Robustness Reports" – a Diamond Open-Access journal dedicated to publishing short reanalyses of empirical findings. Check out our website and blog post about the journal: 🌐 scipost.org/JRobustRep 📄 www.bayesianspectacles.org/introducing-...

The Journal of Robustness Reports is here. Diamond open access. A model for #openscience and #metascience. @balazsaczel.bsky.social scipost.org/JRobustRep.0... 🧪

Love the idea scipost.org/JRobustRep "We hope that the Journal of Robustness Reports will help make reanalyses of published findings the norm across the empirical sciences." #diamondOA scipost.org/JRobustRep/a... @fbartos.bsky.social @balazsaczel.bsky.social @ejwagenmakers.bsky.social

Author copy arrived yesterday. It really was a joy working with @ejwagenmakers.bsky.social and Johnny (is he on here?) on this @jaspstats.bsky.social version of the book.

Two journals tried paying peer reviewers and found increased acceptance, earlier reports, and no change in quality. WHAT A SURPRISE! www.nature.com/articles/d41... @balazsaczel.bsky.social was cited from Eötvös L. Uni. Hungary (where I also teach)

Publishers trial paying peer reviewers — what did they find?

Two journals embarked on efforts to compensate reviewers, with different results.

nature.com

www.nature.com/articles/d41...

Could libraries band together to ensure open access for all?

Through the ‘subscribe to open’ model, libraries’ annual subscriptions ensure that paywalled journals become freely accessible, benefiting researchers and the public alike.

nature.com

🚀Very excited to finally see our paper on nonsignificance misinterpretations published! 📈 Together, @smurphee.bsky.social, Aurelio Fernández, Linda Reimann and I investigated the prevalence of "p > .05 = absence of an effect" interpretations. (1/4) doi.org/10.1098/rsos...

Don't forget to register to #SIPS2025 ! Early-bird deadline is March 15. www.improvingpsych.org/SIPS2025/

PSA Around the World online conference with focus on Central n Eastern Europe is in November (6, 14, 22). The abstracts are due March 31st. Open to anyone around the world and on any #philsci topic, but especially on the history and the present of the field in the region. Thanks to the organisers!

We outline how such a computational psychology of science can contribute to #metascience. Our findings suggest that collective efforts, tailored to group characteristics, may foster behavior change interventions in science, @balazsaczel.bsky.social 👉 doi.org/10.23668/psy... 🧵4/4

🚨 Is the peer review system broken? Our new PNAS paper dives into the biases, inefficiencies, and inconsistencies plaguing scientific publishing. Can transparency, training, and AI fix it? Evolution or revolution for peer review? 🔗 Read more: www.pnas.org/doi/10.1073/... @balazsaczel.bsky.social

Mark your calenders. The dates and topics of the upcoming workshops of the Paul Meehl Graduate School are announced. Stay tuned for more information paulmeehlschool.github.io/2025-02-10-s...

Upcoming Workshops: Finalized Dates & Topics | Paul meehl Graduate School

We’re excited to share the dates for our upcoming workshops for the remainder of this academic year. Mark your calendars...

paulmeehlschool.github.io

After my first year as EiC of Collabra: Psychology, I wrote an editorial with my reflections so far. Featured are some observations about submission triage, author geolocation data, and a registered revisions experiment. @collabrapsychology.bsky.social @improvingpsych.org doi.org/10.1525/coll...

General Triage, Geolocation Data, and Registered Revisions: A Peek Under the Hood of Collabra: Psychology

This editorial comes one year after I took the reins of Collabra: Psychology from Simine Vazire. Simine led the journal from 2020 to 2023, and I have had the privilege of working with her during that ...

doi.org