New post on Data Colada. I spent a very long time trying to figure out a figure in a methods paper that is not in my area of expertise. It shows extremely *negative* R-squared values from replications of a true effect. The question on my mind was: WHAT?? I learned some stuff. datacolada.org/134
[134] Figuring Out Figure 1 - Data Colada
A few years ago our Journal Club discussed an interesting methods paper entitled, “Putting Psychology to the Test: Rethinking Model Evaluation Through Benchmarking and Prediction” (.htm). This post describes my attempt to understand what’s happening in Figure 1 of that paper, which shows that extremely simple experiments can generate extremely negative R2s. I learned a...
datacolada.org
I am sometimes asked (e.g., today) for advice for conducting meta-analysis. Shoudl i use PET-PEESE or Trim-and-fill? I feel like being asked what hat color is best to wear during a rain dance. Data Colada posts about (against) meta-analysis: datacolada.org/archives/cat...
Meta Analysis Archives - Data Colada
datacolada.org
An update on Gino's lawsuit against us (Data Colada). We had a hearing about our motion to dismiss, and we've learned some legal things along the way. No big news yet, but some details: datacolada.org/116
[116] Our (First?) Day In Court - Data Colada
“Any update on the lawsuit?” That is the most common question any of us is asked. It is usually preceded by an apologetic preamble, like, “sorry if this is a sensitive question,” or “I don’t know if you’re tired of talking about this, but…” The reality is that, for the most part, our actual sensitivity...
datacolada.org
Part 1 of a two-part series on Freakonomics: Why is there so much fraud in academia? Interviews with @briannosek.bsky.social Leif Nelson, @joesimmons.bsky.social, @urisohn.bsky.social, Max Bazerman, and me. Part 2 (about what journals are doing) coming next week freakonomics.com/podcast/why-...
Why Is There So Much Fraud in Academia? - Freakonomics
Why Is There So Much Fraud in Academia? - Freakonomics
freakonomics.com
I’m a fan of trying to quantify how often reviewers & editors check authors’ preregistrations (eg, by @syeducation.bsky.social), but also we should not forget that reviewers fail to check for deviations from a priori plans in 100% of unpreregistered studies. Because they can’t.
Finally! New policies for Psych Science in 2024 (part 1): Editorial 1: https://www.psychologicalscience.org/publications/psychological_science/vazire-editorial Editorial 2 w/ @tomhardwicke.bsky.social : https://www.psychologicalscience.org/publications/psychological_science/hardwicke-editorial
psychologicalscience.org
Very excited that @i4replication.bsky.social is going to be doing annual stress tests of papers published in Psych Science. It’s amazing to see what they’ve done in econ & poli sci, and great that they’re expanding to psych!
We are thrilled to announce a new collaboration with Psychological Science. Papers published in PS following January 1st, 2024 will be candidates for I4R to computationally reproduce, stress-test and replicate.
Not your grandparents’ psych journal
I'm thrilled to announce the new Psych Science editor team! We'll start on Jan 1, 2024. Check us out: here: https://www.psychologicalscience.org/publications/psychological_science/2024-editorial-board We're spread across 15 countries in 5 continents! 🌍🌎🌏 Here’s a thread to introduce the team!
Zoé Ziani (who isn't on BlueSky AFAICT) has posted a long post-mortem on the Gino-Ariely case. She explains how she came to suspect Gino’s work, the resistance she met during her Ph.D., her experience working with Data Colada, and the lessons business academia should learn from these scandals...
A Post Mortem on the Gino Case | The Organizational Plumber
My perspective on the Gino-Ariely scandal, and what we should learn from it.
theorgplumber.com
Hello BlueSky! First post to those interested in #decisionmaking #jdm #behavioralecon #consumerbehavior 🔥 SJDM Conference registration is open 🔥 Conference will be Nov 17-20 in San Fran. More info and register today at www.sjdm.org! Early registration ends Nov 5 and fees increase.
Society for Judgment and Decision Making
sjdm.org