This should be mandatory reading for every graduate student.
Matthew B. Jané
@matthewbjane.bsky.social
PhD student at UConn | matthewbjane.com
As specified and posted here: info.unjournal.org/evaluator-pr... I am making the draw for these now using the closing value of S&P 500 today to 2 decimal places, 6,941.81. --> Winners: @matthewbjane.bsky.social and Anon evaluator (of Wellbeing paper). Will make the payments soon.
Thank you so much @unjournal.bsky.social !!
The Unjournal (Unjournal.org)@unjournal.bsky.social · 6mo agoAs specified and posted here: info.unjournal.org/evaluator-pr... I am making the draw for these now using the closing value of S&P 500 today to 2 decimal places, 6,941.81. --> Winners: @matthewbjane.bsky.social and Anon evaluator (of Wellbeing paper). Will make the payments soon.
Congrats on being nominated Edoardo Masset, Hugh Sharma-Waddington, @davidreiley.bsky.social , @cannoncloud.bsky.social , @matthewbjane.bsky.social, & anon. hero. And thanks for the strong work!
We want your feedback – which evaluations merit the top award, and why? Total prize pool: $6600 www.unjournal.org/news/unjourn... Anonymous: coda.io/form/The-Unj...
Unjournal 2024-25 Evaluator Prize Nominations; inviting feedback — The Unjournal
The Unjournal commissions expert public evaluation of research with potential for global impact. We recognize and reward the most useful, insightful, and credible evaluation work, including through ou...
unjournal.org
Update on Error Report #2: The impact of acoustic stimulation during sleep on memory and sleep architecture: A meta-analysis The article has been retracted by agreement with the journal editor and authors #metascience
"Meta-meta-analyses trade precision & rigor for expediency. If your aim is rigor, there’s no substitute for doing the hard work." Preach! I once read a #meta-analysis that mistook SE for SD. Since then I am suspicious of all such studies. Do the hard work! matthewbjane.github.io/blog-posts/b...
When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané
Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...
matthewbjane.github.io
This is very nice from @matthewbjane.bsky.social as to why umbrella reviews are basically useless (sorry!), essentially because they compound up the issues with the meta analyses they include. I have the same concerns but articulate them less eloquently. matthewbjane.github.io/blog-posts/b...
When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané
Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...
matthewbjane.github.io
I've moaned about meta-analyses of meta-analyses for a while and had several interesting experiences reviewing them... Now I can save time and just send people to Matt's post to explain why not to do them.
Matthew B. Jané@matthewbjane.bsky.social · last yr.Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses. Link: matthewbjane.github.io/blog-posts/b... #stats #metascience
Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses. Link: matthewbjane.github.io/blog-posts/b... #stats #metascience
Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses. Link: matthewbjane.github.io/blog-posts/b... #stats #metascience
I'm calling for a total and complete shutdown of JAMA Pediatrics until we can figure out what is going on goodscience.substack.com/p/the-resear... I mean, come ON
(#metascience) A good article by @stuartbuck.bsky.social on the Fluoride and IQ meta-analysis: goodscience.substack.com/p/the-resear.... Summarizes some of the points in our forensic review of it (see the forensic review as a pre-print here: osf.io/preprints/os...). Very nice excerpt below:
Error Report #4: matthewbjane.quarto.pub/meta-analysi... The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os... #metascience
Error Report #4: matthewbjane.quarto.pub/meta-analysi... The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os... #metascience
Spent the past couple days looking at meta-analyses in body comp literature to get reasonable parameter estimates to use in simulations for a study we're planning and really trying to avoid giving myself a to-do list of meta-analyses that I need to correct/redo 🙃 cc: @matthewbjane.bsky.social
livefreeordichotomize.com by @lucystats.bsky.social matthewbjane.github.io/blog.html by @matthewbjane.bsky.social www.andrewheiss.com/blog/ by the king @andrew.heiss.phd ngreifer.github.io/blog/ by yours truly (can't resist a self-promotion 😉) Stats blogs are the best!
Posts | Noah Greifer
Statistical Consultant and Programmer
ngreifer.github.io
The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
OSF
osf.io
The Associated Press@apnews.com · last yr.BREAKING: Health Secretary Robert F. Kennedy Jr. says he plans to tell CDC to stop recommending fluoride in drinking water.
Another great meta-science contribution by @matthewbjane.bsky.social and others. This and his re-analysis of the “social media causes harm” meta-analysis are great examples of how we can use science to serve society without necessarily having to be “activists”
Matthew B. Jané@matthewbjane.bsky.social · last yr.The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
Most studies in the meta-analysis are no more detailed than the following: “Area A has low fluoride water levels, Area B has high fluoride water levels, and area A has a higher mean IQ” No matching or balancing of covariates. Distinct geographic areas differ more than just their fluoride levels.
Matthew B. Jané@matthewbjane.bsky.social · last yr.The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
They chose to use the standardized mean difference in IQ between a reference and exposure group however the reference in many studies has more fluoride exposure than the exposure group in other studies! There is no consistent definition for the groupings.
Matthew B. Jané@matthewbjane.bsky.social · last yr.The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
One major finding in our pre-print is that the journal ‘Fluoride’ publishes much larger effects than any other academic journal. Fluoride is published by the International Society for Fluoride Research which is run by anti-fluoride activists and hosts water defluoridation workshops. #metascience
Matthew B. Jané@matthewbjane.bsky.social · last yr.The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
I saw @epiellie.bsky.social comment on this so I am tagging her here #metascience
Matthew B. Jané@matthewbjane.bsky.social · last yr.The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
OSF
osf.io
The Associated Press@apnews.com · last yr.BREAKING: Health Secretary Robert F. Kennedy Jr. says he plans to tell CDC to stop recommending fluoride in drinking water.
We just published a paper on the performance of various tests and confidence intervals for the scale coefficients in location-scale models in meta-analysis: doi.org/10.3758/s134... Overall, REML-based LRTs and profile-likelihood CIs performed best, but the number of studies typically must be large.
Performance of location-scale models in meta-analysis: A simulation study - Behavior Research Methods
Location-scale models in the field of meta-analysis allow researchers to simultaneously study the influence of moderator variables on the mean (location) and variance (scale) of the distribution of tr...
doi.org