Sean Harrison, PhD

@sean-h.bsky.social

Evidence reviews, public health, epidemiology, statistics https://seanharrison.blog/

Ok, so a few things. 1. England has utterly fucked gender clinics, so referrals will be *obviously* be low: if you can't get even a first appointment, you're not going to be referred for surgery. The England referral rates are *substantially* lower than the need.

@theotheories.bsky.social · 2d ago

The WGS decision was apparently made on the basis of the Welsh Vs English whole population figures, not the number of patients seen in the clinic. This is absolutely ridiculous, serious medical decisions should not be made like this. It's not an appropriate comparison!

Anyone at the mass lobby today. You can tell them about my kid. Supported at school for years. Now out of school - driven out by hateful segregationist school policy introduced by Labour. Trans kids are being persecuted by this government

I spent 18 months doing reviews for the past, current, and future uses of AI in public health. They're done and preprinted now, so time for a post. This will be *long*, so, tldr in image. Research funded by NIHR, opinions expressed are mine alone, etc. etc. AI was *not* used to do these reviews.

"There is only limited evidence for the use of AI in public health: the evidence that exists does not strongly support AI-assisted interventions for reducing alcohol drinking, smoking, of physical inactivity, and while there are many proposed uses of AI in public health, there is limited or no evidence for whether those uses will be beneficial, and there are many risks of using AI, some of which are existential in nature."

From: https://www.exeter.ac.uk/research/groups/medicine/esmi/workstreams/nihrpublichealthreviewteam/#a1

I spent 18 months doing reviews for the past, current, and future uses of AI in public health. They're done and preprinted now, so time for a post. This will be *long*, so, tldr in image. Research funded by NIHR, opinions expressed are mine alone, etc. etc. AI was *not* used to do these reviews.

"There is only limited evidence for the use of AI in public health: the evidence that exists does not strongly support AI-assisted interventions for reducing alcohol drinking, smoking, of physical inactivity, and while there are many proposed uses of AI in public health, there is limited or no evidence for whether those uses will be beneficial, and there are many risks of using AI, some of which are existential in nature."

From: https://www.exeter.ac.uk/research/groups/medicine/esmi/workstreams/nihrpublichealthreviewteam/#a1

That's one take. Mine is that, when I die, I hope that people can't justifiably say that I had made their life, and the lives of their loved ones, substantially worse. When oppressors and abusers fall, the oppressed and abused have no compunction to be polite.

Ben Goldacre@bengoldacre.bsky.social · 2mo ago

Sad to see people posting on social media negatively about Rod Liddle, who died yesterday. If I have disagreed with you very strongly in life - and you die - I hope I'll be either silent, or kind.

This is actually really fucking problematic. Forgetting the Gemini response, which I listen to only if I know the answer going in an need a reminder, how we can now trust any source on the internet? I've no idea if any of this is true, and now I can't trust any primary internet sources. Fuck.

Gemini response to the question: "are there submarines in the great lakes":

"Yes, there are submarines in the Great Lakes, including historic museum ships, a sunken World War I vessel, and occasional tourist submersibles, but no active military submarines.

Museum Submarines

You can walk through several famous decommissioned military submarines preserved as public floating museums:

USS Silversides: Berthed in Muskegon, Michigan.
USS Cobia: Located at the Wisconsin Maritime Museum in Manitowoc, Wisconsin.
USS Cod: Located in Cleveland, Ohio.
HMCS Ojibwa: Located at the Elgin Military Museum's Port Burwell, Ontario site.
U-505: A captured German U-boat housed indoors at Chicago's Museum of Science and Industry.

Sunken Submarines and Tourism

SM UC-97: A surrendered German WWI U-boat that was scuttled and sank in Lake Michigan off the coast of Chicago in 1921, where the wreck still rests on the bottom.

Passenger Submersibles: Select modern expedition cruise ships, such as the Viking Octantis and Viking Polaris, carry small 6-passenger tourist submersibles that take guests on brief underwater excursions into the depths of the lakes.

Would you like to know more about the history of how these submarines entered the lakes or details on visiting one of the museum ships?"
James McLeod@jamespmcleod.ca · 2mo ago

It's safe to assume that all major LLMs are scraping Bluesky data to train future models. As an open protocol, Bluesky is one of the few sources of fresh human-generated content that anybody can gobble up. So all this is probably going in the models. There are submarines in the Great Lakes.

Apropos of nothing, I had a peer review back recently that was literally red pen on my manuscript, the only changes being: 1. Use passive voice (no, I use active voice to be clearer) 2. Remove the bullet points (no, bullet points are sometimes useful) That was it. bsky.app/profile/sean...

Sean Harrison, PhD@sean-h.bsky.social · last yr.

Some peer-reviews are public, so *sometimes* there's accountability, but there's still no guarantee the reviews were good: how many reviews are conducted by people (statisticians) who know the requisite methods? And who has been trained in conducting a good peer-review? 5/n

Hi, I was a genetic epidemiologist for a while. You can edit the genes to remove only a very small proportion of diseases, the ones that affect a single gene in a deterministic way. Anything else is fantasy: genetics are predictive of disease, we have no idea which are causal.

Sheryl Weikal says Prosecute ICE@leftistlawyer.com · 4mo ago

I mean...as someone who has a chronic progressive autoimmune disease, I get the appeal of making sure no one in the future has Crohn's. But I also worry this is going to lead to a future of perfectly abled cisheteronormative aryan babies, and that frankly scares the shit out of me.

I once helped with finding evidence for the public health consequences of a week-long power shortage in the UK. Among the questions asked were: how many calories do people need to survive for a week? How much water? How infectious are dead bodies?

conifergirl.bsky.social@conifergirl.bsky.social · 4mo ago

The Impending Apocalypse AKA Shit is getting Real The Strait of Hormuz has largely disappeared from the headlines, which in itself should make every one of us nervous. In the modern media age, silence is often mistaken for resolution.

I signed this! NHS England, or at least the people who commissioned the reviews, may be ideologically opposed to healthcare for trans kids, but they can't hide behind their intentionally awful evidence reviews to justify the ban they imposed on hormone treatments.

TransActual@transactualuk.bsky.social · 4mo ago

Over 80 clinicians, researchers and academics have signed an open letter raising serious concerns about NHS England’s recent evidence reviews of gender affirming hormone treatment for trans youth. Read the full letter here: transactual.org.uk/blog/2026/05...

Text reads: 80+ clinicians, researchers and academics criticise NHS England’s withdrawal of gender-affirming hormones for trans youth. Swipe to learn more

For a non-academic article about the history of aspirin, I bought a physical copy of a 1940s German journal from Polish eBay to check a reference that didn't exist online. I transcribed the article from German & Google translated. Then put it online for everyone. press.asimov.com/articles/asp...

I went to some length to find a copy of this article. It didn’t exist online, but I found a physical copy for sale on eBay in Poland. Unfortunately, the seller wouldn’t initially ship to me in the UK, so I used Google Translate to ask them (in German) to allow shipping to the UK, which they very kindly did. Subsequently, DHL managed to lose the parcel, which is a shame as it was one of the few extant copies of this article in existence. However, the British Library is, thankfully, magnificent: they had a copy, and someone very generously managed to dig it out of the archives and photograph it for me. I transcribed the German text, translated it with Google translate, and put both the original German transcription and the English translation on the Internet Archive for posterity. Weeks later, DHL found the article and delivered it, so I scanned the original and uploaded it to the Internet Archive.
Dr. Holly Walters@manigarm.bsky.social · 4mo ago

I'm sorry, what? In writing my first monograph, I spent six weeks trying to track down a citation in TWO languages I didn't know. And good thing too, because the citation was wrong. That's scholarship. That's research. You know, the thing we're trained to do?!?

The reactions of some researchers on Twitter finally being held responsible for not having read the very paper they submitted are... something. Mainly, they don't think they should have to check every citation or make sure the data is real and accurate. Because it's too hard, I guess.

If modern life == comfort: Indoor plumbing (pipes, pumping stations, water purification). I just spent 3 days with my stopcock closed to stop my boiler from exploding, and it was awful. I can live comfortably without everything on that list. I cannot live comfortably without indoor plumbing.

John Scalzi@scalzi.com · 5mo ago

The folks at Time Magazine asked me what tech innovation I think defins modern life today, and my answer is anchoring a list that includes contributions from Tim Cook, Tracy Chou, Gabrielle Zevin and Ray Kurtzweil, among others. time.com/collection/o...

Lol, this is the funnel plot from the paper; there was no forest plot, for whatever reason. This is a good example of what a funnel plot should NOT look like (points should be symmetrical around the pooled effect estimate, not skewing massively in one direction).

A funnel plot showing massive right-sided skew.

Interpretation: smaller studies (technically, more precise studies, but on average this will mean larger) massively favoured ChatGPT being good, larger studies did not.

This is collectively termed "small study bias": could be a result of publication bias (smaller studies showing no beneficial effect of ChatGPT not published), or crappy study designs more at risk of bias, or other, more... self-serving reasons...

https://www.nature.com/articles/s41599-025-04787-y/figures/2
Ketan Joshi@ketanjoshi.co · 5mo ago

A big study that was cited as evidence that text generators are good for students has been retracted: www.linkedin.com/posts/ben-wi... www.nature.com/articles/s41...

Retraction Note: The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis
Jin Wang & Wenxiang Fan 
Humanities and Social Sciences Communications volume 13, Article number: 528 (2026) Cite this article

9811 Accesses

2 Altmetric

Metricsdetails

The Original Article was published on 06 May 2025

Retraction Note to: Humanities and Social Sciences Communications https://doi.org/10.1057/s41599-025-04787-y, published online 06 May 2025

The Editor has decided to retract this paper owing to concerns regarding discrepancies in the meta-analysis. These issues ultimately undermine the confidence the Editor can place in the validity of the analysis and resulting conclusions. The authors have not responded to correspondence regarding this retraction.

My job is evidence synthesis in epidemiology/public health: I have read through tens of thousands of abstracts & thousands of full texts in the past year alone. I've been doing this for over a decade. I go through any studies included in my reviews in detail, including rigorous critical appraisal.

Katie Mack@astrokatie.com · 5mo ago

Nice reminder that because a study is published in a journal does not mean it’s a good study or that its stated conclusions are reasonable! When people say they are “doing their own research,” even if reading primary literature, missing the context & subtleties can lead to wildly wrong conclusions.

Ok, so: this was met, justifiably, with many scathing responses. But what separates this from a *lot* of these types of things I have seen is that @barried.bsky.social replied to those responses with what I saw as real humility, and it looks like learning happened. And that's just so good to see.

Barrie D.@barried.bsky.social · 5mo ago

Dangerous philosophy. The difference: - Labour won't do anything to protect you. - Reform will actively hunt you and hurt you, with glee.

Lukewarm take: the potential proportion variance explained in the outcome by the totality of the dataset is the hard ceiling for the predictive capacity of that dataset. Different methods aim to capture as much of that information as possible, but many models could be close to that ceiling.

Denis Mongin@denismongin.bsky.social · 7mo ago

I had this fight with a colleague last year. Exactly that: XGboost on 30k patient to predict remission. Didn't predict shit, as good as logistic regression performed properly. But the colleague wanted to go "look this giant step toward personalized medicine blablabla"

The problem, I think, is that science is often taught as a noun: "This is *the science*, learn it, memorise it, regurgitate it." I think we'd probably be better off teaching science as a verb: "Today, we're going to learn how to science the shit out of this." Skill-based learning >>> facts

David Ho@davidho.bsky.social · 7mo ago

Since I can’t sleep, here’s another hot take: The world would be a better place if everyone‘s science literacy was much better. There should be more emphasis on teaching basic science at all levels in school. Science isn’t just something nerds do, it’s the foundation of the modern world.

The gender roles that are forced on both women (and men) from before birth are so pervasive and dominant that I'd be astounded if there weren't any difference in measurements of "child rearing" between genders. Society (in the UK and elsewhere) is constructed such that "women raise children".

FinnMackay@finnfox.bsky.social · 7mo ago

Sonia Sodha is honestly on the wireless saying women are biologically better at rearing children than men. She found a single dad who agreed with her so it's all ok.