Joseph Lemaitre

@josephlemaitre.bsky.social

👀 Developing novel infectious disease dynamics modeling approaches to inform public health policies 📍Assistant Professor at UNC-Chapel Hill (🇺🇸), PhD from EPFL (🇨🇭). 🌍 josephlemaitre.com

Wow. This is an amazing project with a huge amount of work behind it. Even if you aren't into drosophila, it's worth a look

Mark A. Hanson@hansonmark.bsky.social · last yr.

The "reproducibility crisis" in science constantly makes headlines. Repro efforts are often limited. What if you could assess reproducibility of an entire field? That's what @brunolemaitre.bsky.social et al. have done. Fly immunity is highly replicable & offers lessons for #metascience A 🧵 1/n

But in fact, fly immunity is highly reproducible! 🎊 ~80% of claims could be verified. Moreover, some challenged claims just reflect the field advancing its knowledge/tools. The lesson: if the tools are good and the research largely exempt from direct translation pressures, science works. 3.5/n

A chart depicting the track of claims into verified, unchallenged, challenged, partially verified, or mixed.

Figure 1: Flow of the study.
Claims were first classified in five categories based on literature. 45 unchallenged claims were selected to be experimentally tested and
classified either as challenged or as verified. We further classify some unchallenged as consistent or inconsistent depending on their
consistency with current knowledge.

When everything is considered together (w/ caveats), the most prestigious institutes are the most likely to produce irreproducible work. Journal tier was a more minor effect, and in fact, "high-impact" but not "trophy" journals publish the most reproducible science. But, many caveats (cont.) 4.3/n

A chart showing various factors and their odds ratios and relative contributions to irreproducibility in a multivariate mixed model.

Figure 10. Multivariable analysis of predictors of claim irreproducibility.
The forest plot reports the odds ratio and the 94% highest density interval of each covariate effect on
a claim becoming challenged.

more than that but right order of magnitude. I always say $10^1 for preprint; $10^3 for journal article; $10^5 for research. most costs are staff not tech because of responsible screening, customer service, etc.

This opinion (LLMs have no world model) is repeated at every AI track in IDD conferences, and while it's true for a narrow definition of world model, I am sure it does not square with audience experience. Contrary to what Gary says, LLMs play good (1'800 ELO) chess: dynomight.net/more-chess/.

Onisillos@onisillos.bsky.social · last yr.

"It is not just that LLM’s fail to induce proper world models of chess. It’s that they never induce proper worlds of anything. Everything that they do is through mimicry, rather than abstracted cognition across proper world models." garymarcus.substack.com/p/generative...

Which academic communities have a good record of sharing domain-specific open source tools? Bioinformatics and geospatial analysis comes to mind. I am trying to think about if they are examples to follow or if there is some difference in the domain (to Infectious disease modelling).

Note that one of these projects is about delay estimation (described by one 5 year old as double extra boring) but critical to get right for most/all downstream modelling use cases.

Anne Cori@anne-cori.bsky.social · 2y ago

Amazing opportunity: a few PhD positions in Health Analytics, Epidemic Modelling and Health Economics available with myself and colleagues from @mrc-outbreak.bsky.social, @ccmid.bsky.social and @ukhsa.bsky.social. Please apply/circulate widely!

The studies informing stratified parameters in IDD models often have partitions (e.g age group) different from the model partitions. Most papers takes the median/mean estimates, but a correct solution exists: see this great paper/R pkg (C. Pearson, @lucygoodfellow.bsky.social @mert0248.bsky.social)

BildBild
Justin Lessler@justinlessler.bsky.social · 2y ago

Congrats to team member Carl Pearson and his co-authors @lucygoodfellow.bsky.social and @mert0248.bsky.social. An important tool for a pervasive problem in modeling infectious disease data www.medrxiv.org/content/10.1...