Kamalita

@kamapi13.bsky.social

Just trying to understand the world and be a decent teacher and epidemiologist. Interested in epidemiologic methods, nutrition, health, microbiome, research integrity, teaching and learning. But mostly academic rant, really! Currently a postdoc in SE

Indeed the primary causes of bad science come from within: academics are incentivized for quantity, not quality; for novelty, not reproducibility. Toss in poor #Statistics education (including measurement and experimental design) and you have a disaster.

Alejandro Montenegro@aemonten.bsky.social · 2mo ago

"The crisis of science stems not from paper mills or profit motives but from systemic incentives that reward volume, novelty and prestige over validity and reliability" The problem lies within. doi.org/10.1098/rsos...

The physical-sciences repository arXiv is banning researchers from posting their manuscripts on the platform for one year if a submission is found to contain references that have been hallucinated by artificial-intelligence tools. go.nature.com/4nDfXvv

Researchers who use hallucinated references to face arXiv ban

The preprint server is the latest to impose stiff penalties on authors who contribute to AI ‘slop’ — but not everyone is convinced it’s the right approach.

go.nature.com

"If you don't care about the methods, I don't care about the results"! Most observational research published in biomedical journals is very weak. That's why the methods section is the single most important section, and why it's so ridiculous that Nature journals relegate the methods to the end!

T-shirt that says 'if you don't care about the methods, I don't care about the results'
Katie Mack@astrokatie.com · 3mo ago

Nice reminder that because a study is published in a journal does not mean it’s a good study or that its stated conclusions are reasonable! When people say they are “doing their own research,” even if reading primary literature, missing the context & subtleties can lead to wildly wrong conclusions.

What 6,000 researchers think about the future of science. Noteworthy how this discusses well-known issues, without fully contextualising them or holding systemic harms accountable. Example: discussion of ECRs considering leaving, but not widespread redundancies www.nature.com/articles/d41...

What 6,000 researchers think about the future of science

Funding worries and publishing trends loom large in the minds of scientists surveyed by Nature Index.

nature.com

Where have people's sense of smell gone? Everytime I get on the bus I am hit by really strong perfumes. Even some hours later I could still smell it from my hair! 😵‍💫 In case you're not aware, some people can get headaches from these strong smelling perfumes.

SV: Peer review is not magic. Post-publication critiques are part of the 'Science is self-correcting' process. Love your critics - those are the ones who help you be stronger. Another lesson I learned: A crisis can look a lot like normal science. It's normal that things fail to replicate.

Screenshot from slide: Post Publication critique in psychology: Replication bullies, human scum, methodological terrorists, second-stringers, destructive iconoclasts, accuracy fetishists.

It's kinda disappointing when people whose views you generally respect start using LLMs to write their contributions to collegial discussions, especially when they leave in clues like sycophancy from the bot ("this is your killer point"). Apparently they assume that we won't notice that it's slop. 😥

…students, by definition, cannot reliably determine if a re-wording of their writing changes the underlying ideas. Their ability to communicate their own understanding is exactly what we’re meant to assess. If they were already competent to tell, they wouldn’t need to be students. (4/7)

Question for AI haters who are also academics: How do you navigate co-authorship situations, where you don’t want to be involved in manuscripts where an author is using AI? Do you have explicit discussions with potential co-authors? How do these go?

I do not want to use AI to write or think. Can someone train it to handle annoying tasks like formatting journal submissions instead of trying to get us all to use it for things that take critical thought and expert knowledge?

I don't think the "Einstein" or other AI replacing the important steps of learning, esp in higher ed, would be posing quite the challenge it is right now if students hadn't been sent the message their entire lives that the point of college is to get good grades and a high paying job, not to learn.