I'm looking for published papers showcasing creative uses of item response theory, including studies with unusual item types (e.g., audio stimuli) and/or those in contexts beyond ed/psych measurement (e.g., using chemical mixtures as "items" to measure exposure burden; Liu et al. (2022)). Any ideas?

These are the kinds of interventions #nudge researchers should be doing.

Props to all journals that list author affiliations on the last page. That’s a nice step towards focusing on the research instead of prestige.

Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...

When metascientists decide which studies to reproduce or replicate, why aren't they targeting studies that are being cited in patents, company reports, policy, etc? Valuable resources are wasted on assessing the reliability of inconsequential reports. #metascience #replication

Life, imitating memes.

This Is Fine Meme

ALT: This Is Fine Meme

static.klipy.com

The New York Times@nytimes.com · 2w ago

French officials ordered the evacuation of the Cap Ferret peninsula, a popular holiday destination, as wildfires spread in France and Spain. High temperatures across Western Europe have exacerbated the ferocity of the blazes. nyti.ms/4yLe4SL

This website will convert the air quality of your current location into cigarette equivalents cig-index.vercel.app By @paulinewee.bsky.social

I’m curious if any #scienceofscience folks have seen estimates of the rate/level/pathways of diffusion of methods research into methods practice! (Secretly also wondering if modular research could improve diffusion)

Peter Tennant@pwgtennant.bsky.social · 3w ago

I cannot believe how many of these RCTs used a change/percent change outcomes. Because the literature is so clear on the topic I honestly thought this issue was resolved! @f2harrell.bsky.social @stephensenn.bsky.social

Let's think about the future of infrastructure studies and practice together! Applying to join is lightweight, and due in ~2 weeks (yes, I was late, sorry!) cscw2026-infrastructure-workshop.github.io/apply/

Career progression in academia, generally.

Pekka Lund@pekka.bsky.social · 4w ago

"The student said [Flight instructor] Bertazzo told her, “You know what you have to do, carry on,” before taking off his headset and seatbelt, opening the door and jumping out of the plane" "It’s impossible to think about it or understand it, but the human mind is so complex."

AUTOMATING COMPUTATIONAL REPRODUCIBILITY My colleague @philipjakobbln.bsky.social and I are currently engaged in a research project where we reproduce scientific results en masse. To that end, we built rigor.me, a platform for automatically reproducing papers using agents 🧵

Help. me. understand. why. #SciComment #chartcrime

New study from my fab masters student. There are some people who have so many retractions that they are famous for it. The most notorious frauds in science. Do the unretracted papers from these authors get cited in Cochrane reviews? Yes. link.springer.com/article/10.1...

Research integrity within systematic reviews: investigating the prevalence of studies by authors with multiple retraction histories in Cochrane reviews - Research Integrity and Peer Review

Background Research misconduct poses a significant threat to the integrity of evidence synthesis. Although Cochrane reviews are known for rigorous methodological standards, the potential inclusion of ...

link.springer.com

Thinking abt verifiable manifests to this effect (for correctness - eg metacheck, refine.ink) + traceable machine readable signals of significance/quality over time as a new equilibrium replacement for one-stop pre-pub review in science. Better/worse than status quo?

Refine - AI-Powered Research Assistant

Refine helps researchers analyze papers, collaborate with teams, and streamline their research workflow with AI-powered tools.

refine.ink

hailey@hailey.at · 2mo ago

my firey take (for bluesky standards) is that at this point it’s trending towards disrespectful to submit for human review a PR that you wrote fully by hand if you didn’t have an agent review it first. this idea doesn’t apply just to agent-written code,its all code.

I have a referral link for a week of free Claude Claude if you want it. DM.

This was a blast! Some nuggets: 0: Preprints are amazing 1: Let's build infra that empowers rich interactions with *constellations* of scientific objects 2: Narratives are great + meaning-bearing, let's keep them alongside structured semantics 3: AI motivates + could greatly enable (1) + (2)

Richard Sever@richardsever.bsky.social · 2mo ago

Frontiers In Research webinar on changes in science communication, the role of social media, and new infrastructure/tools - tomorrow (7/18) at 2 pm ET Looking forward to chatting with @ronentk.me & @joelchan86.bsky.social luma.com/7l18yyg4

As long as both lay and technical abstracts are structured and comprehensive, I’m happy. With abstracts, vagueness is the big problem.

Dan Quintana@dsquintana.bsky.social · 2mo ago

Some journals require lay abstracts alongside conventional abstracts. I almost always prefer the lay version because they more clearly describe what was done and what the results mean, which says a lot about how we approach scientific writing

your feedback was kind gentle and correct and still i resent you

New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.

Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth

In this blog post I will analyse the arguments that Dr. Amy Cuddy provided in a blog post “The "Power Posing Was Debunked" Myth: What the Re...

daniellakens.blogspot.com

Small study shows surprisingly encouraging results of a critical thing college class in reducing four biases psycnet.apa.org/record/2027-...

Given the prevalence of LLM-generated citations, it's time we generated Active Citations. These citations give the source excerpt for each citation. Paper: www.princeton.edu/~amoravcs/li... Example: amoravcs.scholar.princeton.edu/sites/g/file...

Dr. Casey Fiesler@cfiesler.bsky.social · 3mo ago

Particularly in the context of (appropriate) crackdowns on LLM-generated papers (e.g., on arXiv) and more and more tales of fabricated citations, two reminders: (1) LLMs do not "cite their sources" (2) Using an LLM to generate, complete, or fix LaTeX code can result in fabricated citations

I’ll be in Oslo May 26-30 and Trondheim June 1-4. Anything I should do or know? Where are my Norwegian peeps?

I'll be in Boston Sunday night for a spell. Boston peep, where are you?

AI is supposedly sycophantic, but Claude Opus 4.7 routinely reminds me to use its advice when coding. I sometimes can't get it to budge and accept my view. Maybe consider the latest models before labeling chatbots are sycophants.

I am once again begging, praying, weeping for lists of written instructions rather than videos. I do not want to watch your two minute video in the hope of catching the two seconds where you whizz past what goddamn menu the thing is under. Write. It. Down.

I have so much grading to do that my home is spotless.

Given the prevalence of LLM-generated citations, it's time we generated Active Citations. These citations give the source excerpt for each citation. Paper: www.princeton.edu/~amoravcs/li... Example: amoravcs.scholar.princeton.edu/sites/g/file...

Dr. Casey Fiesler@cfiesler.bsky.social · 3mo ago

Particularly in the context of (appropriate) crackdowns on LLM-generated papers (e.g., on arXiv) and more and more tales of fabricated citations, two reminders: (1) LLMs do not "cite their sources" (2) Using an LLM to generate, complete, or fix LaTeX code can result in fabricated citations

Pro tip: boost and engage (intelligently) with science posts. Some scientists are feeling lonely.

When reviewing manuscripts/papers, have you ever made a visual or diagram the sole focus of your feedback? I keep wondering that the core representation of reviewing can do for surfacing issues and persuading authors. What would it look like if peer review tech were primarily visual? #peerreview

"Reviewers... are going to become less tolerant of these “obvious” big mistakes now that they can be identified by a variety of cheap tools [GenAI review apps] prior to publication... The least we can do is ask them to review the best possible version..." via @quentinandre.bsky.social