Glad you liked it @ajgillett.bsky.social And a big thank you to AIMOS for the invitation to talk about my favourite topic

@ajgillett.bsky.social · 3d ago

Great talk by @wchiggins.bsky.social "Rethinking measurement validity". Wendy introduces an interesting distinction between 'validity potential' and 'realised validity' to help untangle some problems in measurement practices in psychology: www.youtube.com/watch?v=ni4N...

Austin et al. (2026) advocated for AI in hypothesis-driven scale validation research. In this preprint, led by @wchiggins.bsky.social, we (@malte.the100.ci @bethclarke.bsky.social) sketch out several weaknesses in this paper, and offer recommendations for avoiding them. osf.io/preprints/ps... 1/🧵

This paper has now been accepted at Advances in Methods and Practices in Psychological Science!

Jamie Cummins@jamiecummins.bsky.social · 4mo ago

1/ "Silicon samples" are becoming more and more common in research and polling. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. The updated version of this preprint is now online! THREAD🧵 arxiv.org/abs/2509.13397

Survey research is often interpreted as showing that belief in conspiracy theories can be surprisingly widespread, including belief in conspiracy theories that would be astonishing if true. For example, in The Atlantic we learn that “12 million Americans believe lizard people run our country”

🏆 @simine.com, psychologist at @psychunimelb.bsky.social / @unimelb.bsky.social and Editor-in-Chief of Psychological Science (@psychscience.bsky.social) is a leading voice in the reform movement in psychology - and is now being honored with the €150K Individual Award. Huge congratulations! 🎉

Thrilled to share our new paper introducing “validity potential” versus “realised validity” as a key distinction for psychological measurement, with @davidmkaplanx.bsky.social, Alexander Gillett, @suttonprofessor.bsky.social, and @robert-m-ross.bsky.social www.sciencedirect.com/science/arti...

Rethinking psychological measurement: Validity potential versus realised validity

We propose a concept of validity with a novel feature that we argue can facilitate improved measurement validation practices in the psychological scie…

sciencedirect.com

Thrilled to have been awarded an Australian Psychology Society Award for Excellent PhD Thesis in Psychology! psychology.org.au/about-us/wha...

Thanks to everyone who came to Sydney for #AIMOS2025! I can't wait to see you in Wellington, NZ next year!

Attended my PhD graduation ceremony yesterday. Gotta love the hat

A lot of psych is already conducted with online convenience samples & ppl are probably excited about silicon samples bc it would allow them to crank out more studies for even less 💸 How about we reconsider the idea that sciencey science involves collecting own data. www.science.org/content/arti...

AI-generated ‘participants’ can lead social science experiments astray, study finds

Data produced by “silicon samples” depends on researchers’ exact choice of models, prompts, and settings

science.org

The Eyes Test knows where I live 👀

oh wow! lovely to see people engaging with my research 😃 www.bps.org.uk/research-dig...

The ‘Reading the Mind in the Eyes Test’ may be less robust than we thought | BPS

A new paper assesses the widely-used tool.

bps.org.uk

My editorial on how journals can earn trust. We often use journal names as proxies for quality. This is bad bc it’s not valid. But it could be. Editors could make journal name a valid signal. And we could place value on journals that show us how they do that. journals.sagepub.com/doi/full/10....

Chuffed and excited to announce a new journal section in Cortex: *Methods and Assumptions* is open for submissions starting today! Read the opening editorial here (OA): www.sciencedirect.com/science/arti... 1/

Methods and Assumptions: A new section in Cortex

sciencedirect.com

Wendy Higgins (@wchiggins.bsky.social), who developed all these projects that interrogated the validity of the Reading the Mind in the Eyes test, has just been awarded her PhD and joined BlueSky! Follow her for more cutting-edge research on measurement and meta-science!

Robert Ross@robert-m-ross.bsky.social · last yr.

Have you every found yourself wondering whether the most widely used measures of social cognitive ability measure what they are supposed to measure?

Introducing Dr Wendy Higgins and the Reading the Mammal in the Eyes Test.