Proof by presence 🤖👁️🙅 Check out our new position piece on webcam eye tracking for AI bot detection! 🧵 below:

Krajbich Lab@krajbichlab.bsky.social · 3mo ago

Autonomous AI agents are now built into many browsers. A naive user can take an online survey with as little as the click of a button. For behavioral research, which depends heavily on online samples, this is a real problem. (1/7)

This is incredibly cool and important work! If you think you have bots in your online survey data, why not just have participants turn on their webcam and track their gaze during the study? This team provides open-source resources for implementation and a guide to usage! 🤩

Krajbich Lab@krajbichlab.bsky.social · 3mo ago

Autonomous AI agents are now built into many browsers. A naive user can take an online survey with as little as the click of a button. For behavioral research, which depends heavily on online samples, this is a real problem. (1/7)

It’s NOT time to abandon online data pools! However, we should screen carefully

Oleg Urminsky@olegurminsky.bsky.social · 5mo ago

When you collect data online, are the results from humans or AI? In a project led by Booth PhD student Grace Zhang, we estimate the prevalence of AI agents on commonly used survey platforms: osf.io/preprints/ps... 🧵

One initial line of defense could be to require transparency statements regarding how instruments have been vetted to combat malicious users, based on best practices (like a STAR editor check). In a recent workshop, we aimed to create such a compendium (see @andreaaaaa.bsky.social for access)!

simine vazire@simine.com · 8mo ago

What should psychology journals do about this? What’s a reasonable policy/standard to apply to research using online data collection methods?

There's hope! This is an adversarial game, researchers will need to continuously innovate to stay ahead @kiante.bsky.social @andreaaaaa.bsky.social & @jbogard.bsky.social ran an excellent workshop at #SJDM2025 to help folks get started Materials here: kiante-fernandez.github.io/sjdm-data-va...

John Holbein@johnholbein1.bsky.social · 9mo ago

This is terrifying. "[AI agents] can... infer a researcher's latent hypotheses and produce data that artificially confirms them." ... "We can no longer trust that survey responses are coming from real people" -@seanjwestwood.bsky.social

Thanks so much for featuring us! So glad for everyone who attended and very happy to follow up if that’s of interest

Nick Byrd, Ph.D.@byrdnick.com · 8mo ago

How can we identify or block #AI #survey respondents? @andreaaaaa.bsky.social, Kianté Fernandez, @jbogard.bsky.social, and Craig Fox demoed examples, facilitated discussion, and tested our live suggestions. See their Modern Threats to Online Surveys: kiante-fernandez.github.io/sjdm-data-va...

Very cool and important work 🤩

Sam Skowronek@skowroneksam.bsky.social · last yr.

💢New paper alert💢 Dishonesty is everywhere — but it’s not all the same. My new solo-authored paper in Journal of Experimental Psychology: General disentangles cheating and lying as distinct forms of dishonesty. Link to paper: doi.org/10.1037/xge0... A thread 🧵👇