Been raising that alarm internally at Sinai and Yale, but if our field wants to continue to rely on virtual data collection then we need to develop better bot detection tools. Glad to be collaborating with @kiante.bsky.social on these efforts. His work at UCLA is leading the way survey-shield.com
Survey Shield
Survey Shield - AI-powered survey bot-detection analysis
survey-shield.com
So… we just found out that GPT sol can complete a complex online behavioral/cognitive study producing nearly indistinguishable behavior and subjective reports… right as we are about to launch. Is this doomsday for online cognitive testing?