Tessera

Björn E. Hommel

@bjoernhommel.bsky.social

Natural Language Processing in Behavioral Science Postdoctoral Researcher @unileipzig.bsky.social Personnel Selection & Assessment Technology at magnolia psychometrics https://www.magnolia-psychometrics.com/

8 Posts111 Follower 30 Folgt

Annika Külpmann @anniria.bsky.social · 6mo ago

How many versions of the Iowa Gambling Task (IGT) exist? And how much does this affect research using the IGT? More than you might think. 🧵

PsyArXivBot@psyarxivbot.bsky.social · 6mo ago

Methodological Flexibility in the Iowa Gambling Task Undermines Interpretability: A Meta-method Review: https://osf.io/4g3vr

Ruben C. Arslan @ruben.the100.ci · 8mo ago

Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example. journals.sagepub.com/doi/10.1177/...

Fig. 3. Scatter plots of the synthetic and empirical estimates, validation study (Stage 2). Showing N = 30,135 item-pair correlations, N = 257 scale reliabilities, and N = 1,568 scale-pair correlations for (top) the pretrained SBERT model and (bottom) the fine-tuned SurveyBot3000 model. SBERT = all-mpnet-base-v2 model.

Fig. 4. Prediction error of the synthetic estimates, validation study (Stage 2). Our prediction model allowed the error term to vary freely according to the predictor, the synthetic estimate. The thin-plate splines show that some synthetic estimates were predictably more accurate.

Fig. 5. Accuracy by domain. Accuracy differed across domains. SurveyBot3000 accuracy (colored) was always higher than SBERT accuracy (gray). Results were largely consistent whether accuracy of items was tested (left, circle) within domains or (right, cross) across domains.

Fig. 1. Multistep training procedure for the SurveyBot3000, which produces synthetic estimates of interitem correlations. (a) Pretraining base model (SBERT). (b) Fine-tuning SurveyBot3000. (c) Validation. SBERT = all-mpnet-base-v2 model.

Ruben C. Arslan @ruben.the100.ci · 8mo ago

Want to make nice graphs with me, starting next year? I'm hiring for a position at the University of Witten/Herdecke. uni-wh.softgarden.io/job/61280592...

‘A fragmented field: Construct and measure proliferation in psychology.’ (2025)

From ‘Language models accurately infer correlations between psychological items and scales from text alone.’ (2025)

From ‘Not within spitting distance: salivary immunoassays of estradiol have subpar validity for predicting cycle phase.’ (2023)

Work in progress with cycle tracking data from the app Clue

Björn E. Hommel @bjoernhommel.bsky.social · 8mo ago

🚨 SynthNet is out 🚨 Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3

Björn E. Hommel @bjoernhommel.bsky.social · 11mo ago

If you're going to #DPPD25 next week and would like to learn more about LLMs in Behavioral Science: One spot for my Workshop "Introduction to Large Language Modeling" (Kassel, next Sunday) just opened up. dppd2025.de/programm/pre...

Pre-Conference Workshops - DPPD 2025

Alle Pre-Conference Workshops finden am 21. September ab 9:00 Uhr statt (ganztägige Workshops). Die Workshops werden ab einer Mindestteilnehmendenzahl von 10 Personen durchgeführt. Die Höchstzahl […]

dppd2025.de

Ruben C. Arslan @ruben.the100.ci · last yr.

One position is DFG-funded (75%, 3 years). Topic: Can LLMs help us defragment psychology? It builds on the SurveyBot3000 huggingface.co/spaces/magno... You'll get to collaborate with @bjoernhommel.bsky.social, @jamiecummins.bsky.social, @malte.the100.ci and a mystery cool person.

Synthetic Correlations - a Hugging Face Space by magnolia-psychometrics

Discover amazing ML apps made by the community

huggingface.co

Malte Elson @malte.the100.ci · 2y ago

Check out RegCheck, the latest research tool by the lab, headed by @jamiecummins.bsky.social: Automatically compare preregistrations with papers and reports deviations. We might be hiring a postdoc to work on this full time nexyct year, so if this flips your pancake, please get in touch!

Jamie Cummins@jamiecummins.bsky.social · 2y ago

Introducing RegCheck: a tool which uses Large Language Models to automatically compare preregistered protocols with their corresponding published papers and highlights deviations. @malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social regcheck.app

Björn E. Hommel @bjoernhommel.bsky.social · 2y ago

Predict survey response patterns (item & scale correlations + reliability) based on nothing but item text! Try our HuggingFace App huggingface.co/spaces/magno... accompanying @ruben.the100.ci and my latest research #huggingface #llm #ai #psychometrics