Sho Akamine

@shoakamine.bsky.social

Ph.D candidate @mpi-nl.bsky.social studying multimodal alignment in social interaction. Interested in #mulitmodality, #interaction, #kinematics, #stats, #causal_inference. Okinawa🇯🇵 → Nijmegen🇳🇱

Visuospatial experience shapes the form of gestures: Blind speakers gesture with more precise spatial tracking of motion than sighted speakers. New paper by @ezgimamus.bsky.social , Mounika Kanakanti, @shoakamine.bsky.social, @asliozyurek.bsky.social. doi.org/10.3758/s134....

Visuospatial experience shapes the form of gestures: Blind speakers gesture with more precise spatial tracking of motion than sighted speakers - Psychonomic Bulletin & Review

Co-speech gestures emerge from the interaction between visuospatial experience and speech formulation, but what happens when visual experience is absent from birth? Blind individuals gesture in ways consistent with their native language, albeit they gesture less frequently. However, nothing is known about whether their gesture form differs from that of sighted individuals. Using computer vision technologies, this study examines whether gesture kinematics are shaped by visuospatial experience. In an auditory motion-description task, we analyzed spontaneous path-only gestures – depicting motion trajectories – produced by 20 congenitally blind, 21 blindfolded, and 21 sighted Turkish speakers. We assessed the gestures’ alignment with actual motion paths, along with duration and size. Blind participants produced gestures that were more precisely aligned with the motion trajectories, as well as larger and longer. These findings show that altered spatial cognition in blindness enhances gesture precision. The study underscores the role of sensorimotor experience in shaping gesture form.

doi.org

LingMethodsHub has been in need of some devops TLC for a while, and I finally got around to it! To make sure things are working as intended, I've put together this tutorial on using @vincentab.bsky.social's {marginaleffects} package!

Using {marginaleffects} to understand statistical models – LingMethodsHub

This is a tutorial about how to use the {marginaleffects} package to extract and plot predictions of interest from a statistical model.

lingmethodshub.github.io

My current position will be coming to a close at the end of 2026, so I’m beginning to explore next steps. I’m a postdoctoral researcher at UCL working at the intersection of language, cognition, and multimodal communication. 1/4 👇

A proofed version of our commentary is now available here pure.mpg.de/rest/items/i... Also, the authors have posted their response to the full set of 25 commentaries bsky.app/profile/kmah...

For robust research, center values, not technology
Mark Dingemanse* and Christine Cuskley
*Corresponding author.
doi:10.1017/S0140525X26104816
Large language models are interesting, but linguistics and cognitive science should be cautious about centering any new technology as a magic bullet. Doing so reinforces the historically “narrow focus” of linguistics identified in the target article, rather than expanding our understanding of human language. We argue that centering values instead of technology is the best way to future-proof scholarly work and to keep finding out new things about language.
Kyle Mahowald@kmahowald.bsky.social · 4mo ago

Richard @futrell.bsky.social and I have posted our response to the commentaries on our BBS target article "How Linguistics Learned to Stop Worrying and Love the Language Models." The response is: "You Can't Fight in Here! This is BBS!" arxiv.org/abs/2604.09501

Very happy to see this publication out by our great student @shoakamine.bsky.social . This will advance the way we measure whether two mimicing behavior is same or not applied Kinematic measures applied to gesture and validated by hand coding and big data 👏👏👏

Max Planck Institute for Psycholinguistics@mpi-nl.bsky.social · 4mo ago

Validating dynamic time warping as a measure of gesture form similarity. New paper by @shoakamine.bsky.social , @dingemansemark.bsky.social & @asliozyurek.bsky.social doi.org/10.3758/s13428-026-02975-5

Validating dynamic time warping as a measure of gesture form similarity. New paper by @shoakamine.bsky.social , @dingemansemark.bsky.social & @asliozyurek.bsky.social doi.org/10.3758/s13428-026-02975-5

Validating dynamic time warping as a measure of gesture form similarity - Behavior Research Methods

Dynamic time warping (DTW) is a well-known algorithm used to assess the similarity between signals of varying lengths. Initially developed for automatic speech recognition, DTW has found applications in psycholinguistics, particularly in analyzing gesture form similarity. An open question in this domain is how effectively DTW captures gesture form similarity. Here, we validate DTW against human annotations of gesture form similarity across two multimodal interaction corpora and explore its utility as an automatic, continuous measure of gesture form similarity. Our findings reveal weak to moderate correlations between DTW distance and the number of similar gesture features – such as handshape, movement, orientation, and position – suggesting that DTW serves as a useful proxy for gesture form similarity. Additionally, we highlight the importance of qualitative analysis of raw data and DTW predictions in enhancing DTW’s predictive accuracy. Our study offers a rigorous validation of DTW as a measure of gesture form similarity and presents a detailed framework for preprocessing motion tracking data and calculating DTW distance. While none of the methods is perfect, the combination of automatic and manual measures provides a comprehensive approach to understanding and measuring gesture form similarity.

doi.org

Our new review paper (w/Anna Kuhlen) is out emphasising the cognitive complexities involved in everyday face-to-face conversation and a call for scaling up traditional psycholinguistic paradigms to better capture these complexities, esp multimodality, addressee responses and multiparty interactions.

Max Planck Institute for Psycholinguistics@mpi-nl.bsky.social · 5mo ago

In this new review in Nature Reviews Psychology our researchers Judith Holler and Anna K. Kuhlen argue that conversation is not simply one person speaking while another listens. It is more like a partnership between minds. www.mpi.nl/news/why-con...

📢 心理言語学(文処理)の概説書が出ました! 心理言語学は大学の言語学の講義であまり扱われることがないので学ぶ機会が少ないと思うのですが、この本を読めば、「ひとが言葉を理解・産出する仕組み」に関する古典的な知見から最新の研究(予測処理、自然言語処理の技術を用いた計算モデリング的研究など)まで理解できるようになっています。第1章で、研究するときに身につけておきたい基本的な考え・研究のコツも紹介しているので学部生・院生のかたもぜひ。 本書が少しでも心理言語学に関心のある多くのひとに読まれ、今後、言語学内外の様々な分野との交流の契機になればとても嬉しく思います🍀

矢野雅貴(編)・伊藤愛音・大石衡聴・大関洋平・小野創・小泉政利・峰見一輝・門馬将太(著)『ひとが言葉を理解・産出する仕組みー心理言語学 入門』