Here we go! We can finally share what Sharjeel Shaikh @sharjeelshaikh has been leading the work on with us! Consider participating in our detection challenge

@sharjeelshaikh.bsky.social · 3d ago

Gesture Challenge 2026 is open. envisionbox.org/gesture_chal... @babajideowoyele.bsky.social @wimpouw.bsky.social @jamestrujillo.bsky.social @esamghaleb.bsky.social @gdemelo.bsky.social

The [DRAFT] program for AVSP 2026 is out! Check out project.inria.fr/avsp2026/wor... A terrific day to be had: Great presentations throughout An excellent keynote project.inria.fr/avsp2026/key... A 50th anniversary event re. the McGurk & MacDonald effect (there may be cake🎂) A lipreading contest😦

Multimodal Communication in Autism Is Reorganized, Not Reduced: Evidence From Speech and Gesture Across Four Languages journals.sagepub.com/doi/10.1177/... Autistic & non-autistic children tell stories, speech & gesture analyzed wrt amount, diversity & complexity.

Multimodal Communication in Autism Is Reorganized, Not Reduced: Evidence From Speech and Gesture Across Four Languages - Armita Ghobadi, Pauline Wolfer, Stephanie Durrleman, 2026

Speech and gesture form an integrated communicative system, yet how this system operates in autism, and whether it varies across languages, remains unclear. We ...

journals.sagepub.com

Exploring the acceptability of a lip-reading app in acute and critical care: Perspectives from patients with tracheostomies, relatives and healthcare professional www.sciencedirect.com/science/arti... Study aimed to explore the acceptability of SRAVI among tracheostomies patients relatives & staff

Multimodal Language Processing in Children With Developmental Language Disorder: The Influence of Verbal and Visuospatial Memory pubs.asha.org/doi/10.1044/... How do verbal & visuospatial memory capacities contribute to the processing & comprehension of pragmatic meanings in children with/out DLD?

Multimodal Language Processing in Children With Developmental Language Disorder: The Influence of Verbal and Visuospatial Memory

Purpose: This study investigates how verbal and visuospatial memory capacities contribute to the processing and comprehension of pragmatic meanin...

pubs.asha.org

📚 Citation Classic "Robust text-independent speaker identification using Gaussian mixture speaker models" Reynolds & Rose (1995) Citations: 7600+ GMM-based... 🔗 https://scholar.google.com/scholar?q=Reynolds+Rose+1995+Robust+text-independent+speaker+identification+Gaussian+mixture #SpeechScience

Larger language models better align with neural representations of natural language elifesciences.org/articles/101... Fitted electrode-wise (ECoG) encoding models from contextual embeddings of each hidden layer of LLMs to predict word-level neural signals. The early layers of larger LLMs do better..

Larger language models better align with neural representations of natural language

Embeddings from larger language models and relatively earlier layers better predict neural activity during natural language.

elifesciences.org

Simultaneous speech and gesture decoding for multimodal communication in paralysis www.nature.com/articles/s41... Shows neural signals recorded with a single high-density electrocorticography implant can support simultaneous decoding of speech & gestures Commentary www.nature.com/articles/d41...

Simultaneous speech and gesture decoding for multimodal communication in paralysis - Nature Neuroscience

Brosler et al. develop a brain–computer interface that simultaneously decodes speech and gestures from a single cortical implant to animate a virtual avatar, providing a step toward more flexible comm...

nature.com

Visual speech enhances phoneme separability in human superior temporal gyrus https://www.biorxiv.org/content/10.64898/2026.09.10.750762v1

Impact of visual mouth image presentation on speech perception in noise in normal hearing subjects and cochlear implant users journals.plos.org/plosone/arti... Computer‑animated avatar provided no speech perception AV benefit; real‑speaker videos enhanced AV speech perception but no impact on effort

Impact of visual mouth image presentation on speech perception in noise in normal hearing subjects and cochlear implant users

This study investigated the impact of visual speech cues on speech perception in noise and subjective listening effort in cochlear implant (CI) users compared with normal-hearing (NH) individuals. Fur...

journals.plos.org

The Cortical Contribution to the Speech-Frequency–Following Response Is Not Modulated by Visual Information onlinelibrary.wiley.com/doi/10.1111/... "Our results suggest that visual modulation of the speech-FFR in the auditory cortex is, if existent, too small to be measurable"

Next time when you're thinking of zooming in on that meeting when driving ... "Fast cars, slow words? Tracking processing of concurrent speaking and driving in real time" link.springer.com/article/10.3...

Fast cars, slow words? Tracking processing of concurrent speaking and driving in real time - Psychonomic Bulletin & Review

The study of multitasking provides a unique window into the interaction of cognitive processes and systems and as such, into the cognitive architecture of the human mind. Previous studies reported tha...

link.springer.com

The shrinking landscape of linguistic diversity in the age of large language models www.nature.com/articles/s41... Egads, the trumpet tongues of scholars now sound a single tune; gone, the curate's egg of runny then congealed prose, all is pabulum.

The shrinking landscape of linguistic diversity in the age of large language models - Nature Human Behaviour

Sourati et al. find that variance in writing complexity dropped on social media, news and scientific writing after ChatGPT’s release, a shift from individuality towards uniformity. LLM polishing strip...

nature.com

Rhythm Across Species: Situating Human Speech in a Comparative Framework nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... Examined speech rhythm using units used for nonhuman animals: interonset intervals (IOI) found these durations are relatively similar across a sample of 48 languages - we fit in🥁

NYAS Publications

We analyzed speech rhythms from 48 human languages using methods drawn from biology and linguistics. Interonset intervals across languages are surprisingly similar, with a median value of 2 seconds.,...

nyaspubs.onlinelibrary.wiley.com

Go, @andreadevarda.bsky.social! A beautiful and comprehensive study! 🔑 findng: behav. measures are ~fully reducible to simple predictors of processing effort (surprisal, word length+frequency), but for 🧠 measures, LLM embeddings carry additional predictive power, likely capturing aspects of meaning.

Andrea de Varda@andreadevarda.bsky.social · 3w ago

New preprint! 🧠👀🤖 Behavioral and brain responses to language reflect different levels of linguistic representation w/ @whylikethis.bsky.social , @evfedorenko.bsky.social , and @rplevy.bsky.social (1/10)

The role of high-amplitude bursts of high-gamma activity in naturalistic speech and music listening direct.mit.edu/imag/article... Neuronal avalanches (top 1% of high-gamma activations) may provide an insight into stimulus-relevant, large-scale neural dynamics - its always the bursty noise makers

The role of high-amplitude bursts of high-gamma activity in naturalistic speech and music listening

Abstract. A central challenge in systems neuroscience is to understand how distributed brain networks organize activity during naturalistic cognition. Here, we investigate whether transient, high-ampl...

direct.mit.edu

Evaluating perceptual evidence of cross-modal plasticity in older adults with hearing loss using an AV word mismatch task www.sciencedirect.com/science/arti... Audio/visual mismatch detection task noise/no noise; greater hearing loss not associated with visual benefits or altered gaze to face

📚 Citation Classic "wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations" Baevski et al (2020) Citations: 9100+ wav2vec 2.0 showed self-supervised pretraining slashes the need for labeled speech. 🔗 https://arxiv.org/abs/2006.11477 #SpeechScience

Sensory context improves language prediction in humans & LLMs www.pnas.org/doi/abs/10.1... Compared humans predicting language in reading, listening, watching AV videos with text-based LLM predictions. People do better, AV ~ AO > reading (some of it is prosody); LMMs do better when given this info👁️👂

Colin Cherry (1953) described how we can focus on one conversation in a noisy room full of people talking. This launched decades of research into selective attention and speech perception. 🎧 Cherry (1953) - foundational auditory perception study #SpeechScience #Perception

Assessing Visual Speech Communication Abilities: Cross-Situational Consistency in Lipreadability brill.com/view/journal... Visual speech abilities: Receivers consistently good or poor at lipreading regardless of the talker;OR, talkers consistently lipread accurately or not, regardless of listener 👁️😮

Viewpoint on Multisensory Time Perception brill.com/view/journal... Shi & van Wassenhove draw on decades of research & argue that the field has undergone an important shift from the centralized internal clock toward timing as an active inference process.

Voice perception reflects graded sensitivity to acoustic cues along the auditory hierarchy www.sciencedirect.com/science/arti... How like a human voice? Acoustic patterns over time; Perceptual & neural features align most in the auditory association area; voiceness: a hierarchical encoding framework

Voice perception reflects graded sensitivity to acoustic cues along the auditory hierarchy

Humans readily recognize voices in noisy, challenging environments, yet how the brain does this remains poorly understood. A key question is whether t…

sciencedirect.com

Music Is Quasi-Rhythmic Too: Comparing Bandwidth in Speech and Music Acoustic Modulation Spectra. nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... Confirms findings that speech & music modulation spectra differ in their centre frequency -> but find that the modulation bandwidth is comparable 🎵 ↔️ 💬

Distinct neural processes link speech planning and execution www.nature.com/articles/s41... Busy day on the intracranial recordings research front: planning => prefrontal units => dynamically integrated => execution via speech motor regions representing speech sound units & transitional properties

Distinct neural processes link speech planning and execution - Nature Human Behaviour

Direct recordings from the human brain reveal a hierarchy in planning to speak, with neural activity organizing whole syllables before the individual sounds that compose them are sequenced.

nature.com

Invariant neural representation of parts of speech in the human brain www.cell.com/current-biol... 1,801 electrodes,20 patient, 2 word adjective noun phrases, representation of parts of speech invariant across isual and auditory presentation modalities! Robust to word order, length, frequency ...

Invariant neural representation of parts of speech in the human brain

Misra et al. use invasive neurophysiological recordings from the human brain to describe a highly circumscribed region within the left lateral orbitofrontal cortex that shows strong selectivity for pa...

cell.com

Signal-specific performance of in-ear EEG: strengths and limitations www.frontiersin.org/journals/neu... Results indicate signal detectability depends strongly on signal class, effect size, & recording geometry ->so, a configuration-aware guidance for study design and future in-ear EEG development 👍

Frontiers | Signal-specific performance of in-ear EEG: strengths and limitations

Fully in-ear Electroencephalography (EEG) configurations prioritize wearability and rapid setup but may constrain spatial sampling and signal-to-noise charac...

frontiersin.org

Audiovisual speech perception in Cantonese-speaking children: Developmental trajectories and the role of noise academic.oup.com/chidev/advan... Results suggest that children gradually learn to use the most reliable source of information depending on listening conditions

Audiovisual speech perception in Cantonese-speaking children: Developmental trajectories and the role of noise

Abstract. The development of audiovisual speech perception in tone-language-speaking children remains debated, and this study addressed this issue by exami

academic.oup.com

Real-Time Conversation Comprehension in Younger and Older Adults: The Effects of Noise, Visual Speech, Speaker Switch, and Context journals.sagepub.com/doi/10.1177/... A fun one to put together, we used a topic monitoring task to assess real-time semantic processing, we think this task is useful! 👍

Real-Time Conversation Comprehension in Younger and Older Adults: The Effects of Noise, Visual Speech, Speaker Switch, and Context - Chris Davis, April Ching, Afrah Haroon, Jeesun Kim, 2026

This study investigated older and younger adults’ conversational speech understanding using an established topic monitoring task to assess real-time semantic pr...

journals.sagepub.com

Pedagogy in the speech-gesture couplings of caregivers: Evidence from a corpus-based analysis https://pubmed.ncbi.nlm.nih.gov/42574797/