Auditory-Visual Speech Association (AVISA)

@avsp.bsky.social

The official(ish) account of the Auditory-VIsual Speech Association (AVISA) AV 👄 👓 speech references, but mostly what interests me avisa.loria.fr

Visual identification of Taiwan Mandarin rounded vowels pubs.aip.org/asa/jel/arti... Study examined how Taiwan Mandarin speakers identify rounded vowels using visual-only input. Results reveal an asymmetric pattern between /y/ & /u/, with a bias toward /u/ 👁️👄

Visual identification of Taiwan Mandarin rounded vowels

While auditory and visual cues jointly support vowel perception, the role of visual information alone in vowel identification remains understudied. This study e

pubs.aip.org

Human neuron activity during an 83-minute movie from 2,286 neurons & 29 patients www.nature.com/articles/s41... Single Unit activity(29 intracranially implanted patients) from the Medial temporal lobe:Amygdala, hippocampus, entorhinal cortex, parahippocampal cortex as they watched 500 Days of Summer

Human neuron activity during an 83-minute movie from 2,286 neurons and 29 patients - Scientific Data

Scientific Data - Human neuron activity during an 83-minute movie from 2,286 neurons and 29 patients

nature.com

Effects of Hearing Loss and Hearing Aid Directionality on Performance and Orienting Behavior in a Multi-Talker Audiovisual Search Task www.ovid.com/jnls/ear-hea... Found fundamental differences in task performance and orienting behavior between HI & NH listeners in complex multi-talker environments

Effects of Hearing Loss and Hearing Aid... : Ear & Hearing

Objectives:Hearing-impaired (HI) individuals experience substantial difficulties with speech perception in reverberant environments with multiple...

ovid.com

Repetition induced rhythm as an alternative account to statistical word segmentation: A model and meta-analysis www.sciencedirect.com/science/arti... Proposes word segmentation driven by rhythmic properties of the artificial language input used in prior studies- Neat interpretation & novel findings

Repetition induced rhythm as an alternative account to statistical word segmentation: A model and meta-analysis

From a brief exposure to an artificial language, infants and adults can segment out the embedded words in the speech input. The fact that segmentation…

sciencedirect.com

Silent speech with ultrasound alephneuro.com/blog/silent-... Predicted speech from tongue ultrasound recordings (claims open-vocabulary WER of 15.6%) "just needed to transfer our video embeddings into the embedding space of Whisper" - light on details - wondering if @awrench.bsky.social has views

Silent speech with ultrasound — Aleph

We trained a model to predict speech from ultrasound video of the tongue, no speaking required. It reads open text, generalizes across people, and reaches a 15.6% word error rate on open-vocabulary sp...

alephneuro.com

Seeing a Talker’s Mouth Reduces the Effort of Perceiving Speech and Repairing Perceptual Mistakes for Listeners With Cochlear Implants www.ovid.com/jnls/ear-hea... Speaker visual cues improve speech intelligibility & reduces listening effort, especially for CI listeners when repairing a missing word

Seeing a Talker’s Mouth Reduces the Effort of... : Ear & Hearing

Objectives:Seeing a talker’s mouth improves speech intelligibility, particularly for listeners who use cochlear implants (CIs). However, the impacts...

ovid.com

Bsky research peeps >help🆘 I'll be on a panel discussing Navigating Research in the World of Social Media Today There will be questions - hence the plea Any ideas for this Q In your experience, what are some of the benefits and potential risks of using social media platforms to communicate research?

The ‘design features’ of language revisited www.cell.com/trends/cogni... "In 1960, Hockett proposed 13 ‘design features’ of language to identify commonalities with, and differences from, other nonlinguistic signaling systems and animal communication systems...We re-evaluate Hockett’s framework" 🫣

The ‘design features’ of language revisited

Language is often regarded as a defining trait of our species, but what are its core properties? In 1960, Hockett published ‘The origin of speech’ enumerating 13 design features presumed to be common ...

cell.com