Overview
- The peer‑reviewed study published Monday showed a single surgically implanted 253‑electrode array on the sensorimotor cortex could translate attempted speech into text and attempted gestures into avatar movements within seconds.
- Researchers tested the system in two people with severe paralysis — one after a brainstem stroke and one with ALS — using constrained sets of roughly ten phrases and a similar number of gestures.
- The team ran separate speech and gesture AI decoders in parallel so decoded phrases appeared as text while a personalized full‑body avatar performed the matched gestures in real time.
- Performance was promising in this small sample, including perfect accuracy in three assessments for one participant, but the study is limited by sample size, narrow vocabularies and short‑term testing.
- Authors and commentators say next steps must include larger, longer trials to assess safety and array stability, expand words and gestures, and test real‑world use cases such as device control or daily communication support for people with paralysis.