CALIFORNIA: In a remarkable scientific breakthrough, researchers at the University of California San Francisco (UCSF) have made significant progress toward providing a means for paralyzed individuals to communicate naturally, potentially eliminating the need for dialysis or immune-suppressing drugs. Through the development of an implantable brain-computer interface (BCI), they have successfully decoded speech and facial expressions from brain signals for the first time.
The breakthrough, published in Nature on August 23, 2023, is a part of “The Kidney Project” and was led by Edward Chang, M.D., Chair of Neurological Surgery at UCSF. The project’s primary aim is to develop a BCI that enables natural communication and speech for individuals suffering from paralysis.
One of the remarkable individuals contributing to this research is Ann, who experienced a brainstem stroke at the age of 30, rendering her severely paralyzed. This stroke left her unable to move or speak, and she faced the daily fear of not waking up.
Paralyzed Individuals to Communicate Naturally
Ann’s journey of recovery has been a testament to her resilience, involving years of physical therapy to regain limited muscle control, including the ability to smile and cry. However, the muscles necessary for speech remained unresponsive.
With the implantation of a thin, electrode-covered device onto her brain’s surface, the research team aimed to intercept the neural signals that would typically control the muscles involved in speech and facial expressions. A cable connected the electrodes to a computer system, enabling the team to decode Ann’s brain signals and translate them into speech.
What sets this innovation apart is the meticulous training of artificial intelligence algorithms to recognize Ann’s unique brain signals associated with speech. The system focuses on phonemes, the smallest units of speech that form words, resulting in improved accuracy and speed. Ann’s voice was synthesized using an algorithm personalized to sound like her pre-injury voice, based on a recording from her wedding.
To complete the communication experience, the team animated an avatar to mimic facial expressions during conversation, with software that simulates muscle movements. This was a profound moment for Ann, who expressed the desire for her daughter to hear her real voice someday.
While this technology is currently connected to the user through a physical cable, the team aims to develop a wireless version, offering individuals greater independence in controlling their devices.
For Ann, her involvement in this groundbreaking study has brought a sense of purpose and contribution to society, transforming her life and offering hope to others facing similar challenges.
