Scientists have developed a real-time system that reads brain signals to identify which speaker a listener is focused on, marking the first proof that a mind-reading hearing device can genuinely improve speech perception.
The study, published in Nature Neuroscience, was led by Vishal Choudhari of the Department of Electrical Engineering at Columbia University.
Current hearing aids amplify everything equally, making crowded environments exhausting for users. This system works differently. It reads low-frequency and high-gamma brain signals through implanted electrodes, reconstructs the speech pattern of the attended speaker, then boosts that voice while reducing the competing one by up to nine decibels.
Researchers tested the system on four patients who already had brain electrodes placed for epilepsy monitoring. Participants listened to two simultaneous conversations separated in space.
The system decoded their attention every four seconds and adjusted audio levels accordingly. Decoding accuracy ranged from 72 to 90.3 percent across participants, delivering an average volume boost of 12 decibels between inactive and active conditions.
Brain decoding accuracy directly shapes the listener’s experience
The perceptual gains were significant across multiple measures. Participants preferred the active system between 75 and 95 percent of the time. Speech understanding improved noticeably, and pupil size measurements confirmed reduced mental effort during active trials.
Researchers also found that every one-percent increase in decoding accuracy raised the likelihood of preferring the system by 4.3 percent, directly linking technical performance to real listening experience.
#1st direct evidence that
🧠-controlled technology can help listeners isolate a single voice in a crowded environmentThe study demonstrates a system that acts as a “neural extension,” utilizing real-time brain signals to identify which speaker a person is focusing on and… pic.twitter.com/4bWBc3zLFI
— Mack (@Analytics_699) May 13, 2026
The team ran three separate experiments. The first confirmed basic perceptual benefits. The second showed the system could follow instructed attention switches, adapting within an average of 5.1 seconds after a participant shifted focus.
The third tested voluntary, self-initiated switches without any external cue, which the system tracked successfully. In a critical control test, researchers secretly reversed the gain, suppressing the attended speaker instead.
Participants immediately reported confusion and difficulty, confirming that correct brain decoding drove the benefits.
Mind-reading hearing system offers greatest gains for severe hearing loss
Forty participants with hearing loss then listened to audio processed by the system during the earlier trials. They not only preferred the brain-enhanced audio but also showed greater intelligibility gains than the normal-hearing group. The largest improvements appeared among those with moderate-to-severe hearing loss.
Researchers acknowledged that brain implants are not yet practical for most people. However, they described this work as defining an upper performance limit, a measurable standard that less invasive future technologies can aim to match.
See all the latest news from Greece and the world at Greekreporter.com. Contact our newsroom to report an update or send your story, photos and videos. Follow GR on Google News and subscribe here to our daily email!
