Researchers addressed the longstanding “cocktail party problem” by building a prototype called proactive hearing assistants. The device uses AI to follow the rhythm of a conversation and to highlight the voices of the people you are speaking with. The team presented the work in Suzhou at the Conference on Empirical Methods in Natural Language Processing and made the code open‑source.
The system has two models. The first determines who spoke when and looks for low overlap in turns. The second isolates the identified speakers and reduces other voices and background noise. The models can identify partners with only two to four seconds of audio and can handle one to four partners besides the wearer.
The team tested the headphones with 11 participants. Users rated the filtered audio more than twice as favorably as the baseline. The researchers said challenges remain with overlapping talk, long monologues, and people entering or leaving conversations.
Difficult words
- prototype — early model of a new device
- proactive — acting before a problem happens
- rhythm — regular pattern or beat in speech
- isolate — separate one sound from other soundsisolates
- overlap — when two people speak at same time
- baseline — standard condition used for comparison
- monologue — a long speech by one personmonologues
Tip: hover, focus or tap highlighted words in the article to see quick definitions while you read or listen.
Discussion questions
- Would you use hearing assistants that highlight voices in a noisy place? Why or why not?
- What worries or benefits could appear if headphones follow the rhythm of conversations?
- How could such a system help people in meetings or social events? Give one example.
