NeuroAI NEUROAINEUROAI.SITE
ESC

A Shanghai brain–computer interface now decodes Chinese from neural signals — built for patients who have lost speech

A collaboration between Fudan University's Huashan Hospital and the Shanghai Rockies NeuroAI Institute has pushed a Chinese-language brain–computer interface (脑机接口) into clinical trials. Trained on just 54 characters, the system generalizes to nearly 2,000 common Chinese characters and turns a full sentence of brain activity into text in half a second — a design aimed squarely at ALS (渐冻症) and stroke patients who can no longer speak.

2026-09-29 · 959 words · NeuroAI
A Shanghai brain–computer interface now decodes Chinese from neural signals — built for patients who have lost speech

A patient who cannot move a muscle thinks a sentence, and a screen finishes it. In a Shanghai hospital ward, that stopped being a thought experiment and started being a clinical result. The hard part was never the electrode — it was the Chinese language itself.

The work comes from the Shanghai Rockies NeuroAI Institute (上海岩思类脑人工智能研究院), working with Huashan Hospital affiliated with Fudan University (复旦大学附属华山医院), the National Center for Neurological Diseases, the iBRAIN EEG alliance, Zhejiang University and the Chinese Academy of Sciences' Shanghai Institute of Microsystem and Information Technology. What they built is a neural-signal large model (大模型) that reads speech intent straight out of the brain and writes it back as Chinese.

Why Chinese is the hard part

Most brain–computer interface (脑机接口) demos you have seen decode English, or simple yes/no choices. English gets by with roughly 50 phonemes. Mandarin is a different animal: about 418 syllables multiplied by 4 tones, which balloons the number of distinct sound-units past 400 once you combine initials, finals and tone. Build a decoder that confuses one tone for another and you have changed the meaning of the whole word.

That is why a "Chinese operating system for the brain" is harder than it sounds. The team did not try to predict characters one by one. Instead it broke spoken Chinese down to its smallest pieces — initials and finals — then rebuilt upward.

How the decode actually works

The patients in the trial already had clinically approved stereoelectroencephalography (SEEG) electrodes implanted — between 8 and 10 thin probes reaching different brain regions and depths. Researchers recorded neural activity while a subject read aloud a small set of characters, then fed that signal into a four-level decoder:

  • Initials and finals are recognized first, the raw phonetic atoms of Mandarin.
  • Those combine into syllables.
  • Syllables map to characters.
  • Characters assemble into full sentences.

Crucially, the model is personalized. One subject spent about 100 minutes in training, reading just 54 Chinese characters aloud. From that tiny seed the system extrapolated to 1,951 commonly used characters — a generalization ratio the team describes as 1:36.

The numbers that matter

The headline figures are not marketing rounded numbers; they are the ones clinicians repeated across disclosures:

  • Initial-consonant recognition above 83% (across 10 initials).
  • Final-vowel recognition above 84% (across 15 finals).
  • A complete Chinese sentence decoded in under 0.5 seconds, with no hard limit on sentence length.

Speed matters here because the goal is real-time conversation, not transcription after the fact. A person "thinking" a sentence and seeing it appear fast enough to keep a dialogue going is the difference between a medical device and a lab curiosity.

Who this is really for

The trial ran on ten epilepsy patients whose electrodes were already in place for clinical care. But the people the system is built to serve are those with ALS (渐冻症) and post-stroke aphasia — patients whose minds stay intact while their bodies lock down. For them, an implanted decoder that turns inner speech into visible, shareable Chinese is not a productivity tool. It is the restoration of a basic human right: being heard.

Huashan Hospital president Mao Ying (毛颖) has framed the value plainly — the point of this frontier is not concept demos, it is letting patients "move, walk and speak" again, lifting their quality of life. The hospital has also launched what it describes as the world's first multi-center BCI cohort study, moving the field from one-off cases to standardized, long-term observation.

What it is not yet

Two honest caveats. First, the published validation is in epilepsy subjects, not yet in ALS or stroke patients directly — the aphasia application is the stated target, and the generalization claim is what makes that plausible, but it is not the same as a locked clinical result in the eventual users. Second, decoding accuracy, while leading for Chinese, is not perfect; an 83–84% phoneme hit rate still leaves room for misread tones, and real quiet speech (thinking without vocalizing) is a harder signal than reading aloud.

What readers can do now

  • If you work in assistive tech or neurology, watch this "train on a few characters, generalize to thousands" approach — it lowers the data burden that has historically blocked BCI from everyday use.
  • If you report on or fund neurotech in China, treat Huashan's multi-center cohort as the milestone to track; standardized real-world data, not a single dramatic case, is what turns a breakthrough into a treatment.
  • If you have a loved one affected by ALS or aphasia, ask clinicians about trial enrollment pathways rather than waiting for a commercial product — this research is already in the clinic, not on a slide.

Honest limitations

Core facts (collaboration among Shanghai Rockies NeuroAI Institute, Fudan University's Huashan Hospital, the National Center for Neurological Diseases, iBRAIN, Zhejiang University and CAS Shanghai Institute of Microsystem; SEEG electrodes 8–10; ~100 minutes training on 54 characters; 1:36 generalization to 1,951 common characters; >83% initial-consonant and >84% final-vowel accuracy; sub-0.5-second full-sentence decode; targeting ALS and stroke aphasia; world-first multi-center BCI cohort launched) are drawn from the Shanghai Municipal Government information office (shio.gov.cn), Cailianshe (财联社, cls.cn) and a TechTimes report, all describing a mid-2025 clinical disclosure. The "Chinese is harder" framing (418 syllables × 4 tones, ~50 English phonemes) is stated in those same reports. The trial subjects were epilepsy patients with pre-implanted electrodes; direct ALS/stroke-patient validation is the stated forward aim, not a reported completed result. Phoneme accuracies and decode speed are vendor/clinical claims from the research group, not yet an independent third-party benchmark on end-user patients. No RMB figures appear in this article, so no currency conversion applies. Analysis is current to 29 September 2026.

Related coverage

More in “Brain–Computer Interface” → · Back to home · Markdown version