跳到正文
arXiv cs.LG + cs.RO + cs.HC· Jiacheng Zhang, Xueyi Zhang, Xin Lu, Siqi Cai, Haizhou Li·· 16 小时前AI 评分55

OneEEG:统一数值与视觉 EEG 表示的多任务脑电大模型

OneEEG: A Unified Signal-Visual Multimodal Language Model with Task-Aware Mixture of Projectors for Multi-Task EEG Understanding

AI 导读

研究团队提出 OneEEG,一个面向多任务 EEG 理解的统一 EEG-MLLM 框架,同时建模数值与视觉 EEG 表示,并用任务感知的 Mixture of Projectors(MoP)把不同任务族的 EEG 特征对齐到 LLM 嵌入空间。

正文 · 原文

View PDF HTML (experimental)

Abstract:Electroencephalography (EEG) is widely used in clinical assessment, brain-computer interfaces, and cognitive-state analysis, yet EEG modeling remains fragmented across task paradigms. Recent multimodal large language models (MLLMs) provide a promising interface for flexible multimodal reasoning, but their ability to understand EEG inputs remains limited. In this work, we propose OneEEG, a unified EEG-MLLM framework for multi-task EEG understanding. By training on our curated OneEEG-Instruct, a multi-task EEG instruction-tuning dataset, OneEEG jointly models numerical EEG representations and visual EEG representations, and introduces a task-aware Mixture of Projectors (MoP) to align heterogeneous EEG features across different task families with the LLM embedding space. We further establish OneEEG-Bench, a benchmark for evaluating current MLLMs and our method on multi-task EEG understanding. Experiments show that existing MLLMs have limited ability to interpret EEG inputs, while OneEEG achieves stronger performance by integrating numerical and visual EEG representations with task-aware EEG-to-LLM projection. Extensive ablations and analyses further reveal the effects of visual EEG renderings, MoP variants, router behavior, and feature dispersion across EEG tasks.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2610.35355 [cs.LG]
  (or arXiv:2610.35355v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2610.35355

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Jiacheng Zhang [view email]
[v1] Mon, 26 Oct 2026 12:46:40 UTC (2,417 KB)

来源:arXiv cs.LG + cs.RO + cs.HC · arxiv.org

原文链接:https://arxiv.org/abs/2610.35355