arXiv:2611.05581v1 Announce Type: new Abstract: Real-world vision is dynamic and scene-rich, while EEG and fMRI resolve it at complementary temporal and spatial scales. Most neural decoding systems, however, align one modality in isolation and mostly against static images or short clips. We study the synchronized case: EEG and fMRI are recorded during the same long-form naturalistic viewing, giving a shared stimulus but also recurring narrative context and many semantically similar candidates. We present BrainBind, a framework that maps synchronized EEG and fMRI into frozen long-form video embedding spaces and treats those spaces as common visual-semantic references, not literal neural codes. On CineBrain, a five-seed Recall@K 2 x 4 matrix across two video anchors and four system configurations shows distinct retrieval profiles. With Omni, fMRI organizes the full candidate list most strongly (MRR = 23.82, nDCG@10 = 25.31), while Joint-Dual gives the highest mean label-aware R@1 (13.52%) with a distinct rank-wide profile. The complementary episode-disjoint evaluation quantifies the contribution of repeated stimulus identity and narrative context to the random split. Across these experiments, proxy choice and system configuration produce distinct top-rank and rank-wide retrieval profiles within the present synchronized dataset. The code is available at https://github.com/Forainest789/Brainbind.
BrainBind: Bridging Synchronized EEG and fMRI through Long-Form Naturalistic Video Representations
Researchers released BrainBind, a framework that maps synchronized EEG and fMRI recordings from the same long-form naturalistic video viewing into frozen long-form video embedding spaces, with code available on GitHub. On the CineBrain dataset, a five-seed Recall@K 2 x 4 matrix across two video anchors and four system configurations showed that with Omni, fMRI organized the full candidate list most strongly (MRR = 23.82, nDCG@10 = 25.31), while Joint-Dual gave the highest mean label-aware R@1 at 13.52%. A complementary episode-disjoint evaluation quantified how much repeated stimulus identity and narrative context contribute to the random split, with the authors concluding that proxy choice and system configuration produce distinct top-rank and rank-wide retrieval profiles within the synchronized dataset.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.