Log in to write a review.

Neuro-Symbolic Decoding of Neural Activity

Authors: Yanchen Wang, Joy Hsu, Ehsan Adeli, Jiajun Wu

Source: arXiv 2603.03343

Published: 2026-02-22

Added: 2026-03-06 09:00 UTC

Open Paper Back to Library

Abstract / Extracted Text

We propose NEURONA, a neuro-symbolic framework for fMRI decoding and concept grounding in neural activity. Leveraging image- and video-based fMRI question-answering datasets, NEURONA learns to decode interacting concepts from visual stimuli based on patterns of fMRI responses, integrating symbolic reasoning and compositional execution with fMRI grounding across brain regions. We demonstrate that incorporating structural priors (e.g., compositional predicate-argument dependencies between concepts) into the decoding process significantly improves both decoding accuracy over precise queries, and notably, generalization to unseen queries at test time. With NEURONA, we highlight neuro-symbolic frameworks as promising tools for understanding neural activity.

Latest Summary

Certainly! Here’s a practitioner-focused summary and takeaways for the paper “Neuro-Symbolic Decoding of Neural Activity” (Wang et al., ICLR 2026), based on a thorough reading of the entire document.

---

Key Findings

  • Neuro-symbolic decoding with structural priors significantly improves fMRI decoding accuracy and generalization.
  • The NEURONA framework uses symbolic reasoning (e.g., predicate-argument structures) with neural network concept modules to interpret fMRI data from visual stimuli, outperforming end-to-end neural models and linear baselines by a wide margin, especially for complex relational queries.
  • Explicit modeling of compositional structure—how concepts and relations interact—yields robust generalization to unseen queries.
  • NEURONA not only performs better on known (train) examples but generalizes much more effectively to novel combinations of concepts (unseen at train time), a key challenge for previous neural decoding approaches.
  • Guided grounding is crucial: guiding the decoding of predicates based on their subject and object arguments (“full argument guidance”) delivers the greatest performance gains.
  • Ablation studies show multi-region, argument-guided grounding consistently outperforms single-region or unguided multi-region grounding, particularly for action and relationship queries.
  • Learned concept groundings are interpretable and consistent across datasets, subjects, and brain region parcellations.
  • NEURONA’s internal mapping of concepts to brain regions is reproducible, showing significantly higher consistency than random baselines and working well across different brain atlas schemes and subjects.

---

Practical Takeaways

  • Incorporating compositional structure and symbolic reasoning into decoding models makes them more accurate and generalizable.

Practitioners working on neural decoding from fMRI data should consider hybrid models that blend symbolic reasoning (predicate-argument structures, scene graphs, etc.) with neural modules, rather than relying solely on black-box, end-to-end architectures.

  • Structural priors about how concepts and relations are organized (e.g., knowing that “holding(person, object)” should depend on regions associated with both the person and the object) are particularly powerful.

For applications involving complex, relational questions about cognitive or perceptual states, explicitly modeling the structure of queries and neural responses will likely yield more robust and interpretable results.

  • NEURONA’s approach is robust across parcellation schemes, subjects, and datasets.

The model retains high accuracy and consistency regardless of the brain atlas used or the individual subject, suggesting strong potential for both research and clinical translation, including real-world neural decoding and BCI systems.

  • Available resources:
  • Public BOLD5000-QA and CNeuroMod-QA datasets can be used for benchmarking future methods on fine-grained, compositionally rich neural decoding tasks.
  • The NEURONA codebase is available [here](https://github.com/PPWangyc/neurona), allowing easy reproduction and adaptation for other fMRI/question-answering problems.

---

### Final note:

NEURONA highlights the value of neuro-symbolic approaches—combining neural network flexibility with symbolic compositionality—for advancing the decoding and interpretation of brain signals. Integrating explicit structure into decoding models uncovers richer, more generalizable neural representations compared to previous generation models, paving the way for more interpretable and effective brain-computer interfaces and cognitive neuroscience tools.

Community Reviews

No reviews yet.