Exploring Brain Effective Connectivity in Visual Perception Using a Hierarchical Correlation Network - Artificial Intelligence Applications and Innovations Access content directly
Conference Papers Year : 2019

Exploring Brain Effective Connectivity in Visual Perception Using a Hierarchical Correlation Network

Siyu Yu
  • Function : Author
  • PersonId : 1056838
Nanning Zheng
  • Function : Author
  • PersonId : 1033459
Hao Wu
  • Function : Author
  • PersonId : 1056839
Ming Du
  • Function : Author
  • PersonId : 1056840
Badong Chen
  • Function : Author
  • PersonId : 1056841

Abstract

Brain-inspired computing is a research hotspot in artificial intelligence (AI). One of the key problems in this field is how to find the bridge between brain connectivity and data correlation in a connection-to-cognition model. Functional magnetic resonance imaging (fMRI) signals provide rich information about brain activities. Existing modeling approaches with fMRI focus on the strength information, but neglect structural information. In a previous work, we proposed a monolayer correlation network (CorrNet) to model the structural connectivity. In this paper, we extend the monolayer CorrNet to a hierarchical correlation network (HcorrNet) by analysing visual stimuli of natural images and fMRI signals in the entire visual cortex, that is, V1, V2 V3, V4, fusiform face area (FFA), the lateral occipital complex (LOC) and parahippocampal place area (PPA). Through the HcorrNet, the efficient connectivity of the brain can be inferred layer by layer. Then, the stimulus-sensitive activity mode of voxels can be extracted, and the forward encoding process of visual perception can be modeled. Both of them can guide the decoding process of fMRI signals, including classification and image reconstruction. In the experiments, we improved a dynamic evolving spike neuron network (SNN) as the classifier, and used Generative Adversarial Networks (GANs) to reconstruct image.
Fichier principal
Vignette du fichier
483292_1_En_18_Chapter.pdf (2.1 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02331335 , version 1 (24-10-2019)

Licence

Attribution

Identifiers

Cite

Siyu Yu, Nanning Zheng, Hao Wu, Ming Du, Badong Chen. Exploring Brain Effective Connectivity in Visual Perception Using a Hierarchical Correlation Network. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Hersonissos, Greece. pp.223-235, ⟨10.1007/978-3-030-19823-7_18⟩. ⟨hal-02331335⟩
64 View
25 Download

Altmetric

Share

Gmail Facebook X LinkedIn More