Abstract
In the neural science society, multi-subject brain decoding is of great interest. However, due to the variability of activation patterns across brains, it is difficult to build an effective decoder using fMRI samples pooled from different subjects. In this paper, a hierarchical model is proposed to extract robust features for decoding. With feature selection for each subject treated as a separate task, a novel multi-task feature selection method is introduced. This method utilizes both complementary information among subjects and local correlation between brain areas within a subject. Finally, using fMRI samples pooled from all subjects, a linear support vector machine (SVM) classifier is trained to predict 2-D stimuli-related images or 3-D stimuli-related images. The experimental results demonstrated the effectiveness of the proposed method.