Diverse Task Classification from Activation Patterns of Functional Neuro-Images Using Feature Fusion Module
Küçük Resim Yok
Tarih
2023
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
MDPI
Erişim Hakkı
info:eu-repo/semantics/openAccess
Özet
One of the emerging fields in functional magnetic resonance imaging (fMRI) is the decoding of different stimulations. The underlying idea is to reveal the hidden representative signal patterns of various fMRI tasks for achieving high task-classification performance. Unfortunately, when multiple tasks are processed, performance remains limited due to several challenges, which are rarely addressed since the majority of the state-of-the-art studies cover a single neuronal activity task. Accordingly, the first contribution of this study is the collection and release of a rigorously acquired dataset, which contains cognitive, behavioral, and affective fMRI tasks together with resting state. After a comprehensive analysis of the pitfalls of existing systems on this new dataset, we propose an automatic multitask classification (MTC) strategy using a feature fusion module (FFM). FFM aims to create a unique signature for each task by combining deep features with time-frequency representations. We show that FFM creates a feature space that is superior for representing task characteristics compared to their individual use. Finally, for MTC, we test a diverse set of deep-models and analyze their complementarity. Our results reveal higher classification accuracy compared to benchmarks. Both the dataset and the code are accessible to researchers for further developments.
Açıklama
Anahtar Kelimeler
DWT, emotion, feature fusion, fMRI, LSTM, memory, multitask, ResNet, resting fMRI, task classification, Brain Activity, Representations, Connectivity
Kaynak
Sensors
WoS Q Değeri
Q2
Scopus Q Değeri
Q1
Cilt
23
Sayı
7
