Skip to content

This is the PyTorch implementation of the FBMSNet architecture for EEG-MI classification.

Notifications You must be signed in to change notification settings

sushantbio/FBMSNet

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FBMSNet

FBMSNet: A Filter-Bank Multi-Scale Convolutional Neural Network for EEG-Based Motor Imagery Decoding

This is the PyTorch implementation of the FBMSNet architecture for EEG-MI classification.

FBMSNet: Architecture

FBMSNet

FBMSNet consists of four blocks, (1) a temporal convolution block, (2) a spatial convolution block, (3) a temporal log-variance block, and (4) a fully connected layer for classification. The first block is designed to learn the multiscale temporal information from the multiview EEG representations, and the second block aims to learn the spatial information from each temporal feature map. Subsequently, the third block computes the temporal variance of each time series. Finally, all representations are flattened and fed to the fully connected layer with softmax as the activation function. An overview of FBMSNet is depicted in Fig. 1.

Furthermore, to distinguish similar categories in a better way and decrease the influence of interclass dispersion and within-class variance, we not only minimize the cross entropy (CE) loss function but also introduce the center loss function. With this joint supervision, FBMSNet is capable of learning deep features with two key learning objectives as much as possible, interclass separability and intraclass compactness as much as possible, which are crucial to MI recognition

How to use

If you want to reproduce the experimental results reported in the paper, make sure you use the same runtime environment.

The package requirements to run all the codes are provided in file env.txt. The complete instructions for utilising this toolbox are provided in instructions.txt.

All the codes have been tested to work using a virtual environment mentioned in the env.txt file.

  1. Create a new virtual environment named "env_fbmsnet" with python3.7 using Anaconda3 and activate it:

    conda create --name env_fbmsnet python=3.7
    conda activate env_fbmsnet
    
  2. Install virtualenv package:

    conda install -c anaconda ujson=1.35
    pip install -U scikit-learn
    pip install pandas -i
    pip install matplotlib
    pip install torchsummary
    pip install resampy
    pip install seaborn
    pip install pygame
    pip install selenium
    
  3. Change the current working path to the path where you have stored env.txt. Install required packages.

    E: // Change the current working path
    pip install -r env.txt
    
  4. Download the offline installation files for torch and torchvision from the following link: https://download.pytorch.org/whl/torch_stable.html, Use the "Ctrl + F" command to search for the installation files of the specified version of torch and torchvision and download it. It is recommended to store them under the same path as env.txt.

    torch version : torch-1.3.1-cp37-cp37m-win_amd64

    torchvision version : torchvision-0.4.2-cp37-cp37m-win_amd64

  5. When you have finished downloading, use the pip command to install them.

    pip install torch-1.3.1-cp37-cp37m-win_amd64.whl
    pip install torchvision-0.4.2-cp37-cp37m-win_amd64.whl
    

Congratulations, you have completed all the steps to create the virtual environment needed to run the source code!

FBMSNet: Results

The classification results for FBMSNet and other competing architectures are as follows:

results

Cite:

If you find this architecture or toolbox useful then please cite this paper:

Liu, Ke and Yang, Mingzhao and Yu, Zhuliang and Wang, Guoyin and Wu, Wei. FBMSNet: A Filter-Bank Multi-Scale Convolutional Neural Network for EEG-Based Motor Imagery Decoding. IEEE Transactions on Biomedical Engineering, 70(2):436–445, 2023. https://ieeexplore.ieee.org/document/9837422

References:

Ravikiran Mane, Effie Chew, Karen Chua, Kai Keng Ang, Neethu Robinson, A.P. Vinod, Seong-Whan Lee, and Cuntai Guan, "FBCNet: An Efficient Multi-view Convolutional Neural Network for Brain-Computer Interface," arXiv preprint arXiv:2104.01233 (2021) https://arxiv.org/abs/2104.01233

Acknowledgment

We thank Ravikiran Mane et al. for their useful toolbox.

About

This is the PyTorch implementation of the FBMSNet architecture for EEG-MI classification.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%