ffengc/marnet-parkinson-severity-diagnosis-explainable-model

The code repository for "Parkinson’s severity diagnosis explainable model based on 3D multi-head attention residual network"

Parkinson’s Severity Diagnosis Explainable Model Based on 3D Multi-Head Attention Residual Network

abstract

The severity evaluation of Parkinson’s disease (PD) is of great significance for the treatment of PD. However, existing methods either have limitations based on prior knowledge or are invasive methods. To propose a more generalized severity evaluation model, this paper proposes an explainable 3D multi-head attention residual convolution network. First, we introduce the 3D attention-based convolution layer to extract video features. Second, features will be fed into LSTM and residual backbone networks, which can be used to capture the contextual information of the video. Finally, we design a feature compression module to condense the learned contextual features. We develop some interpretable experiments to better explain this black-box model so that it can be better generalized. Experiments show that our model can achieve state-of-the-art diagnosis performance. The proposed lightweight but effective model is expected to serve as a suitable end-to-end deep learning baseline in future research on PD video-based severity evaluation and has the potential for large-scale application in PD telemedicine. The source code is available at https://github.com/JackAILab/MARNet.

---

Installation

See INSTALL.md for the installation of dependencies required to run MARNet.

Training and Testing

Training and Testing instructions for MARNet. Here is a summary table containing hyperlinks for easy navigation.

Training Navigation	Testing Navigation
TrainNavigation	TestNavigation

Results

In our experiments, first, we test several different models on the same dataset. Second, we also performed binary classification tests on patients of different periods and compared their results. Third, we conducted a module ablation experiment for MARNet.

Classification Prediction Results (click to expand)

Ablation Experiment Results (click to expand)

Contact

Should you have any question, please contact [email protected]