shawnyuen/medical_vision_transformer_paper_collection

medical_vision_transformer_paper_collection

Survey

A Data-scalable Transformer for Medical Image Segmentation - Architecture - Model Efficiency - and Benchmark arXiv 2022 [paper]

""

Advances in Medical Image Analysis with Vision Transformers - A Comprehensive Review arXiv 2023 [paper]

Transformers in Medical Image Analysis - A Review IM 2023 [paper] [paper]

""

Transformers in Medical Imaging - A Survey MedIA 2023 [arXiv paper] [paper]

""

Transforming Medical Imaging with Transformers - A Comparative Review of Key Properties - Current Progresses - and Future Perspectives MedIA 2023 [paper]

""

Vision Transformers in Medical Computer Vision -- A Contemplative Retrospection arXiv 2022

2023

3D UX-Net - A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation ICLR 2023 [paper]

"pseudo transformer"

A Permutable Hybrid Network for Volumetric Medical Image Segmentation MICCAI 2023 [paper]

""

A Transformer-based Representation-learning Model with Unified Processing of Multimodal Input for Clinical Diagnostics NBME 2023

Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network arXiv 2023

CCT-Unet - A U-shaped Network based on Convolution Coupled Transformer for Segmentation of Peripheral and Transition Zones in Prostate MRI IEEE JBHI 2023 [paper]

""

CiT-Net - Convolutional Neural Networks Hand in Hand with Vision Transformers for Medical Image Segmentation arXiv 2023

Deformable Cross-Attention Transformer for Medical Image Registration arXiv 2023 [paper]

""

EPT-Net - Edge Perception Transformer for 3D Medical Image Segmentation IEEE TMI 2023

FCB-SwinV2 Transformer for Polyp Segmentation arXiv 2023

Few Shot Medical Image Segmentation with Cross Attention Transformer arXiv 2023

Global Adaptive Transformer for Cross-Subject Enhanced EEG Classification IEEE TNNLS 2023

H2Former - An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation arXiv 2023

HiFormer - Hierarchical Multi-Scale Representations Using Transformers for Medical Image Segmentation IEEE WACV 2023

HST-MRF - Heterogeneous Swin Transformer with Multi-Receptive Field for Medical Image Segmentation arXiv 2023

MedSegDiff-V2 - Diffusion based Medical Image Segmentation with Transformer arXiv 2023

MedViT A Robust Vision Transformer for Generalized Medical Image Classification arXiv 2023

MS-DINO Efficient Distributed Training of Vision Transformer Foundation Model in Medical Domain through Masked Sampling arXiv 2023

Multi-scale Hierarchical Vision Transformer with Cascaded Attention Decoding for Medical Image Segmentation MIDL 2023

TEC-Net - Vision Transformer Embrace Convolutional Neural Networks for Medical Image Segmentation arXiv 2023

Token Sparsification for Faster Medical Image Segmentation IPMI 2023 [paper] [code]

""

Spatially-varying Regularization with Conditional Transformer for Unsupervised Image Registration arXiv 2023 [paper]

""

MedNeXt - Transformer-driven Scaling of ConvNets for Medical Image Segmentation MICCAI 2023 [paper]

"pseudo transformer"

SwinCross - Cross-modal Swin Transformer for Head-and-Neck Tumor Segmentation in PET-CT Images arXiv 2023

SwinMM - Masked Multi-view with Swin Transformers for 3D Medical Image Segmentation MICCAI 2023 [code]

""

ViT-AE++ - Improving Vision Transformer Autoencoder for Self-supervised Medical Image Representations MIDL 2023 [paper] [code]

"ViT-AE is MAE", "structural information",

2022

3D CVT-GAN - A 3D Convolutional Vision Transformer-GAN for PET Reconstruction MICCAI 2022 [paper]

3D Shuffle-Mixer - An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume arXiv 2022 [paper]

""

(VT-UNet) A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation MICCAI 2022 [paper] [code]

Accurate and Robust Lesion RECIST Diameter Prediction and Segmentation with Transformers arXiv 2022

Affine Medical Image Registration With Coarse-To-Fine Vision Transformer CVPR 2022 [paper] [arXiv paper] [code]

""

AFTer-UNet - Axial Fusion Transformer UNet for Medical Image Segmentation IEEE WACV 2022

APAUNet - Axis Projection Attention UNet for Small Target in 3D Medical Segmentation ACCV 2022

C2FTrans - Coarse-to-Fine Transformers for Medical Image Segmentation arXiv 2022 [paper]

""

CATS - Complementary CNN and Transformer Encoders for Segmentation arXiv 2022

ConvFormer - Combining CNN and Transformer for Medical Image Segmentation arXiv 2022

ConvTransSeg - A Multi-resolution Convolution-Transformer Network for Medical Image Segmentation arXiv 2022

COTR - Convolution in Transformer Network for End to End Polyp Detection arXiv 2022

CTformer - Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising arXiv 2022

Deformer - Towards Displacement Field Learning for Unsupervised Medical Image Registration MICCAI 2022

""

DuAT - Dual-Aggregation Transformer Network for Medical Image Segmentation arXiv 2022

Edge-Oriented Point-Cloud Transformer for 3D Intracranial Aneurysm Segmentation MICCAI 2022 [paper]

FocalUNETR - A Focal Transformer for Boundary-aware Segmentation of CT Images arXiv 2022 [paper]

""

HiFormer - Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation arXiv 2022

High-Resolution Swin Transformer for Automatic Medical Image Segmentation arXiv 2022

Hybrid Window Attention Based Transformer Architecture for Brain Tumor Segmentation arXiv 2022

Lymph Node Detection in T2 MRI with Transformers SPIE 2022

M3NAS - Multi-Scale and Multi-Level Memory-Efficient Neural Architecture Search for Low-Dose CT Denoising IEEE TMI 2022

Memory Transformers for Full Context and High-resolution 3D Medical Segmentation arXiv 2022

mmFormer - Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation MICCAI 2022

NestedFormer Nested Modality-Aware Transformer for Brain Tumor Segmentation MICCAI 2022 [paper] [code]

Parameter-Efficient Transformer with Hybrid Axial-Attention for Medical Image Segmentation arXiv 2022

PHTrans Parallelly Aggregating Global and Local Representations for Medical Image Segmentation arXiv 2022 [paper]

RTNet - Relation Transformer Network for Diabetic Retinopathy Multi-Lesion Segmentation IEEE TMI 2022

ScaleFormer - Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentation IJCAI 2022

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis CVPR 2022 [arXiv paper]

SUNet - Swin Transformer UNet for Image Denoising arXiv 2022

Swin UNETR - Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images arXiv 2022 [paper]

SwinBTS - A Method for 3D Multimodal Brain Tumor Segmentation Using Swin Transformer BS 2022 [paper]

""

SWTRU - Star-shaped Window Transformer Reinforced U-Net for Medical Image Segmentation CBM 2022

TFCNs - A CNN-Transformer Hybrid Network for Medical Image Segmentation ICANN 2022

The Lighter The Better - Rethinking Transformers in Medical Image Segmentation Through Adaptive Pruning arXiv 2022 [paper]

""

Toward Foundational Deep Learning Models for Medical Imaging in the New Era of Transformer Networks Radiology AI 2022

Transformer Based Feature Fusion for Left Ventricle Segmentation in 4D Flow MRI MICCAI 2022 [paper]

Transformer-based Annotation Bias-aware Medical Image Segmentation arXiv 2022

UNETR - Transformers for 3D Medical Image Segmentation IEEE WACV 2022 [arXiv paper] [WACV paper]

""

UNETR++ - Delving into Efficient and Accurate 3D Medical Image Segmentation arXiv 2022 [paper] [code]

UNesT Local Spatial Representation Learning with Hierarchical Transformer for Efficient Medical Segmentation arXiv 2022

Using Multi-scale SwinTransformer-HTC with Data augmentation in CoNIC Challenge arXiv 2022

XMorpher - Full Transformer for Deformable Medical Image Registration via Cross Attention MICCAI 2022 [arXiv paper] [paper] [code]

""

2021

TransUNet - Transformers Make Strong Encoders for Medical Image Segmentation arXiv 2021 [paper]

""

3D Medical Point Transformer Introducing Convolution to Attention Networks for Medical Point Cloud Analysis arXiv 2021 [paper]

""

3D Transformer-GAN for High-Quality PET Reconstruction MICCAI 2021 [paper]

""

3DMeT - 3D Medical Image Transformer for Knee Cartilage Defect Assessment MLMI 2021 [paper]

""

A Multi-branch Hybrid Transformer Network for Corneal Endothelial Cell Segmentation MICCAI 2021 [paper]

""

Accelerated Multi-Modal MR Imaging with Transformers arXiv 2021 [paper]

""

Anatomy-Guided Parallel Bottleneck Transformer Network for Automated Evaluation of Root Canal Therapy arXiv 2021 [paper]

""

Attention-Based Transformers for Instance Segmentation of Cells in Microstructures IEEE BIBM 2020 [paper]

BiTr-Unet a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation [paper]

Boundary-Aware Transformers for Skin Lesion Segmentation MICCAI 2021 [paper]

""

Combining CNNs with Transformer for Multimodal 3D MRI Brain Tumor Segmentation with Self-Supervised Pretraining arXiv 2021 [paper]

""

Convolution-Free Medical Image Segmentation Using Transformers arXiv 2021 [paper]

""

Lesion-Aware Transformers for Diabetic Retinopathy Grading CVPR 2021 [paper]

""

Lymph Node Detection in T2 MRI with Transformers arXiv 2021 [paper]

CoTr - Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation arXiv 2021 [paper]

""

CyTran - Cycle-Consistent Transformers for Non-Contrast to Contrast CT Translation arXiv 2021 [paper]

""

D-Former A U-shaped Dilated Transformer for 3D Medical Image Segmentation arXiv 2022 [paper]

Deep MRI Reconstruction with Generative Vision Transformers MLMIR 2021 [paper]

""

DS-TransUNet - Dual Swin Transformer U-Net for Medical Image Segmentation arXiv 2021 [paper]

""

DuDoTrans Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction arXiv 2021 [paper]

Effective Pancreatic Cancer Screening on Non-contrast CT Scans via Anatomy-aware Transformers MICCAI 2021 [paper]

""

Evaluating Transformer-based Semantic Segmentation Networks for Pathological Image Segmentation arXiv 2021 [paper]

Few-Shot Domain Adaptation with Polymorphic Transformers MICCAI 2021 [paper]

""

Focal Self-attention for Local-Global Interactions in Vision Transformers arXiv 2021

GasHis-Transformer - A Multi-scale Visual Transformer Approach for Gastric Histopathology Image Classification arXiv 2021 [paper]

""

GT U-Net - A U-Net Like Group Transformer Network for Tooth Root Segmentation MLMI 2021 [paper]

""

Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention [paper]

Is it Time to Replace CNNs with Transformers for Medical Images arXiv 2021 [paper]

""

Learning Dual Transformer Network for Diffeomorphic Registration MICCAI 2021 [paper]

""

LeViT-UNet - Make Faster Encoders with Transformer for Medical Image Segmentation arXiv 2021 [paper]

""

Lesion-Aware Transformers for Diabetic Retinopathy Grading CVPR 2021 [paper]

Medical Image Segmentation Using Squeeze-and-Expansion Transformers IJCAI 2021 [paper]

""

Medical Transformer Gated Axial-Attention for Medical Image Segmentation MICCAI 2021 [paper]

""

Medical Transformer Universal Brain Encoder for 3D MRI Analysis arXiv 2021 [paper]

""

MIL-VT Multiple Instance Learning Enhanced Vision Transformer for Fundus Image Classification MICCAI 2021 [paper]

""

MISSFormer An Effective Medical Image Segmentation Transformer arXiv 2021 [paper]

Mixed Transformer U-Net For Medical Image Segmentation arXiv 2021 [paper]

""

More than Encoder Introducing Transformer Decoder to Upsample arXiv 2021 [paper]

MSHT Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer [paper]

MT-TransUNet - Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classification arXiv 2021

Multi-Compound Transformer for Accurate Biomedical Image Segmentation MICCAI 2021 [paper]

""

Multi-view Analysis of Unregistered Medical Images Using Cross-View Transformers MICCAI 2021 [paper] [code]

""

Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images ICCV 2021

nnFormer - Interleaved Transformer for Volumetric Segmentation arXiv 2021 [paper]

Polyp-PVT - Polyp Segmentation with Pyramid Vision Transformers arXiv 2021 [paper]

""

Pyramid Medical Transformer for Medical Image Segmentation arXiv 2021 [paper]

""

RATCHET Medical Transformer for Chest X-ray Diagnosis and Reporting arXiv 2021 [paper]

""

Region Aware Transformer for Automatic Breast Ultrasound Tumor Segmentation MIDL 2022 [paper]

ResViT - Residual Vision Transformers for Multi-modal Medical Image Synthesis arXiv 2021 [paper]

""

Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer arXiv 2021 [paper]

SpecTr - Spectral Transformer for Hyperspectral Pathology Image Segmentation arXiv 2021 [paper]

Spine-Transformers Vertebra Detection and Localization in Arbitrary Field-of-View Spine CT with Transformers MICCAI 2021 [paper]

""

Swin-Unet - Unet-like Pure Transformer for Medical Image Segmentation arXiv 2021 [paper]

""

T-AutoML - Automated Machine Learning for Lesion Segmentation Using Transformers in 3D Medical Imaging ICCV 2021

Task Transformer Network for Joint MRI Reconstruction and Super-Resolution MICCAI 2021 [paper] [code]

""

TED-Net - Convolution-Free T2T Vision Transformer-Based Encoder-Decoder Dilation Network for Low-Dose CT Denoising MLMI 2021 [paper]

""

TransAttUnet - Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation arXiv 2021 [paper]

""

TransBridge - A Lightweight Transformer for Left Ventricle Segmentation in Echocardiography ASMUS 2021 [paper]

""

TransBTS - Multimodal Brain Tumor Segmentation Using Transformer MICCAI 2021 [MICCAI paper]

TransClaw - U-Net Claw U-Net with Transformers for Medical Image Segmentation arXiv 2021 [paper]

TransCT - Dual-path Transformer for Low Dose Computed Tomography arXiv 2021 [paper]

""

TransDIR - Deformable Imaging Registration Network Based on Transformer to Improve the Feature Extraction Ability MP 2021 [paper]

Transformer Network for Significant Stenosis Detection in CCTA of Coronary Arteries MICCAI 2021 [paper] [arXiv paper] [code]

""

TransFuse - Fusing Transformers and CNNs for Medical Image Segmentation arXiv 2021 [paper]

""

TransMed - Transformers Advance Multi-Modal Medical Image Classification Diagnostics 2021 [paper]

""

TransMIL - Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classication arXiv 2021 [paper]

""

TransMorph - Transformer for Unsupervised Medical Image Registration arXiv 2021 [arXiv paper] [paper]

""

TransPath - Transformer-Based Self-supervised Learning for Histopathological Image Classification MICCAI 2021 [paper]

""

U-Net Transformer - Self and Cross Attention for Medical Image Segmentation MLMI 2021 [paper]

""

UCTransNet - Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer AAAI 2022 [paper] [code]

""

Ultrasound Video Transformers for Cardiac Ejection Fraction Estimation MICCAI 2021 [paper] [code]

""

UTNet - A Hybrid Transformer Architecture for Medical Image Segmentation MICCAI 2021 [paper]

Vision Transformer-based Recognition of Diabetic Retinopathy Grade MP 2021 [paper]

""

ViT-V-Net - Vision Transformer for Unsupervised Volumetric Medical Image Registration MIDL 2021 [paper] [arXiv paper] [code]

""