Some useful attention mechanisms are simply implemented on pytoch.
It is mainly used to improve the performance of image recognition and detection, and the amount of calculation is small.
CBAM https://arxiv.org/pdf/1807.06521.pdf
CCNet https://arxiv.org/pdf/1811.11721.pdf
CoordAttention https://arxiv.org/pdf/2103.02907.pdf
DANet https://arxiv.org/abs/1809.02983.pdf
ECANet https://arxiv.org/abs/1910.03151.pdf
EPSANet https://arxiv.org/pdf/2105.14447v1.pdf