Shuffle Attention for MobileNetV3
Run the following command for train model on your own dataset:
python train.py --dataset mnist
Run the following command for evaluation trained model on test dataset:
python test.py --dataset mnist
Run the following command for classification images:
python inference.py --input /path/to/image.jpg
Deformable Attention Implementation of Deformable Attention from this paper in Pytorch, which appears to be an improvement to what was proposed in DET
Adjacent Attention Network An implementation of a simple transformer that is equivalent to graph neural network where the message passing is done with
Lie Transformer - Pytorch (wip) Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch. Only the SE3 version will be present in thi
SE3 Transformer - Pytorch Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. May be needed for replicating Alphafold2 resu
FcaNet: Frequency Channel Attention Networks PyTorch implementation of the paper "FcaNet: Frequency Channel Attention Networks". Simplest usage Models
LieTransformer This repository contains the implementation of the LieTransformer used for experiments in the paper LieTransformer: Equivariant self-at
Tab Transformer Implementation of Tab Transformer, attention network for tabular data, in Pytorch. This simple architecture came within a hair's bread
PyTorch实现多种计算机视觉中网络设计中用到的Attention机制，还收集了一些即插即用模块。由于能力有限精力有限，可能很多模块并没有包括进来，有任何的建议或者改进，可以提交issue或者进行PR。
Self-attention building blocks for computer vision applications in PyTorch Implementation of self attention mechanisms for computer vision in PyTorch
I appreciate your effort of making these experiment results and sharing code. I am quite interesting in the experiment on ImageNet. I try but cannot produce your result.
My training strategy is based on this repo(https://github.com/PaddlePaddle/PaddleClas/blob/release/2.5/ppcls/configs/ImageNet/MobileNetV3/MobileNetV3_large_x1_0.yaml), which can obtain 75.2% of MobileNetv3-large. I just use the same strategy to train sa-MobileNetv3.
I am looking forward to your rely.
Best wishes!
SA-Net: Shuffle Attention for Deep Convolutional Neural Networks (paper) By Qing-Long Zhang and Yu-Bin Yang [State Key Laboratory for Novel Software T
Transformer in Transformer Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image c
HaloNet - Pytorch Implementation of the Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones. This re
STAM - Pytorch Implementation of STAM (Space Time Attention Model), yet another pure and simple SOTA attention model that bests all previous models in
Under construction... Attention in Attention Network for Image Super-Resolution (A2N) This repository is an PyTorch implementation of the paper "Atten
Attention-driven Robotic Manipulation (ARM) This codebase is home to: Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulation I
LESA Introduction This repository contains the official implementation of Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Cont
Relational Self-Attention: What's Missing in Attention for Video Understanding This repository is the official implementation of "Relational Self-Atte
Memory Efficient Attention Pytorch Implementation of a memory efficient multi-head attention as proposed in the paper, Self-attention Does Not Need O(
cosFormer Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention Update log 2022/2/28 Add core code License This
128 Dec 24, 2022
327 Dec 27, 2022
35 Oct 18, 2022
599 Dec 23, 2022
962 Dec 23, 2022
199 Jan 8, 2023
272 Dec 23, 2022
71 Dec 30, 2022
84 Dec 29, 2022
20 Dec 31, 2021
43 Dec 7, 2022
120 Dec 15, 2022