rishikksh20/ceit-pytorch

Implementation of Convolutional enhanced image Transformer

Hi there, I'm Rishikesh, Speech and Computer Vision Researcher👋

Hi friends, I'm Rishikesh, Co-founder and CTO of Dubpro.ai (formely known as DeepSync Technologies). I graduated from NIT Silchar and immediately after my graduation I joined my first organisation, Nucleus Software as Full Stack Developer role. I have a keen interest in machine learning and deep learning research, especially in a field of speech synthesis and computer vision.

• 🔭 I’m currently working on Speech Synthesis and End to End Text to Speech (TTS) engines.
• 🌱 I love to code and contribute to Open Source.
• 💬 Ask me anything regarding my work, code and research here (Please tag me @rishikksh20 in your comment.).
• 📫 How to reach me: [email protected]

Connect with me:

Languages and Tools:

ceit-pytorch's Issues

Training on new datasets.

Are there any instructions to help me train the model on other datasets mentioned in the paper, e.g., Oxford pets?
As I understood, as of now, it is just possible to train on CIFAR10 or CIFAR100.
I would appreciate any clues that point me in the right direction.
Thanks a lot.

Question about parameters Initialization

Hello, I'm appreciate that your work help me a lot. I have a question that dose Transformer model need parameters initialization?

Changing in Image Size Problem

Hi @rishikksh20,

Thank you for your great work. When I give an image 224x224, it works fine. Then, I just changed image 224 to 112x112 and it gives an error. Any advice?

Code

"CeiT": CeiT(
        GPU_ID=GPU_ID,
        image_size=112,
        patch_size=4,
        dim=512,
        depth=20,
        num_classes=NUM_CLASS,
        heads=8,
        dropout=0.1,
        emb_dropout=0.1
        )

Traceback

    raise EinopsError(' Error while computing {!r}\n {}'.format(self, e))
einops.EinopsError:  Error while computing Rearrange('b c (h w) -> b c h w', h=14, w=14)
 Shape mismatch, 49 != 196

Image Size for CIFAR10 and CIFAR100

I wonder why the image size for cifar is 224?

Is this just for convenience?

请问下ReAttention得作用是啥呢

Error while training on CIFAR!!

raise EinopsError('Shape mismatch, {} != {}'.format(length, known_product))
einops.EinopsError: Shape mismatch, 4 != 196