Giter Site home page Giter Site logo

alphaqi / isda-for-deep-networks Goto Github PK

View Code? Open in Web Editor NEW

This project forked from blackfeather-wang/isda-for-deep-networks

0.0 1.0 0.0 51.03 MB

An efficient implicit semantic augmentation method, complementary to existing non-semantic techniques.

Python 92.42% Shell 0.34% Cuda 3.83% C 0.81% C++ 2.60%

isda-for-deep-networks's Introduction

ISDA-Pytorch

The Implicit Semantic Data Augmentation (ISDA) algorithm implemented in Pytorch.

Update on 2021/01/17: Journal Version of ISDA is Accepted by T-PAMI!

Update on 2020/04/25: Release Pre-trained Models on ImageNet.

Update on 2020/04/24: Release Code for Image Classification on ImageNet and Semantic Segmentation on Cityscapes.

Introduction

We propose a novel implicit semantic data augmentation (ISDA) approach to complement traditional augmentation techniques like flipping, translation or rotation. ISDA consistently improves the generalization performance of popular deep networks on supervised & semi-supervised image classification, semantic segmentation, object detection and instance segmentation.

Citation

If you find this work valuable or use our code in your own research, please consider citing us with the following bibtex:

@inproceedings{NIPS2019_9426,
        title = {Implicit Semantic Data Augmentation for Deep Networks},
       author = {Wang, Yulin and Pan, Xuran and Song, Shiji and Zhang, Hong and Huang, Gao and Wu, Cheng},
    booktitle = {Advances in Neural Information Processing Systems (NeurIPS)},
        pages = {12635--12644},
         year = {2019},
}

@article{wang2021regularizing,
        title = {Regularizing deep networks with semantic data augmentation},
       author = {Wang, Yulin and Huang, Gao and Song, Shiji and Pan, Xuran and Xia, Yitong and Wu, Cheng},
      journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
         year = {2021}
}

Get Started

Please go to the folder Image classification on CIFAR, Image classification on ImageNet and Semantic segmentation on Cityscapes for specific docs.

Pre-trained Models on ImageNet

  • Measured by Top-1 error.
Model Params Baseline ISDA Model
ResNet-50 25.6M 23.0 21.9 Tsinghua Cloud / Google Drive
ResNet-101 44.6M 21.7 20.8 Tsinghua Cloud / Google Drive
ResNet-152 60.3M 21.3 20.3 Tsinghua Cloud / Google Drive
DenseNet-BC-121 8.0M 23.7 23.2 Tsinghua Cloud / Google Drive
DenseNet-BC-265 33.3M 21.9 21.2 Tsinghua Cloud / Google Drive
ResNeXt50, 32x4d 25.0M 22.5 21.3 Tsinghua Cloud / Google Drive
ResNeXt101, 32x8d 88.8M 21.1 20.1 Tsinghua Cloud / Google Drive

Visualization of Augmented Samples

  • ImageNet

Results

  • Supervised image classification on ImageNet

  • Complementing traditional data augmentation techniques

  • Semi-supervised image classification on CIFAR & SVHN

  • Semantic segmentation on Cityscapes

  • Object detection on MS COCO

  • Instance segmentation on MS COCO

Acknowledgment

Our code for semantic segmentation is mainly based on pytorch-segmentation-toolbox.

To Do

Update code for semi-supervised learning.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.