d-x-y/awesome-autodl

Automated Deep Learning: Neural Architecture Search Is Not the End (a curated list of AutoDL resources and an in-depth analysis)

Hi there 👋

awesome-autodl's Issues

What is the difference between type “-” and type “Other”?

Hi,
I'm new to NAS. And I want to know the difference between type “-” and type “Other”.
Thank you!

ICLR 2019 Paper

Hello,

Here is the link to our ICLR 2019 paper on automatically searching for a compressed architecture with Bayesian optimization: https://openreview.net/forum?id=S1xLN3C9YX . Our code is also available here: https://github.com/Friedrich1006/ESNAC .

Our lab also has a ICLR 2018 paper (https://openreview.net/forum?id=B1hcZZ-AW) that uses reinforcement learning to search for compressed architectures.

Would you please add them to the list? Thanks!

Please add NeurIPS 2019 paper

Towards modular and programmable architecture search
Paper: https://arxiv.org/abs/1909.13404
Code: https://github.com/negrinho/deep_architect

Thank you

New paper adding

Hi,

Here is our new ICCV paper "AutoGAN: Neural Architecture Search for Generative Adversarial Networks"
Paper Link: https://arxiv.org/pdf/1908.03835.pdf
code link: https://github.com/TAMU-VITA/AutoGAN

Thanks!

New paper

Hi, our new paper about nas has accepted by CVPR2019, would you please add it on your list?

Name:
Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search
Link:
https://arxiv.org/abs/1903.03777

Zen-NAS ICCV 2021

Dear D-X-Y,

We have one ICCV 2021 paper about zero-shot Neural Architecture Search:

paper arXiv link: https://arxiv.org/abs/2102.01063

Github: https://github.com/idstcv/ZenNAS

It would so nice of you if you could kindly append this work to the paper list. Thank you very much!

Request to Add THIN-Bayes

Paper: https://www.researchgate.net/profile/Sandeep-Sandha/publication/356911955_Enabling_Hyperparameter_Tuning_of_Machine_Learning_Classifiers_in_Production/links/62171fb21857671d0d8b04f4/Enabling-Hyperparameter-Tuning-of-Machine-Learning-Classifiers-in-Production.pdf

Poster: https://cms.tinyml.org/wp-content/uploads/talks2022/Saha-S.-Sayan-SW-tools.pdf

Code: https://github.com/ARM-software/mango/tree/master/examples/THIN-Bayes

We developed a new state-of-art Bayesian NAS framework. We would be happy if you add it to your list.

The paper "ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware" is a gradient based method.

AutoML survey

There are over 30 citations of this survey.

@article{he2019automl,
  title={AutoML: A Survey of the State-of-the-Art},
  author={He, Xin and Zhao, Kaiyong and Chu, Xiaowen},
  journal={arXiv preprint arXiv:1908.00709},
  year={2019}
}

FBNetv2/v3 not seen in the list

New Paper Adding CVPR 2020

Hi Xuanyi,

Thanks for making this awesome summary list!

Here is our new CVPR 2020 paper "Binarizing MobileNet via Evolution-based Searching"
Paper Link: https://arxiv.org/abs/2005.06305
Type is Evolution Algorithm.

Thanks!

Where is the library of PyGlove?

The Library PyGlove only have a neuralPS paper, not an usable Library, where is the code?

New paper on CVPR 2020

Hi Xuanyi,
Thanks for the awesome paper list for NAS!

Here is our CVPR 2020 paper about NAS based on performance prediction.
Paper Title: A Semi-Supervised Assessor of Neural Architectures
Paper link: https://openaccess.thecvf.com/content_CVPR_2020/papers/Tang_A_Semi-Supervised_Assessor_of_Neural_Architectures_CVPR_2020_paper.pdf

Thanks!

how to run Facebookresearch fixres

I am beginner in DL,i know the basic running models on dataset and getting results but somehow i got assigned to work on using Fixres strategy.Can u provide me some help that how to run this ??am clueless

New Paper Adding

Hi,

Here is our new CVPR 2020 paper "AdversarialNAS: Adversarial Neural Architecture Search for GANs"
Paper Link: https://arxiv.org/pdf/1912.02037.pdf
Code link: https://github.com/chengaopro/AdversarialNAS
Type is gradient-based.

Thx!

ICLR 2020 Paper

Hi Xuanyi,
We have a NAS related paper in ICLR 2020, 'Fast Neural Network Adaptation via Parameter Remapping and Architecture Search'.
Paper: https://openreview.net/forum?id=rklTmyBKPH
Code: https://github.com/JaminFong/FNA
We wonder if it is OK to add this paper. Thank you!

Please add ICLR 2020 paper

paper: https://openreview.net/forum?id=BylQSxHFwr
code: https://github.com/meijieru/AtomNAS
Thanks.

Add new papers

Hi,

Would you please add our recent paper on NAS to the list? The title is Neural Architecture Optimization , which is accepted at NIPS this year. Maybe it can be categorized into the gradient based method. Thanks.

Best