#6 · Primary category: Optimization & Heuristic Algorithms

darts

automl convolutional-networks deep-learning image-classification language-modeling neural-architecture-search pytorch recurrent-networks

Differentiable architecture search for convolutional and recurrent networks

Project last updated:01/03/21

GitHub Stars

4.0K

Forks

836

Contributors

3

License

Apache-2.0

Why we included this project

DARTS is the reference implementation of the 2018 neural architecture search paper that turned the search itself into a gradient-descent problem: instead of training and scoring candidate networks one by one, it relaxes discrete architecture choices into continuous weights and optimizes them directly. The whole search stays cheap enough to run on a single GPU. The repo ships pretrained cells you can test right away, a CIFAR-10 and ImageNet convolutional pair plus a recurrent cell for language modeling on Penn Treebank and WikiText-2, with expected error rates and perplexities spelled out in the README. It is research code from 2018 pinned to PyTorch 0.3.1, so treat it as a readable baseline for comparison and a study reference, not something to build production training on.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category