Logo
v1.6

Table of Contents

  • Overview
  • Installation
  • QuickStart
  • Auto (Hyper-parameter) Tuning
  • Neural Architecture Search
    • Overview
    • Quick Start
    • Tutorial
    • ENAS
    • DARTS
    • P-DARTS
    • SPOS
    • CDARTS
    • ProxylessNAS
    • TextNAS
    • Customize a NAS Algorithm
    • NAS Visualization
    • API Reference
  • Model Compression
  • Feature Engineering
  • References
  • Community Sharings
  • FAQ
  • How to Contribution
  • Changelog
NNI
  • Docs »
  • Neural Architecture Search
  • Edit on GitHub

Neural Architecture SearchΒΆ

Automatic neural architecture search is taking an increasingly important role on finding better models. Recent research works have proved the feasibility of automatic NAS, and also found some models that could beat manually tuned models. Some of representative works are NASNet, ENAS, DARTS, Network Morphism, and Evolution. Moreover, new innovations keep emerging.

However, it takes great efforts to implement NAS algorithms, and it is hard to reuse code base of existing algorithms in a new one. To facilitate NAS innovations (e.g., design and implement new NAS models, compare different NAS models side-by-side), an easy-to-use and flexible programming interface is crucial.

Therefore, we provide a unified interface for NAS, to accelerate innovations on NAS, and apply state-of-art algorithms on real world problems faster. For details, please refer to the following tutorials:

  • Overview
    • Supported One-shot NAS Algorithms
    • Supported Distributed NAS Algorithms
    • Using the NNI API
    • NAS Visualization
    • Reference and Feedback
  • Quick Start
    • Write your model with NAS APIs
    • Choose a NAS trainer
    • Export the best model
    • NAS visualization
    • Retrain the exported best model
  • Tutorial
    • Implement a Search Space
    • Use a Search Algorithm
  • ENAS
    • Introduction
    • Examples
    • Reference
  • DARTS
    • Introduction
    • Reproduction Results
    • Examples
    • Reference
    • Limitations
  • P-DARTS
    • Examples
  • SPOS
    • Introduction
    • Examples
    • Reference
    • Known Limitations
    • Current Reproduction Results
  • CDARTS
    • Introduction
    • Reproduction Results
    • Examples
    • Reference
  • ProxylessNAS
    • Introduction
    • Usage
    • Implementation
    • Reproduce Results
  • TextNAS
    • Introduction
    • Preparation
    • Examples
    • Reference
  • Customize a NAS Algorithm
    • Extend the Ability of One-Shot Trainers
    • Implement New Mutators
    • Implemented a Distributed NAS Tuner
  • NAS Visualization
    • Built-in Trainers Support
    • Visualize a Customized Trainer
    • NAS UI Preview
    • Limitations
    • Feedback
  • API Reference
    • Mutables
    • Mutators
    • Trainers
Next Previous

© Copyright 2020, Microsoft Revision b039773f.

Built with Sphinx using a theme provided by Read the Docs.