v1.9

Table of Contents

  • Overview
  • Installation
  • QuickStart
  • Auto (Hyper-parameter) Tuning
  • Neural Architecture Search
    • Overview
    • Write A Search Space
    • Classic NAS
    • One-shot NAS
    • Customize a NAS Algorithm
    • NAS Visualization
    • Search Space Zoo
    • NAS Benchmarks
    • API Reference
  • Model Compression
  • Feature Engineering
  • References
  • Use Cases and Solutions
  • FAQ
  • How to Contribute
  • ChangeLog
  • Release 1.9 - 10/22/2020
  • Release 1.8 - 8/27/2020
  • Release 1.7 - 7/8/2020
NNI
  • Docs »
  • Neural Architecture Search
  • Edit on GitHub

Neural Architecture SearchΒΆ

Automatic neural architecture search is taking an increasingly important role on finding better models. Recent research works have proved the feasibility of automatic NAS, and also found some models that could beat manually tuned models. Some of representative works are NASNet, ENAS, DARTS, Network Morphism, and Evolution. Moreover, new innovations keep emerging.

However, it takes great efforts to implement NAS algorithms, and it is hard to reuse code base of existing algorithms in a new one. To facilitate NAS innovations (e.g., design and implement new NAS models, compare different NAS models side-by-side), an easy-to-use and flexible programming interface is crucial.

Therefore, we provide a unified interface for NAS, to accelerate innovations on NAS, and apply state-of-art algorithms on real world problems faster. For details, please refer to the following tutorials:

  • Overview
    • Overview
    • Supported Classic NAS Algorithms
    • Supported One-shot NAS Algorithms
    • Search Space Zoo
    • Using NNI API to Write Your Search Space
    • NAS Visualization
    • Reference and Feedback
  • Write A Search Space
  • Classic NAS
    • Quick Start
    • Standalone mode for easy debugging
    • Regularized Evolution Tuner
  • One-shot NAS
    • Quick Start
    • ENAS
    • DARTS
    • P-DARTS
    • SPOS
    • CDARTS
    • ProxylessNAS
    • TextNAS
  • Customize a NAS Algorithm
    • Extend the Ability of One-Shot Trainers
    • Implement New Mutators
    • Implemented a Distributed NAS Tuner
  • NAS Visualization
    • Built-in Trainers Support
    • Visualize a Customized Trainer
    • NAS UI Preview
    • Limitations
    • Feedback
  • Search Space Zoo
    • DartsCell
    • ENASMicroLayer
    • ENASMacroLayer
    • NAS-Bench-201
  • NAS Benchmarks
    • Introduction
    • Prerequisites
    • Data Preparation
    • Example Usages
    • NAS-Bench-101
    • NAS-Bench-201
    • NDS
    • Available Operators
  • API Reference
    • Mutables
    • Mutators
    • Trainers
Next Previous

© Copyright 2020, Microsoft Revision 98a72a1e.

Built with Sphinx using a theme provided by Read the Docs.