v1.7

Table of Contents

  • Overview
  • Installation
  • QuickStart
  • Auto (Hyper-parameter) Tuning
  • Neural Architecture Search
    • Overview
    • Write A Search Space
    • Classic NAS
    • One-shot NAS
    • Customize a NAS Algorithm
    • NAS Visualization
    • NAS Benchmarks
    • API Reference
  • Model Compression
  • Feature Engineering
  • References
  • Community Sharings
  • FAQ
  • How to Contribution
  • ChangeLog
  • Release 1.7 - 7/8/2020
NNI
  • Docs »
  • Neural Architecture Search
  • Edit on GitHub

Neural Architecture SearchΒΆ

Automatic neural architecture search is taking an increasingly important role on finding better models. Recent research works have proved the feasibility of automatic NAS, and also found some models that could beat manually tuned models. Some of representative works are NASNet, ENAS, DARTS, Network Morphism, and Evolution. Moreover, new innovations keep emerging.

However, it takes great efforts to implement NAS algorithms, and it is hard to reuse code base of existing algorithms in a new one. To facilitate NAS innovations (e.g., design and implement new NAS models, compare different NAS models side-by-side), an easy-to-use and flexible programming interface is crucial.

Therefore, we provide a unified interface for NAS, to accelerate innovations on NAS, and apply state-of-art algorithms on real world problems faster. For details, please refer to the following tutorials:

  • Overview
    • Overview
    • Supported Classic NAS Algorithms
    • Supported One-shot NAS Algorithms
    • Using NNI API to Write Your Search Space
    • NAS Visualization
    • Reference and Feedback
  • Write A Search Space
  • Classic NAS
    • Quick Start
    • Standalone mode for easy debugging
  • One-shot NAS
    • Quick Start
    • ENAS
    • DARTS
    • P-DARTS
    • SPOS
    • CDARTS
    • ProxylessNAS
    • TextNAS
  • Customize a NAS Algorithm
    • Extend the Ability of One-Shot Trainers
    • Implement New Mutators
    • Implemented a Distributed NAS Tuner
  • NAS Visualization
    • Built-in Trainers Support
    • Visualize a Customized Trainer
    • NAS UI Preview
    • Limitations
    • Feedback
  • NAS Benchmarks
    • Introduction
    • Prerequisites
    • Data Preparation
    • Example Usages
    • NAS-Bench-101
    • NAS-Bench-201
    • NDS
    • Available Operators
  • API Reference
    • Mutables
    • Mutators
    • Trainers
Next Previous

© Copyright 2020, Microsoft Revision a38df504.

Built with Sphinx using a theme provided by Read the Docs.