Skip to content
Neural Network Intelligence logo
Neural Network Intelligence Advanced Usage
Type to start searching
    GitHub
    • Neural Network Intelligence 
    • Compression 
    • Advanced Usage
    GitHub
    • Overview
    • Get Started
    • Install NNI
    • Quickstart
    • User Guide
    •  Hyperparameter Optimization
      • Overview
      •  Quickstart
        • PyTorch
        • TensorFlow
        • HPO Quickstart with PyTorch
        • Port PyTorch Quickstart to NNI
        • HPO Quickstart with TensorFlow
        • Port TensorFlow Quickstart to NNI
      • Search Space
      • Tuners
      • Assessors
      •  Advanced Usage
        • Command Line Tool Example
        • Implement Custom Tuners and Assessors
        • Install Custom or 3rd-party Tuners and Assessors
        • Tuner Benchmark
        • Tuner Benchmark Example Statistics
    •  Neural Architecture Search
      • Overview
      •  Tutorials
        • Hello NAS!
        • Search in DARTS
      • Construct Model Space
      • Model Space Hub
      • Exploration Strategy
      • Model Evaluator
      •  Advanced Usage
        • Execution Engines
        • Hardware-aware NAS
        • Construct Space with Mutator
        • Customize Exploration Strategy
        • Serialization
        •  NAS Benchmark
          • Overview
          • Examples
    •  Model Compression
      • Overview
      •  Pruning
        • Overview
        • Quickstart
        • Pruner
        • Speedup
        •  Best Practices
          • Pruning Transformer
      •  Quantization
        • Overview
        • Quickstart
        • Quantizer
        • SpeedUp
      • Config Specification
      • Evaluator
      •  Advanced Usage
        • Customize Basic Pruner
        • Customize Quantizer
        • Customize Scheduled Pruning Process
        • Utilities
    •  Feature Engineering
      • Overview
      • GradientFeatureSelector
      • GBDTSelector
    •  Experiment
      • Overview
      •  Training Service
        • Overview
        • Local
        • Remote
        • OpenPAI
        • Kubeflow
        • AdaptDL
        • FrameworkController
        • AML
        • PAI-DLC
        • Hybrid
        • Customize a Training Service
        • Shared Storage
      •  Web Portal
        • Experiment Web Portal
        • Visualize with TensorBoard
      • Experiment Management
    • References
    •  Python API
      • Hyperparameter Optimization
      •  Neural Architecture Search
        • Search Space
        • Strategy
        • Evaluator
        • Others
      •  Model Compression
        • Pruner
        • Quantizer
        • Pruning Speedup
        • Quantization Speedup
        • Evaluator
        • Compression Utilities
        • Framework Related
      • Experiment
      • Others
    • Experiment Config Reference
    • nnictl Commands
    • Misc
    • Examples
    •  Use Cases and Solutions
      • Overview
      •  Automatic Model Tuning (HPO/NAS)
        • Tuning SVD automatically
        • EfficientNet on NNI
        • Automatic Model Architecture Search for Reading Comprehension
        • Parallelizing Optimization for TPE
      •  Automatic System Tuning (AutoSys)
        • Tuning SPTAG (Space Partition Tree And Graph) automatically
        • Tuning the performance of RocksDB
        • Tuning Tensor Operators automatically
      •  Model Compression
        • Knowledge distillation with NNI model compression
      •  Feature Engineering
        • NNI review article from Zhihu: - By Garvin Li
      •  Performance measurement, comparison and analysis
        • Neural Architecture Search Comparison
        • Hyper-parameter Tuning Algorithm Comparsion
        • Model Compression Algorithm Comparsion
      • Use NNI on Google Colab
      • nnSpider Emoticons
    • Research and Publications
    • Build from Source
    • Contribution Guide
    • Change Log

    Advanced UsageΒΆ

    • Customize Basic Pruner
      • Concepts
      • Simple Example: Customize a Block-L1NormPruner
    • Customize Quantizer
      • Customize backward function
    • Customize Scheduled Pruning Process
      • Workflow of Pruning Scheduler
      • How to Customized Iterative Pruning
      • More about Task Generator
      • Why Use Pruning Scheduler
    • Utilities
      • Sensitivity Analysis
      • Topology Analysis
      • Model FLOPs/Parameters Counter
    Previous Compression Evaluator
    Next Customize Basic Pruner
    © Copyright 2022, Microsoft.
    Created using Sphinx 5.1.1. and Material for Sphinx