CARRE4
Published in

CARRE4

[Paper] Single-Path NAS: Designing Hardware-Efficient ConvNets in less than 4 Hours (Image Classification)

Training Time 5,000× Faster Than MnasNet, 25× Faster Than ProxylessNAS, 11× Faster Than FBNet. Outperforms MnasNet, ProxylessNAS, FBNet & MobileNetV2

Outline

1. Multi-Path NAS vs Single-Path NAS

1.1. Multi-Path NAS

Multi-Path NAS

1.2. Single-Path NAS

Single-Path NAS

2. Single-Path NAS: Search Space

2.1. Single-Path NAS Search Space

Single-path search space

2.2. Searching for Kernel Size

Searching for Kernel Size

2.3. Searching for Expansion Ratio

Searching for Expansion Ratio

3. Single-Path NAS: Differentiable Runtime Loss

Hardware-efficient ConvNet found by Single-Path NAS (Orange Part is not found by NAS)

4. Experimental Results

4.1. ImageNet classification

ImageNet classification accuracy
ImageNet classification accuracy with various channel size scales

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store