Network Automatic Pruning: Start NAP and Take a Nap


本文提出了自動化的Pruning方法,取代先前大多採用手動調整壓縮率的Pruning方式,在Fine-grained pruning和Structured pruning上都有不錯的效果。概念與NAS自動搜尋網路架構的方式很類似,幾乎不需要調整到Hyperparameter。三位作者皆來自Uber旗下的Uber ATG公司

Fine-grained pruning removes individual parameters from a network, and thus saves the storage space and benefits for embedded systems. Structured pruning, on the other hand, typically removes whole
channels (filters) from a network and thus achieves inference
speed-up with no need of any hardware specialization.


Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store