Feature Variance Ratio-Guided Channel Pruning for Deep Convolutional Network Acceleration
Junjie He (Zhejiang University)*, Bohua Chen (Zhejiang University), Yinzhang Ding (Zhejiang University), Dongxiao Li (Zhejiang University)
Keywords: Deep Learning for Computer Vision
Abstract:
Most existing channel pruning approaches utilize the magnitude of network parameters to guide the pruning process. However, these methods suffer from some limitations in modern networks, where the magnitude of parameters can vary independently of the importance of corresponding channels. To recognize redundancies more accurately and therefore, accelerate networks better, we propose a novel channel pruning criterion based on the Pearson correlation coefficient. The criterion preserves the features that are essentially informative to the given task and avoids the influence of useless parameter scales. Based on this criterion, we further establish our channel pruning framework named Feature Variance Ratio-guided Channel Pruning (FVRCP). FVRCP prunes channels globally with little human intervention. Moreover, it can automatically find important layers in the network. Extensive numerical experiments on CIFAR-10 and ImageNet with widely varying architectures present state-of-the-art performance of our method.
SlidesLive
Similar Papers
Towards Optimal Filter Pruning with Balanced Performance and Pruning Speed
Dong Li (Nuctech)*, Sitong Chen (Nuctech), Xudong Liu (Nuctech), Yunda Sun (Nuctech), Li Zhang (Nuctech)

Dense Dual-Path Network for Real-time Semantic Segmentation
Xinneng Yang (Tongji University)*, Yan Wu (Tongji University), Junqiao Zhao (Tongji University), Feilin Liu (Tongji University)

Lightweight Single-Image Super-Resolution Network with Attentive Auxiliary Feature Learning
Xuehui Wang (School of Data and Computer Science, Sun Yat-sen University), qing wang (School of Data and Computer Science, Sun Yat-sen University), Yuzhi Zhao (City University of Hong Kong), Junchi Yan (Shanghai Jiao Tong University), Lei Fan (Northwestern University), long chen (School of Data and Computer Science, Sun Yat-sen University)*
