Recent advances in efficient computation of deep convolutional neural networks

doi:10.1631/FITEE.1700789

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 图像与视频分析团队

	Recent advances in efficient computation of deep convolutional neural networks
	Cheng, Jian1,2 ; Wang, Pei-song1,2 ; Li, Gang1,2 ; Hu, Qing-hao1,2 ; Lu, Han-qing1,2
刊名	FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING
	2018
卷号	19 期号:1 页码:64-77
关键词	Deep Neural Networks Acceleration Compression Hardware Accelerator
DOI	10.1631/FITEE.1700789
文献子类	Review
英文摘要	Deep neural networks have evolved remarkably over the past few years and they are currently the fundamental tools of many intelligent systems. At the same time, the computational complexity and resource consumption of these networks continue to increase. This poses a significant challenge to the deployment of such networks, especially in real-time applications or on resource-limited devices. Thus, network acceleration has become a hot topic within the deep learning community. As for hardware implementation of deep neural networks, a batch of accelerators based on a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC) have been proposed in recent years. In this paper, we provide a comprehensive survey of recent advances in network acceleration, compression, and accelerator design from both algorithm and hardware points of view. Specifically, we provide a thorough analysis of each of the following topics: network pruning, low-rank approximation, network quantization, teacher-student networks, compact network design, and hardware accelerators. Finally, we introduce and discuss a few possible future directions.
WOS研究方向	Computer Science ; Engineering
语种	英语
WOS记录号	WOS:000427742400007
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/20897]
专题	自动化研究所_模式识别国家重点实验室_图像与视频分析团队
通讯作者	Cheng, Jian
作者单位	1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
推荐引用方式 GB/T 7714	Cheng, Jian,Wang, Pei-song,Li, Gang,et al. Recent advances in efficient computation of deep convolutional neural networks[J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING,2018,19(1):64-77.
APA	Cheng, Jian,Wang, Pei-song,Li, Gang,Hu, Qing-hao,&Lu, Han-qing.(2018).Recent advances in efficient computation of deep convolutional neural networks.FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING,19(1),64-77.
MLA	Cheng, Jian,et al."Recent advances in efficient computation of deep convolutional neural networks".FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING 19.1(2018):64-77.