SqueezeFlow: A Sparse CNN Accelerator Exploiting Concise Convolution Rules

doi:10.1109/TC.2019.2924215

CORC > 计算技术研究所 > 中国科学院计算技术研究所 > 中国科学院计算技术研究所期刊论文 > 英文

	SqueezeFlow: A Sparse CNN Accelerator Exploiting Concise Convolution Rules
	Li, Jiajun 1,2; Jiang, Shuhao 1,2; Gong, Shijun 1,2; Wu, Jingya 1,2; Yan, Junchao 1,2; Yan, Guihai 1,2; Li, Xiaowei 1,2
刊名	IEEE TRANSACTIONS ON COMPUTERS
	2019-11-01
卷号	68 期号:11 页码:1663-1677
关键词	Convolutional neural networks accelerator architecture hardware acceleration
ISSN号	0018-9340
DOI	10.1109/TC.2019.2924215
英文摘要	Convolutional Neural Networks (CNNs) have been widely used in machine learning tasks. While delivering state-of-the-art accuracy, CNNs are known as both compute- and memory-intensive. This paper presents the SqueezeFlow accelerator architecture that exploits sparsity of CNN models for increased efficiency. Unlike prior accelerators that trade complexity for flexibility, SqueezeFlow exploits concise convolution rules to benefit from the reduction of computation and memory accesses as well as the acceleration of existing dense architectures without intrusive PE modifications. Specifically, SqueezeFlow employs a PT-OS-sparse dataflow that removes the ineffective computations while maintaining the regularity of CNN computations. We present a full design down to the layout at 65 nm, with an area of 4.80mm2 and power of 536.09mW. The experiments show that SqueezeFlow achieves a speedup of 2:9 on VGG16 compared to the dense architectures, with an area and power overhead of only 8.8 and 15.3 percent, respectively. On three representative sparse CNNs, SqueezeFlow improves the performance and energy efficiency by 1:8 and 1:5 over the state-of-the-art sparse accelerators.
资助项目	National Natural Science Foundation of China[61872336] ; National Natural Science Foundation of China[61532017] ; National Natural Science Foundation of China[61572470] ; National Natural Science Foundation of China[61432017] ; National Natural Science Foundation of China[61521092] ; National Natural Science Foundation of China[61376043] ; Youth Innovation Promotion Association, CAS[Y404441000]
WOS研究方向	Computer Science ; Engineering
语种	英语
出版者	IEEE COMPUTER SOC
WOS记录号	WOS:000491426600009
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/14910]
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yan, Guihai; Li, Xiaowei
作者单位	1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Li, Jiajun,Jiang, Shuhao,Gong, Shijun,et al. SqueezeFlow: A Sparse CNN Accelerator Exploiting Concise Convolution Rules[J]. IEEE TRANSACTIONS ON COMPUTERS,2019,68(11):1663-1677.
APA	Li, Jiajun.,Jiang, Shuhao.,Gong, Shijun.,Wu, Jingya.,Yan, Junchao.,...&Li, Xiaowei.(2019).SqueezeFlow: A Sparse CNN Accelerator Exploiting Concise Convolution Rules.IEEE TRANSACTIONS ON COMPUTERS,68(11),1663-1677.
MLA	Li, Jiajun,et al."SqueezeFlow: A Sparse CNN Accelerator Exploiting Concise Convolution Rules".IEEE TRANSACTIONS ON COMPUTERS 68.11(2019):1663-1677.