Stacked dense networks for single-image snow removal
Li PY(李鹏越)2,3,4; Yun, Mengshen5; Tian JD(田建东)3,4; Tang YD(唐延东)3,4; Wang GL(王国霖)1,3,4; Wu CD(吴成东)2
刊名Neurocomputing
2019
卷号367期号:20页码:152-163
关键词Snow removal Single image Stacked dense networks Image restoration
ISSN号0925-2312
产权排序1
英文摘要

Single image snow removal is important since snowy images usually degrade the performance of computer vision systems. In this paper, we deduce a physics-based snow model and propose a novel snow removal method based on the snow model and deep neural networks. Our model decomposes a snowy image into a nonlinear combination of a snow-free image and dynamic snowflakes. Inspired by our model and DenseNet connectivity pattern, we design a novel Multi-scale Stacked Densely Connected Convolutional Network (MS-SDN) to simultaneously detect and remove snowflakes in an image. The MS-SDN is composed of a multi-scale convolutional sub-net for extracting feature maps and two stacked modified DenseNets for snowflakes detection and removal. The snowflake detection sub-net guides snow removal through forward transmission, and the snowflake removal sub-net adjusts snow detection through back transmission. In this way, snowflake detection and removal mutually improve the final results. For training and testing our method, we constructed a large-scale benchmark synthesis dataset which contains 3000 triplets of snowy images, snowflakes, and snow-free images. Specifically, the snow-free images are captured from snow scenes, and the snowy images are synthesized by using our deduced snow model. Our extensive quantitative and qualitative experimental results show that our MS-SDN performs better than several state-of-the-art methods, and the stacked structure is better than multi-branch structures in terms of snow removal.

资助项目Natural Science Foundation of China[91648118] ; Natural Science Foundation of China[61821005] ; Youth Innovation Promotion Association CAS
WOS关键词RAIN
WOS研究方向Computer Science
语种英语
WOS记录号WOS:000489017500015
资助机构Natural Science Foundation of China under Grants no. 91648118 and 61821005 ; Youth Innovation Promotion Association CAS
内容类型期刊论文
源URL[http://ir.sia.cn/handle/173321/25473]  
专题沈阳自动化研究所_机器人学研究室
通讯作者Tian JD(田建东)
作者单位1.University of Chinese Academy of Sciences, China
2.Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
3.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, China
4.Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, China
5.College of Engineering, University of Illinois at Urbana-Champaign, Urbana, United States
推荐引用方式
GB/T 7714
Li PY,Yun, Mengshen,Tian JD,et al. Stacked dense networks for single-image snow removal[J]. Neurocomputing,2019,367(20):152-163.
APA Li PY,Yun, Mengshen,Tian JD,Tang YD,Wang GL,&Wu CD.(2019).Stacked dense networks for single-image snow removal.Neurocomputing,367(20),152-163.
MLA Li PY,et al."Stacked dense networks for single-image snow removal".Neurocomputing 367.20(2019):152-163.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace