Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras

doi:10.1111/cgf.13561

CORC > 自动化研究所 > 中国科学院自动化研究所 > 多媒体计算与图形学团队

	Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras
	Cheng, Dachuan 1; Shi, Jian2 ; Chen, Yanyun 1; Deng, Xiaoming 3; Zhang, Xiaopeng2
刊名	COMPUTER GRAPHICS FORUM
	2018-10-01
卷号	37 期号:7 页码:213-221
ISSN号	0167-7055
DOI	10.1111/cgf.13561
通讯作者	Cheng, Dachuan()
英文摘要	Illumination estimation is an essential problem in computer vision, graphics and augmented reality. In this paper, we propose a learning based method to recover low-frequency scene illumination represented as spherical harmonic (SH) functions by pairwise photos from rear and front cameras on mobile devices. An end-to-end deep convolutional neural network (CNN) structure is designed to process images on symmetric views and predict SH coefficients. We introduce a novel Render Loss to improve the rendering quality of the predicted illumination. A high quality high dynamic range (HDR) panoramic image dataset was developed for training and evaluation. Experiments show that our model produces visually and quantitatively superior results compared to the state-of-the-arts. Moreover, our method is practical for mobile-based applications.
资助项目	National Natural Science Foundation of China[61620106003] ; National Natural Science Foundation of China[61331018] ; National Natural Science Foundation of China[61473276]
WOS关键词	REFLECTANCE
WOS研究方向	Computer Science
语种	英语
出版者	WILEY
WOS记录号	WOS:000448166700020
资助机构	National Natural Science Foundation of China
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/22794]
专题	多媒体计算与图形学团队
通讯作者	Cheng, Dachuan
作者单位	1.Univ Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Inst Automat, Beijing, Peoples R China 3.Chinese Acad Sci, Inst Software, Beijing Key Lab Human Comp Interact, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Cheng, Dachuan,Shi, Jian,Chen, Yanyun,et al. Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras[J]. COMPUTER GRAPHICS FORUM,2018,37(7):213-221.
APA	Cheng, Dachuan,Shi, Jian,Chen, Yanyun,Deng, Xiaoming,&Zhang, Xiaopeng.(2018).Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras.COMPUTER GRAPHICS FORUM,37(7),213-221.
MLA	Cheng, Dachuan,et al."Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras".COMPUTER GRAPHICS FORUM 37.7(2018):213-221.