Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features

doi:10.1016/j.isprsjprs.2017.12.005

CORC > 武汉植物园 > 中国科学院武汉植物园

	Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features
	Huang, Ronggang 2; Li, Jianping 1; Yang, Bisheng 1; Chen, Chi 1; Dong, Zhen 1; Xiao, Wen 3
刊名	ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING
	2018-02-01
卷号	136 页码:41-57
关键词	Panoramic image sequence Mobile laser scanning data Semantic features Registration
ISSN号	0924-2716
DOI	10.1016/j.isprsjprs.2017.12.005
英文摘要	Inaccurate exterior orientation parameters (EoPs) between sensors obtained by pre-calibration leads to failure of registration between panoramic image sequence and mobile laser scanning data. To address this challenge, this paper proposes an automatic registration method based on semantic features extracted from panoramic images and point clouds. Firstly, accurate rotation parameters between the panoramic camera and the laser scanner are estimated using GPS and IMU aided structure from motion (SfM). The initial EoPs of panoramic images are obtained at the same time. Secondly, vehicles in panoramic images are extracted by the Faster-RCNN as candidate primitives to be matched with potential corresponding primitives in point clouds according to the initial EoPs. Finally, translation between the panoramic camera and the laser scanner is refined by maximizing the overlapping area of corresponding primitive pairs based on the Particle Swarm Optimization (PSO), resulting in a finer registration between panoramic image sequences and point clouds. Two challenging urban scenes were experimented to assess the proposed method, and the final registration errors of these two scenes were both less than three pixels, which demonstrates a high level of automation, robustness and accuracy. (C) 2017 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS). Published by Elsevier B.V. All rights reserved.
资助项目	NSFC[41725005] ; NSFC[41531177] ; NSFC[41371431] ; NSFC[41701530] ; National Key Technology RD Program[2014BAL05807] ; Public science and technology research funds projects of ocean[2013418025] ; National Key Research and Development Program of China[2016YFF0103501] ; Ministry of Education of China[2016M600614] ; Key Laboratory of Spatial Data Mining & Information Sharing of Ministry of Education, Fuzhou University[2018LSDMIS06]
WOS研究方向	Physical Geography ; Geology ; Remote Sensing ; Imaging Science & Photographic Technology
语种	英语
出版者	ELSEVIER SCIENCE BV
WOS记录号	WOS:000425079200004
内容类型	期刊论文
源URL	[http://202.127.146.157/handle/2RYDP1HH/4656]
专题	中国科学院武汉植物园
通讯作者	Yang, Bisheng
作者单位	1.Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Hubei, Peoples R China 2.Chinese Acad Sci, Inst Geodesy & Geophys, Wuhan, Hubei, Peoples R China 3.Newcastle Univ, Sch Engn, Newcastle Upon Tyne NE1 7RU, Tyne & Wear, England
推荐引用方式 GB/T 7714	Huang, Ronggang,Li, Jianping,Yang, Bisheng,et al. Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features[J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,2018,136:41-57.
APA	Huang, Ronggang,Li, Jianping,Yang, Bisheng,Chen, Chi,Dong, Zhen,&Xiao, Wen.(2018).Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features.ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,136,41-57.
MLA	Huang, Ronggang,et al."Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features".ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING 136(2018):41-57.