3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System

doi:10.1109/TIM.2020.3006681

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 先进机器人控制团队

	3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System
	Chi, Jiannan 2; Liu, Jiahui 2; Wang, Feng 2; Chi, Yingkai 3; Hou, Zeng-Guang 1
刊名	IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
	2020-12-01
卷号	69 期号:12 页码:9695-9708
关键词	Pupils Cameras Cornea Estimation Three-dimensional displays Optical distortion 3-D gaze estimation corneal reflection multi-camera-multi-light-source (MCMLS) system optical axis reconstruction pupil refraction user calibration
ISSN号	0018-9456
DOI	10.1109/TIM.2020.3006681
通讯作者	Hou, Zeng-Guang(zengguang.hou@ia.ac.cn)
英文摘要	The image of the center of a 3-D circular target is not the center of its imaging ellipse due to the imaging distortion of the spatial circular targets; therefore, traditional 3-D gaze-estimation methods with the multi-camera-multi-light-source (MCMLS) systems generally replace the projection of the pupil center with the virtual image of the pupil center for 3-D gaze estimation. However, this introduces a large gaze-estimation error when the oblique angle between the optical axis of the eye and the camera optical axis is large. To eliminate the error caused by using the virtual image of the pupil center, a 3-D gaze-estimation method using an MCMLS system is developed in this study. We first estimate the cornea center and then determine the matching points of the pupil imaging ellipse using the special polar plane. After the cornea radius and the kappa angle are calibrated, the optical axis of the eye is reconstructed by the refraction planes constructed by the edge points of the pupil imaging ellipses. Thus, the 3-D gaze is estimated by the real-time calculated transformation matrix represented by the kappa angle. The feasibility and performance of the method have been analyzed by the simulations and the experiments. Since the estimation of the spatial pupil center or the construction of the refraction plane using the virtual image of the pupil center is not required, the proposed method mitigates the inherent errors caused by optical axis reconstruction in the traditional methods and simplifies the algorithm for gaze estimation, which has a practical value.
资助项目	National Key Research and Development Program of China[2018YFC2001700] ; Opening Project of Key Laboratory of Operation Safety Technology on Transport Vehicle, Ministry of Transport, China ; Beijing Municipal Natural Science Foundation[4172040] ; Science and Technology on Electrooptic Control Laboratory[301090704]
WOS关键词	SINGLE CAMERA ; TRACKING ; CALIBRATION
WOS研究方向	Engineering ; Instruments & Instrumentation
语种	英语
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号	WOS:000589255800037
资助机构	National Key Research and Development Program of China ; Opening Project of Key Laboratory of Operation Safety Technology on Transport Vehicle, Ministry of Transport, China ; Beijing Municipal Natural Science Foundation ; Science and Technology on Electrooptic Control Laboratory
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/41790]
专题	自动化研究所_复杂系统管理与控制国家重点实验室_先进机器人控制团队
通讯作者	Hou, Zeng-Guang
作者单位	1.Chinese Acad Sci, Inst Automat, State Key Lab Complex Syst Management & Control, Beijing 100190, Peoples R China 2.Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China 3.Northern Theater Command, Gen Hosp, Dept Pathol, Shenyang 110015, Peoples R China
推荐引用方式 GB/T 7714	Chi, Jiannan,Liu, Jiahui,Wang, Feng,et al. 3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System[J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT,2020,69(12):9695-9708.
APA	Chi, Jiannan,Liu, Jiahui,Wang, Feng,Chi, Yingkai,&Hou, Zeng-Guang.(2020).3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System.IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT,69(12),9695-9708.
MLA	Chi, Jiannan,et al."3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System".IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT 69.12(2020):9695-9708.