ISEE: An Intelligent Scene Exploration and Evaluation Platform for Large-Scale Visual Surveillance

doi:10.1109/TPDS.2019.2921956

CORC > 自动化研究所 > 中国科学院自动化研究所 > 智能感知与计算研究中心

	ISEE: An Intelligent Scene Exploration and Evaluation Platform for Large-Scale Visual Surveillance
	Li, Da 2,6; Zhang, Zhang 1,2,3; Yu, Kai 5; Huang, Kaiqi 4; Tan, Tieniu 1,2
刊名	IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS
	2019-12-01
卷号	30 期号:12 页码:2743-2758
关键词	Visualization Surveillance Task analysis Streaming media Computer architecture Pipelines Sparks Intelligent surveillance system big visual data distributed system and parallel computing
ISSN号	1045-9219
DOI	10.1109/TPDS.2019.2921956
通讯作者	Zhang, Zhang(zzhang@nlpr.ia.ac.cn)
英文摘要	Intelligent video surveillance (IVS) is always an interesting research topic to utilize visual analysis algorithms for exploring richly structured information from big surveillance data. However, existing IVS systems either struggle to utilize computing resources adequately to improve the efficiency of large-scale video analysis, or present a customized system for specific video analytic functions. It still lacks of a comprehensive computing architecture to enhance efficiency, extensibility and flexibility of IVS system. Moreover, it is also an open problem to study the effect of the combinations of multiple vision modules on the final performance of end applications of IVS system. Motivated by these challenges, we develop an Intelligent Scene Exploration and Evaluation (ISEE) platform based on a heterogeneous CPU-GPU cluster and some distributed computing tools, where Spark Streaming serves as the computing engine for efficient large-scale video processing and Kafka is adopted as a middle-ware message center to decouple different analysis modules flexibly. To validate the efficiency of the ISEE and study the evaluation problem on composable systems, we instantiate the ISEE for an end application on person retrieval with three visual analysis modules, including pedestrian detection with tracking, attribute recognition and re-identification. Extensive experiments are performed on a large-scale surveillance video dataset involving 25 camera scenes, totally 587 hours 720p synchronous videos, where a two-stage question-answering procedure is proposed to measure the performance of execution pipelines composed of multiple visual analysis algorithms based on millions of attribute-based and relationship-based queries. The case study of system-level evaluations may inspire researchers to improve visual analysis algorithms and combining strategies from the view of a scalable and composable system in the future.
资助项目	National Key Research and Development Program of China[2016YFB1001005] ; National Natural Science Foundation of China[61473290]
WOS关键词	FRAMEWORK ; TRACKING
WOS研究方向	Computer Science ; Engineering
语种	英语
出版者	IEEE COMPUTER SOC
WOS记录号	WOS:000498569400010
资助机构	National Key Research and Development Program of China ; National Natural Science Foundation of China
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/29407]
专题	自动化研究所_智能感知与计算研究中心
通讯作者	Zhang, Zhang
作者单位	1.Chinese Acad Sci, Inst Automat, NLPR, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Inst Automat, CRIPAC, Beijing 100190, Peoples R China 3.UCAS, Beijing 100049, Peoples R China 4.Chinese Acad Sci, Inst Automat, CRISE, Beijing 100090, Peoples R China 5.Carnegie Mellon Univ, Pittsburgh, PA 15213 USA 6.UCAS, Sch Artificial Intelligence, Beijing 100049, Peoples R China
推荐引用方式 GB/T 7714	Li, Da,Zhang, Zhang,Yu, Kai,et al. ISEE: An Intelligent Scene Exploration and Evaluation Platform for Large-Scale Visual Surveillance[J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,2019,30(12):2743-2758.
APA	Li, Da,Zhang, Zhang,Yu, Kai,Huang, Kaiqi,&Tan, Tieniu.(2019).ISEE: An Intelligent Scene Exploration and Evaluation Platform for Large-Scale Visual Surveillance.IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,30(12),2743-2758.
MLA	Li, Da,et al."ISEE: An Intelligent Scene Exploration and Evaluation Platform for Large-Scale Visual Surveillance".IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS 30.12(2019):2743-2758.