Latent Hierarchical Model of Temporal Structure for Complex Activity Classification

	Latent Hierarchical Model of Temporal Structure for Complex Activity Classification
	Limin Wang; Yu Qiao; Xiaoou Tang
刊名	IEEE TRANSACTIONS ON IMAGE PROCESSING
	2014
英文摘要	Modeling the temporal structure of sub-activities is an important yet challenging problem in complex activity classification. This paper proposes a latent hierarchical model (LHM) to describe the decomposition of complex activity into sub-activities in a hierarchical way. The LHM has a tree-structure, where each node corresponds to a video segment (sub-activity) at certain temporal scale. The starting and ending time points of each sub-activity are represented by two latent variables, which are automatically determined during the inference process. We formulate the training problem of the LHM in a latent kernelized SVM framework and develop an efficient cascade inference method to speed up classification. The advantages of our methods come from: 1) LHM models the complex activity with a deep structure, which is decomposed into sub-activities in a coarse-to-fine manner and 2) the starting and ending time points of each segment are adaptively determined to deal with the temporal displacement and duration variation of sub-activity. We conduct experiments on three datasets: 1) the KTH; 2) the Hollywood2; and 3) the Olympic Sports. The experimental results show the effectiveness of the LHM in complex activity classification. With dense features, our LHM achieves the state-of-the-art performance on the Hollywood2 dataset and the Olympic Sports dataset.
收录类别	SCI
原文出处	http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6690150
语种	英语
内容类型	期刊论文
源URL	[http://ir.siat.ac.cn:8080/handle/172644/5345]
专题	深圳先进技术研究院_集成所
作者单位	IEEE TRANSACTIONS ON IMAGE PROCESSING
推荐引用方式 GB/T 7714	Limin Wang,Yu Qiao,Xiaoou Tang. Latent Hierarchical Model of Temporal Structure for Complex Activity Classification[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2014.
APA	Limin Wang,Yu Qiao,&Xiaoou Tang.(2014).Latent Hierarchical Model of Temporal Structure for Complex Activity Classification.IEEE TRANSACTIONS ON IMAGE PROCESSING.
MLA	Limin Wang,et al."Latent Hierarchical Model of Temporal Structure for Complex Activity Classification".IEEE TRANSACTIONS ON IMAGE PROCESSING (2014).