Exploiting Semantic and Visual Context for Effective Video Annotation

doi:10.1109/TMM.2013.2250266

CORC > 北京大学 > 信息科学技术学院

	Exploiting Semantic and Visual Context for Effective Video Annotation
	Yi, Jian ; Peng, Yuxin ; Xiao, Jianguo
刊名	ieee transactions on multimedia
	2013
关键词	Context mining semantic context video annotation visual context video retrieval OBJECT RECOGNITION CONCEPT FUSION RETRIEVAL
DOI	10.1109/TMM.2013.2250266
英文摘要	We propose a new method to refine the result of video annotation by exploiting the semantic and visual context of video. On one hand, semantic context mining is performed in a supervised way, using the manual concept labels of the training set. It is very useful for boosting video annotation performance, because semantic context is learned from labels given by people, indicating human intention. In this paper, we model the spatial and temporal context in video by using conditional random fields with different structures. Comparing with existing methods, our method could more accurately capture concept relationship in video and could more effectively improve the video annotation performance. On the other hand, visual context mining is performed in a semi-supervised way based on the visual similarities among video shots. It indicates the natural visual property of video, and could be considered as the compensation to semantic context, which generally could not be perfectly modeled. In this paper, we construct a graph based on the visual similarities among shots. Then a semi-supervised learning approach is adopt based on the graph to propagate probabilities of the reliable shots to others having similar visual features with them. Extensive experimental results on the widely used TRECVID datasets exhibit the effectiveness of our method for improving video annotation accuracy.; http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000324765400016&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=8e1609b174ce4e31116a60747a720701 ; Computer Science, Information Systems; Computer Science, Software Engineering; Telecommunications; SCI(E); EI; 2; ARTICLE; 6; 1400-1414; 15
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/161768]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Yi, Jian,Peng, Yuxin,Xiao, Jianguo. Exploiting Semantic and Visual Context for Effective Video Annotation[J]. ieee transactions on multimedia,2013.
APA	Yi, Jian,Peng, Yuxin,&Xiao, Jianguo.(2013).Exploiting Semantic and Visual Context for Effective Video Annotation.ieee transactions on multimedia.
MLA	Yi, Jian,et al."Exploiting Semantic and Visual Context for Effective Video Annotation".ieee transactions on multimedia (2013).