Using Webcast Text for Semantic Event Detection in Broadcast Sports Video

	Using Webcast Text for Semantic Event Detection in Broadcast Sports Video
	Xu, Changsheng1,2 ; Zhang, Yi-Fan1,2 ; Zhu, Guangyu 3; Rui, Yong 4; Lu, Hanqing1,2 ; Huang, Qingming 5
刊名	IEEE TRANSACTIONS ON MULTIMEDIA
	2008-11-01
卷号	10 期号:7 页码:1342-1355
关键词	Broadcast video semantic event detection Webcast text
英文摘要	Sports video semantic event detection is essential for sports video summarization and retrieval. Extensive research efforts have been devoted to this area in recent years. However, the existing sports video event detection approaches heavily rely on either video content itself, which face the difficulty of high-level semantic information extraction from video content using computer vision and image processing techniques, or manually generated video ontology, which is domain specific and difficult to be automatically aligned with the video content. In this paper, we present a novel approach for sports video semantic event detection based on analysis and alignment of webcast text and broadcast video. Webcast text is a text broadcast channel for sports game which is co-produced with the broadcast video and is easily obtained from the web. We first analyze webcast text to cluster and detect text events in an unsupervised way using probabilistic latent semantic analysis (pLSA). Based on the detected text event and video structure analysis, we employ a conditional random field model (CRFM) to align text event and video event by detecting event moment and event boundary in the video. Incorporation of webcast text into sports video analysis significantly facilitates sports video semantic event detection. We conducted experiments on 33 hours of soccer and basketball games for webcast analysis, broadcast video analysis and text/video semantic alignment. The results are encouraging and compared with the manually labeled ground truth.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
研究领域[WOS]	Computer Science ; Telecommunications
关键词[WOS]	RETRIEVAL
收录类别	SCI
语种	英语
WOS记录号	WOS:000261310700011
公开日期	2015-12-24
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/9593]
专题	自动化研究所_09年以前成果
作者单位	1.Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, Beijing 100080, Peoples R China 2.China Singapore Inst Digital Media, Singapore, Singapore 3.Harbin Inst Technol, Sch Comp Sci, Harbin 150001, Peoples R China 4.Microsoft China R&D Grp, Beijing 100080, Peoples R China 5.Chinese Acad Sci, Grad Univ, Beijing 100039, Peoples R China
推荐引用方式 GB/T 7714	Xu, Changsheng,Zhang, Yi-Fan,Zhu, Guangyu,et al. Using Webcast Text for Semantic Event Detection in Broadcast Sports Video[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2008,10(7):1342-1355.
APA	Xu, Changsheng,Zhang, Yi-Fan,Zhu, Guangyu,Rui, Yong,Lu, Hanqing,&Huang, Qingming.(2008).Using Webcast Text for Semantic Event Detection in Broadcast Sports Video.IEEE TRANSACTIONS ON MULTIMEDIA,10(7),1342-1355.
MLA	Xu, Changsheng,et al."Using Webcast Text for Semantic Event Detection in Broadcast Sports Video".IEEE TRANSACTIONS ON MULTIMEDIA 10.7(2008):1342-1355.