Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 图像与视频分析团队

	Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation
	Liu, Nan 1,2; Zhao, Yao 1,2; Zhu, Zhenfeng 1,2; Lu, Hanqing3
刊名	IEEE TRANSACTIONS ON MULTIMEDIA
	2011-10-01
卷号	13 期号:5 页码:961-973
关键词	Commercial detection commercial segmentation multi-modal fusion text detection video analysis
英文摘要	Automatic TV commercial block detection (CBD) and commercial block segmentation (CBS) are two key components of a smart commercial digesting system. In this paper, we focus our research on CBD and CBS by the means of collaborative exploitation of visual-audio-textual characteristics embedded in commercials. Rather than utilizing exclusively visual-audio characteristics like most previous works, an abundance of textual characteristics associated with commercials are fully exploited. Additionally, Tri-AdaBoost, an interactive ensemble learning manner, is proposed to form a consolidated semantic fusion across visual, audio, and textual characteristics. In order to segment a detected commercial block into multiple individual commercials, additional informative descriptors including textual characteristics are introduced to boost the robustness in the detection of frame marked with product information (FMPI). Together with the characteristics of audio spectral variation pointer and silent position, FMPI can provide a kind of complementary representation architecture to model the similarity of intra-commercial and the dissimilarity of inter-commercial. Experiments are conducted on a large video dataset from both China central television (CCTV) channels and TRECVID'05, and promising experimental results show the effectiveness of the proposed scheme.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
研究领域[WOS]	Computer Science ; Telecommunications
关键词[WOS]	VIDEO ; STREAMS
收录类别	SCI
语种	英语
WOS记录号	WOS:000295007300011
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/3329]
专题	自动化研究所_模式识别国家重点实验室_图像与视频分析团队
作者单位	1.Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China 2.Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China 3.Chinese Acad Sci, Inst Automat, Beijing 100080, Peoples R China
推荐引用方式 GB/T 7714	Liu, Nan,Zhao, Yao,Zhu, Zhenfeng,et al. Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2011,13(5):961-973.
APA	Liu, Nan,Zhao, Yao,Zhu, Zhenfeng,&Lu, Hanqing.(2011).Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation.IEEE TRANSACTIONS ON MULTIMEDIA,13(5),961-973.
MLA	Liu, Nan,et al."Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation".IEEE TRANSACTIONS ON MULTIMEDIA 13.5(2011):961-973.