Cross-media retrieval by intra-media and inter-media correlation mining | |
Zhai, Xiaohua ; Peng, Yuxin ; Xiao, Jianguo | |
刊名 | multimedia systems
![]() |
2013 | |
关键词 | Cross-media retrieval Heterogeneous similarity measure Intra-media correlation Inter-media correlation |
DOI | 10.1007/s00530-012-0297-6 |
英文摘要 | With the rapid development of multimedia content on the Internet, cross-media retrieval has become a key problem in both research and application. Cross-media retrieval is able to retrieve the results of the same semantics with the query, but with different media types. For instance, given a query image of Moraine Lake, besides retrieving the images about Moraine Lake, cross-media retrieval system can also retrieve the related media contents of different media types such as text description. As a result, measuring content similarity between different media is a challenging problem. In this paper, we propose a novel cross-media similarity measure. It considers both intra-media and inter-media correlation, which are ignored by existing works. Intra-media correlation focuses on semantic category information within each media, while inter-media correlation focuses on positive and negative correlations between different media types. Both of them are very important and their adaptive fusion can complement each other. To mine the intra-media correlation, we propose a heterogeneous similarity measure with nearest neighbors (HSNN). The heterogeneous similarity is obtained by computing the probability for two media objects belonging to the same semantic category. To mine the inter-media correlation, we propose a cross-media correlation propagation (CMCP) approach to simultaneously deal with positive and negative correlation between media objects of different media types, while existing works focus solely on the positive correlation. Negative correlation is very important because it provides effective exclusive information. The correlations are modeled as must-link constraints and cannot-link constraints, respectively. Furthermore, our approach is able to propagate the correlation between heterogeneous modalities. Finally, both HSNN and CMCP are flexible, so that any traditional similarity measure could be incorporated. An effective ranking model is learned by further fusion of multiple similarity measures through AdaRank for cross-media retrieval. The experimental results on two datasets show the effectiveness of our proposed approach, compared with state-of-the-art methods.; http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000324883100001&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=8e1609b174ce4e31116a60747a720701 ; Computer Science, Information Systems; Computer Science, Theory & Methods; SCI(E); EI; 3; ARTICLE; 5; 395-406; 19 |
语种 | 英语 |
内容类型 | 期刊论文 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/161770] ![]() |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Zhai, Xiaohua,Peng, Yuxin,Xiao, Jianguo. Cross-media retrieval by intra-media and inter-media correlation mining[J]. multimedia systems,2013. |
APA | Zhai, Xiaohua,Peng, Yuxin,&Xiao, Jianguo.(2013).Cross-media retrieval by intra-media and inter-media correlation mining.multimedia systems. |
MLA | Zhai, Xiaohua,et al."Cross-media retrieval by intra-media and inter-media correlation mining".multimedia systems (2013). |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论