Learning descriptive visual representation for image classification and   annotation

doi:10.1016/j.patcog.2014.08.008

CORC > 北京大学 > 信息科学技术学院

	Learning descriptive visual representation for image classification and annotation
	Lu, Zhiwu ; Wang, Liwei
刊名	模式识别
	2015
关键词	Image classification Image annotation Visual representation Matrix factorization NONNEGATIVE MATRIX FACTORIZATION SPARSE REPRESENTATION VOCABULARY RETRIEVAL ALGORITHM SQUARES MODELS
DOI	10.1016/j.patcog.2014.08.008
英文摘要	This paper presents a novel semantic regularized matrix factorization method for learning descriptive visual bag-of-words (BOW) representation. Although very influential in image classification, the traditional visual BOW representation has one distinct drawback. That is, for efficiency purposes, this visual representation is often generated by directly clustering the low-level visual feature vectors extracted from local keypoints or regions, without considering the high-level semantics of images. In other words, it still suffers from the semantic gap and may lead to significant performance degradation in more challenging tasks, e.g., image classification over social collections with large intra-class variations. To learn descriptive visual BOW representation for such image classification task, we develop a semantic regularized matrix factorization method by adding Laplacian regularization defined with the tags (easy to access) of social images into matrix factorization. Moreover, given that image annotation only provides the tags of training images in advance (while the tags of all social images are available), we can readily apply the proposed method to image annotation by first running a round of image annotation to predict the tags (maybe incorrect) of test images and thus obtaining the tags of all images. Experimental results show the promising performance of the proposed method. (C) 2014 Elsevier Ltd. All rights reserved.; Computer Science, Artificial Intelligence; Engineering, Electrical & Electronic; SCI(E); 0; ARTICLE; zhiwu.lu@gmail.com; wanglw@cis.pku.edu.cn; 2; 498-508; 48
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/206233]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Lu, Zhiwu,Wang, Liwei. Learning descriptive visual representation for image classification and annotation[J]. 模式识别,2015.
APA	Lu, Zhiwu,&Wang, Liwei.(2015).Learning descriptive visual representation for image classification and annotation.模式识别.
MLA	Lu, Zhiwu,et al."Learning descriptive visual representation for image classification and annotation".模式识别 (2015).