Image sentiment prediction based on textual descriptions with adjective noun pairs

doi:10.1007/s11042-016-4310-5

CORC > 西安光学精密机械研究所 > 中国科学院西安光学精密机械研究所 > 光学影像学习与分析中心

	Image sentiment prediction based on textual descriptions with adjective noun pairs
	Li, Zuhe 1,2; Fan, Yangyu 1; Liu, Weihua 3; Wang, Fengqin 2
刊名	MULTIMEDIA TOOLS AND APPLICATIONS
	2018
卷号	77 期号:1 页码:1115-1132
关键词	Image Sentiment Textual Sentiment Concept Detection Late Fusion
ISSN号	1380-7501
DOI	10.1007/s11042-016-4310-5
产权排序	3
英文摘要	We aim to predict the sentiment related information reflected in images based on SentiBank, which is a library including Adjective Noun Pair (ANP) concept detectors for image sentiment analysis. Instead of using only ANP responses in images as mid-level features, we make full use of the ANPs' textual sentiment. We first give each ANP concept in SentiBank a sentiment value by adding together the textual sentiment value of the adjective and that of the noun. Having detected the presence of ANPs in an image, we define an image sentiment value by computing the weighted sum of the textual sentiment values of ANPs describing this image with corresponding ANP responses as weights. On the one hand, we adopt a one-dimension logistic regression model to predict the sentiment orientation according to the image sentiment value. On the other hand, we use the ANP responses detected in an image as mid-level representations to train a regularized logistic regression classifier for sentiment prediction. We finally employ a late fusion algorithm to combine the prediction results from the two schemes. Experimental results reveal that the proposed method which takes into account the textual sentiment of ANPs improves the performance of SentiBank based image sentiment prediction.
语种	英语
WOS记录号	WOS:000419995400047
内容类型	期刊论文
源URL	[http://ir.opt.ac.cn/handle/181661/30800]
专题	西安光学精密机械研究所_光学影像学习与分析中心
作者单位	1.Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Shaanxi, Peoples R China; 2.Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450002, Henan, Peoples R China; 3.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
推荐引用方式 GB/T 7714	Li, Zuhe,Fan, Yangyu,Liu, Weihua,et al. Image sentiment prediction based on textual descriptions with adjective noun pairs[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2018,77(1):1115-1132.
APA	Li, Zuhe,Fan, Yangyu,Liu, Weihua,&Wang, Fengqin.(2018).Image sentiment prediction based on textual descriptions with adjective noun pairs.MULTIMEDIA TOOLS AND APPLICATIONS,77(1),1115-1132.
MLA	Li, Zuhe,et al."Image sentiment prediction based on textual descriptions with adjective noun pairs".MULTIMEDIA TOOLS AND APPLICATIONS 77.1(2018):1115-1132.