Learning Hierarchical Space Tiling for Scene Modeling, Parsing and   Attribute Tagging

doi:10.1109/TPAMI.2015.2424880

CORC > 北京大学 > 信息科学技术学院

	Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging
	Wang, Shuo ; Wang, Yizhou ; Zhu, Song-Chun
刊名	IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
	2015
关键词	Scene representation hierarchical space tiling scene attributes ALGORITHM OBJECTS
DOI	10.1109/TPAMI.2015.2424880
英文摘要	A typical scene category contains an enormous number of distinct scene configurations that are composed of objects and regions of varying shapes in different layouts. In this paper, we first propose a representation named hierarchical space tiling (HST) to quantize the huge and continuous scene configuration space. Then, we augment the HST with attributes (nouns and adjectives) to describe the semantics of the objects and regions inside a scene. We present a weakly supervised method for simultaneously learning the scene configurations and attributes from a collection of natural images associated with descriptive text. The precise locations of attributes are unknown in the input and are mapped to the HST nodes through learning. Starting with a full HST, we iteratively estimate the HST model under a learning-by-parsing framework. Given a test image, we compute the most probable parse tree with the associated attributes by dynamic programming. We quantitatively analyze the representative efficiency of HST, show the learned representation is less ambiguous and has semantically meaningful inner concepts. In applications, we apply our model to four tasks: scene classification, attribute recognition, attribute localization, and pixel-wise scene labeling, and show the performance improvements as well as higher efficiency.; NSF [CNS-1028381]; MURI ONR [N00014-10-1-0933]; China Scholarship Council; [NSFC-61272027]; [NSFC-61231010]; [973-2015CB351800]; SCI(E); EI; ARTICLE; shuowang@pku.edu.cn; Yizhou.Wang@pku.edu.cn; sczhu@stat.ucla.edu; 12; 2478-2491; 37
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/435694]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Wang, Shuo,Wang, Yizhou,Zhu, Song-Chun. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2015.
APA	Wang, Shuo,Wang, Yizhou,&Zhu, Song-Chun.(2015).Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE.
MLA	Wang, Shuo,et al."Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2015).