Interaction Design for Mobile Visual Search

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 多媒体计算与图形学团队

	Interaction Design for Mobile Visual Search
	Sang, Jitao1 ; Mei, Tao 2; Xu, Ying-Qing 3; Zhao, Chen 4; Xu, Changsheng1 ; Li, Shipeng 2
刊名	IEEE TRANSACTIONS ON MULTIMEDIA
	2013-11-01
卷号	15 期号:7 页码:1665-1676
关键词	Interaction design interactive search mobile visual search user interfaces
英文摘要	Mobile devices are becoming ubiquitous. People take pictures via their phone cameras to explore the world on the go. In many cases, they are concerned with the picture-related information. Understanding user intent conveyed by those pictures therefore becomes important. Existing mobile applications employ visual search to connect the captured picture with the physical world. However, they only achieve limited success due to the ambiguity nature of user intent in the picture-one picture usually contains multiple objects. By taking advantage of multitouch interactions on mobile devices, this paper presents a prototype of interactive mobile visual search, named TapTell, to help users formulate their visual intent more conveniently. This kind of search leverages limited yet natural user interactions on the phone to achieve more effective visual search while maintaining a satisfying user experience. We make three contributions in this work. First, we conduct a focus study on the usage patterns and concerned factors for mobile visual search, which in turn leads to the interactive design of expressing visual intent by gesture. Second, we introduce four modes of gesture-based interactions (crop, line, lasso, and tap) and develop a mobile prototype. Third, we perform an in-depth usability evaluation on these different modes, which demonstrates the advantage of interactions and shows that lasso is the most natural and effective interaction mode. We show that TapTell provides a natural user experience to use phone camera and gesture to explore the world. Based on the observation and conclusion, we also suggest some design principles for interactive mobile visual search in the future.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
研究领域[WOS]	Computer Science ; Telecommunications
收录类别	SCI
语种	英语
WOS记录号	WOS:000325811800017
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/2850]
专题	自动化研究所_模式识别国家重点实验室_多媒体计算与图形学团队
作者单位	1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China 2.Microsoft Res Asia, Beijing 100080, Peoples R China 3.Tsinghua Univ, Beijing 100084, Peoples R China 4.Microsoft Corp, Redmond, WA 98052 USA
推荐引用方式 GB/T 7714	Sang, Jitao,Mei, Tao,Xu, Ying-Qing,et al. Interaction Design for Mobile Visual Search[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2013,15(7):1665-1676.
APA	Sang, Jitao,Mei, Tao,Xu, Ying-Qing,Zhao, Chen,Xu, Changsheng,&Li, Shipeng.(2013).Interaction Design for Mobile Visual Search.IEEE TRANSACTIONS ON MULTIMEDIA,15(7),1665-1676.
MLA	Sang, Jitao,et al."Interaction Design for Mobile Visual Search".IEEE TRANSACTIONS ON MULTIMEDIA 15.7(2013):1665-1676.