Deep Audio-Visual Learning: A Survey

doi:10.1007/s11633-021-1293-0

CORC > 自动化研究所 > 中国科学院自动化研究所 > 学术期刊 > International Journal of Automation and Computing

	Deep Audio-Visual Learning: A Survey
	Hao Zhu 3,4; Man-Di Luo 2,3; Rui Wang 3,4; Ai-Hua Zheng 4; Ran He 1,2,3
刊名	International Journal of Automation and Computing
	2021
卷号	18 期号:3 页码:351-376
关键词	Deep audio-visual learning audio-visual separation and localization correspondence learning generative models representation learning
ISSN号	1476-8186
DOI	10.1007/s11633-021-1293-0
英文摘要	Audio-visual learning, aimed at exploiting the relationship between audio and visual modalities, has drawn considerable attention since deep learning started to be used successfully. Researchers tend to leverage these two modalities to improve the performance of previously considered single-modality tasks or address new challenging problems. In this paper, we provide a comprehensive survey of recent audio-visual learning development. We divide the current audio-visual learning tasks into four different subfields: audio-visual separation and localization, audio-visual correspondence learning, audio-visual generation, and audio-visual representation learning. State-of-the-art methods, as well as the remaining challenges of each subfield, are further discussed. Finally, we summarize the commonly used datasets and challenges.
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/44288]
专题	自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位	1.Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China 2.School of Artificial Intelligence, University of the Chinese Academy of Sciences, Beijing 100049, China 3.Center for Research on Intelligent Perception and Computing (CRIPAC) and National Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China 4.Anhui Provincial Key Laboratory of Multimodal Cognitive Computation, School of Computer Science and Technology, Anhui University, Hefei 230601, China
推荐引用方式 GB/T 7714	Hao Zhu,Man-Di Luo,Rui Wang,et al. Deep Audio-Visual Learning: A Survey[J]. International Journal of Automation and Computing,2021,18(3):351-376.
APA	Hao Zhu,Man-Di Luo,Rui Wang,Ai-Hua Zheng,&Ran He.(2021).Deep Audio-Visual Learning: A Survey.International Journal of Automation and Computing,18(3),351-376.
MLA	Hao Zhu,et al."Deep Audio-Visual Learning: A Survey".International Journal of Automation and Computing 18.3(2021):351-376.