Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches | |
Alacam, O (Alacam, Ozge)1; Li, XS (Li, Xingshan)2; Menzel, W (Menzel, Wolfgang)1; Staron, T (Staron, Tobias)1 | |
刊名 | FRONTIERS IN NEUROROBOTICS
![]() |
2020-01 | |
卷号 | 14页码:不详 |
关键词 | language comprehension crossmodality psycholinguistics incrementality prediction speaker intention |
ISSN号 | 1662-5218 |
DOI | 10.3389/fnbot.2020.00002 |
产权排序 | 2 |
文献子类 | Review |
英文摘要 | Crossmodal interaction in situated language comprehension is important for effective and efficient communication. The relationship between linguistic and visual stimuli provides mutual benefit: While vision contributes, for instance, information to improve language understanding, language in turn plays a role in driving the focus of attention in the visual environment. However, language and vision are two different representational modalities, which accommodate different aspects and granularities of conceptualizations. To integrate them into a single, coherent system solution is still a challenge, which could profit from inspiration by human crossmodal processing. Based on fundamental psycholinguistic insights into the nature of situated language comprehension, we derive a set of performance characteristics facilitating the robustness of language understanding, such as crossmodal reference resolution, attention guidance, or predictive processing. Artificial systems for language comprehension should meet these characteristics in order to be able to perform in a natural and smooth manner. We discuss how empirical findings on the crossmodal support of language comprehension in humans can be applied in computational solutions for situated language comprehension and how they can help to mitigate the shortcomings of current approaches. |
语种 | 英语 |
内容类型 | 期刊论文 |
源URL | [http://ir.psych.ac.cn/handle/311026/31317] ![]() |
专题 | 心理研究所_认知与发展心理学研究室 |
作者单位 | 1.Univ Hamburg, Dept Informat, Nat Language Syst Grp, Hamburg, Germany 2.Chinese Acad Sci, Inst Psychol, Reading & Visual Cognit Lab, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Alacam, O ,Li, XS ,Menzel, W ,et al. Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches[J]. FRONTIERS IN NEUROROBOTICS,2020,14:不详. |
APA | Alacam, O ,Li, XS ,Menzel, W ,&Staron, T .(2020).Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches.FRONTIERS IN NEUROROBOTICS,14,不详. |
MLA | Alacam, O ,et al."Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches".FRONTIERS IN NEUROROBOTICS 14(2020):不详. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论