Multi-sense based neural machine translation
Yang Z(杨振); Chen W(陈炜); Wang F(王峰); Wang F(王峰); Chen W(陈炜)
2017-07-03
会议日期2017-5-4
会议地点Anchorage, AK, USA
英文摘要
Attention mechanism advances the neural machine
translation (NMT) by reducing the confusion introduced by
irrelevant words in long sentences. However, the confusion caused
by ambiguous words hasn’t been handled yet and it may be
a bottleneck for the NMT model. This paper validates the
hypothesis and proposes a simple and flexible framework, which
enables the NMT model to only focus on the relevant sense type
of the input word in current context. Experiments show that the
proposed model achieves substantial improvements on every test
set over competitive baselines. Our contributions come from twofold.
Firstly, to the best of our knowledge, this is the first effort to
introduce the multi-sense representation, which represents each
sense type of the word with a sense-specific embedding, into
NMT. Secondly, We propose a sense search module which can
detect the sense type of the word automatically. Flexibility and
versatility are the most attractive characteristic of the proposed
sense search module. It can be applied to any other semantic
related NLP tasks with little modification.
内容类型会议论文
源URL[http://ir.ia.ac.cn/handle/173211/41018]  
专题数字内容技术与服务研究中心_听觉模型与认知计算
通讯作者Chen W(陈炜)
推荐引用方式
GB/T 7714
Yang Z,Chen W,Wang F,et al. Multi-sense based neural machine translation[C]. 见:. Anchorage, AK, USA. 2017-5-4.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace