Improved word similarity computation for Chinese using sub-word information | |
Jin, Peng ; John, Carroll ; Wu, Yunfang ; McCarthy, Diana | |
2011 | |
英文摘要 | In the Chinese language, words consist of characters each of which is composed of one or more components. Almost every individual Chinese character has a specific meaning, and the meaning of a word is usually highly related to the characters that comprise it. Likewise, sub-character components often make a predictable contribution to the meaning of a character, and in general characters that have the same components have similar or related meanings. It is easy to automatically decompose words into characters and their components. In this paper, we improve on a corpus-based approach to computing word similarity in Chinese by extending it according to the characters and components shared between words. In an evaluation on 30, 000 word types (noun, verb and adjective), we obtain a 39% relative improvement compared with a state-of-the-art baseline. ? 2011 IEEE.; EI; 0 |
语种 | 英语 |
DOI标识 | 10.1109/CIS.2011.108 |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/412932] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Jin, Peng,John, Carroll,Wu, Yunfang,et al. Improved word similarity computation for Chinese using sub-word information. 2011-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论