AUGMENTED MUTUAL INFORMATION FOR MULTI-WORD EXTRACTION | |
Zhang, Wen1; Yoshida, Taketoshi1; Ho, Tu Bao1; Tang, Xijin2 | |
刊名 | INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL |
2009-02-01 | |
卷号 | 5期号:2页码:543-554 |
关键词 | Multi-word extraction Mutual information Augmented mutual information Word dependency |
ISSN号 | 1349-4198 |
英文摘要 | In order to extract multi-words from documents, mutual information (MI), as a statistical method, is the most popular solution under consideration. However, there are two kinds of deficiencies inherent in MI. One is the problem of unilateral co-occurrence, and the other is rare occurrence problem. To attack these two problems, augmented mutual information (AMI) is proposed in this paper to measure word dependency for multi-word extraction. We prove theoretically that AMI has the capacity to approximate MI to capture the independency of individual words, but it will amplify the significance of dependent individual words which may be possible multi-words. And our experimental results on Chinese multi-word extraction demonstrate that AMI method has superior performance to traditional MI method. |
资助项目 | Ministry of Education, Culture, Sports, Science and Technology of Japan ; National Natural Science Foundation of China[70571078] ; National Natural Science Foundation of China[70221001] |
WOS研究方向 | Automation & Control Systems ; Computer Science |
语种 | 英语 |
出版者 | ICIC INT |
WOS记录号 | WOS:000263795500028 |
内容类型 | 期刊论文 |
源URL | [http://ir.amss.ac.cn/handle/2S8OKBNM/7439] |
专题 | 中国科学院数学与系统科学研究院 |
通讯作者 | Zhang, Wen |
作者单位 | 1.Japan Adv Inst Sci & Technol, Sch Knowledge Sci, Nomi, Ishikawa 9231292, Japan 2.Chinese Acad Sci, Inst Syst Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China |
推荐引用方式 GB/T 7714 | Zhang, Wen,Yoshida, Taketoshi,Ho, Tu Bao,et al. AUGMENTED MUTUAL INFORMATION FOR MULTI-WORD EXTRACTION[J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL,2009,5(2):543-554. |
APA | Zhang, Wen,Yoshida, Taketoshi,Ho, Tu Bao,&Tang, Xijin.(2009).AUGMENTED MUTUAL INFORMATION FOR MULTI-WORD EXTRACTION.INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL,5(2),543-554. |
MLA | Zhang, Wen,et al."AUGMENTED MUTUAL INFORMATION FOR MULTI-WORD EXTRACTION".INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL 5.2(2009):543-554. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论