Mamr: high-performance mapreduce programming model for material cloud applications | |
Jing, Weipeng1; Tong, Danyu1; Wang, Yangang2; Wang, Jingyuan3; Liu, Yaqiu1; Zhao, Peng1 | |
刊名 | Computer physics communications
![]() |
2017-02-01 | |
卷号 | 211页码:79-87 |
关键词 | Materials Programming model Mapreduce Bsp Merge phase |
ISSN号 | 0010-4655 |
DOI | 10.1016/j.cpc.2016.07.015 |
通讯作者 | Wang, yangang(wangyg@sccas.cn) |
英文摘要 | With the increasing data size in materials science, existing programming models no longer satisfy the application requirements. mapreduce is a programming model that enables the easy development of scalable parallel applications to process big data on cloud computing systems. however, this model does not directly support the processing of multiple related data, and the processing performance does not reflect the advantages of cloud computing. to enhance the capability of workflow applications in material data processing, we defined a programming model for material cloud applications that supports multiple different map and reduce functions running concurrently based on hybrid share-memory bsp called mamr. an optimized data sharing strategy to supply the shared data to the different map and reduce stages was also designed. we added a new merge phase to mapreduce that can efficiently merge data from the map and reduce modules. experiments showed that the model and framework present effective performance improvements compared to previous work. (c) 2016 elsevier b.v. all rights reserved. |
WOS研究方向 | Computer Science ; Physics |
WOS类目 | Computer Science, Interdisciplinary Applications ; Physics, Mathematical |
语种 | 英语 |
出版者 | ELSEVIER SCIENCE BV |
WOS记录号 | WOS:000390181300012 |
内容类型 | 期刊论文 |
URI标识 | http://www.corc.org.cn/handle/1471x/2374190 |
专题 | 计算机网络信息中心 |
通讯作者 | Wang, Yangang |
作者单位 | 1.Northeast Forestry Univ, Coll Informat & Comp Engn, Harbin, Peoples R China 2.Chinese Acad Sci, Comp Network Informat Ctr, Beijing, Peoples R China 3.Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Jing, Weipeng,Tong, Danyu,Wang, Yangang,et al. Mamr: high-performance mapreduce programming model for material cloud applications[J]. Computer physics communications,2017,211:79-87. |
APA | Jing, Weipeng,Tong, Danyu,Wang, Yangang,Wang, Jingyuan,Liu, Yaqiu,&Zhao, Peng.(2017).Mamr: high-performance mapreduce programming model for material cloud applications.Computer physics communications,211,79-87. |
MLA | Jing, Weipeng,et al."Mamr: high-performance mapreduce programming model for material cloud applications".Computer physics communications 211(2017):79-87. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论