QQ客服 官方微博 反馈留言

	Hadoop 副本放置策略; Research on the replica placement strategy of Hadoop
	邵秀丽 ; 王亚光 ; 李云龙 ; 刘一伟
	2013
关键词	云存储 副本放置 存储均衡 存储节点 Hdfs cloud storage Hdfs replica placement storage equilibrium storage node
英文摘要	分布式文件系统（ Hdfs）采用随机的副本放置策略使得系统在运行一段时间后会出现数据分布不均衡的情况，从而降低数据的可靠性和读取速率。为解决Hdfs默认副本放置策略存在的问题，对Hdfs副本放置策略进行改进：在副本放置选择时优先考虑存储使用率低的节点。模拟实验一测试了机架数目对于算法的影响，结果显示改进后的副本放置策略中，机架数目对集群的均衡性影响很小，显示出较好的均衡性。模拟实验二测试了随着写入数据的增加，比较了使用改进前后的副本放置策略集群中节点使用率的标准差，证实了改进后的副本放置策略在存储均衡方面较原放置策略有着更好的表现。; Hadoop distributed file system applies the random replica placement strategy , which causes unbalanced data distribution after the system has operated for a while , resulting in lowering the data reliability and reading speed .In order to eliminate the defect of the replica placement strategy defaulted by the Hdfs , the strategy was im-proved .When the placement location of a replica is selected , a node with a low storage and use rate will be consid-ered as a priority .The first simulation experiment tested the effects caused by the number of racks on the algorithm . The results show that , for the improved replica placement strategy , the number of racks has little impact on the e-quilibrium of the group , the equilibrium is excellent .The second simulation experiment compared the standard difference of the node usage rates between the replica placement strategy groups before and after and found an im -provement following the increase of the data input .The results verify that the improved replica placement strategy has better performance with respect to storage equilibrium .; 天津市滨海新区科技项目资助项目(12ZCDZGX46700、13ZCZDGX02500)．; 中文核心期刊要目总览(PKU); 中国科技核心期刊(ISTIC); 中国科学引文数据库(CSCD); 0; 6; 489-496
语种	中文
出处	万方 ; 知网 ; http://d.g.wanfangdata.com.cn/Periodical_xdkjyc201306004.aspx
出版者	智能系统学报
内容类型	其他
源URL	[http://hdl.handle.net/20.500.11897/235898]
专题	数学科学学院
推荐引用方式 GB/T 7714	邵秀丽,王亚光,李云龙,等. Hadoop 副本放置策略, Research on the replica placement strategy of Hadoop. 2013-01-01.

个性服务

查看访问统计

相关权益政策

暂无数据

收藏/分享

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。