HARL: Optimizing Parallel File Systems with Heterogeneity-Aware Region-Level Data Layout.

	HARL: Optimizing Parallel File Systems with Heterogeneity-Aware Region-Level Data Layout.
	Shuibing He; Yang Wang; Xian-He Sun; Chengzhong Xu
刊名	IEEE Transactions on Computers
	2017
文献子类	期刊论文
英文摘要	Parallel file system (PFS) is commonly used in high-end computing systems. With the emergence of solid state drives (SSDs), hybrid PFS, which consists of both HDD and SSD servers, provides a practical I/O system solution for data-intensive applications. However, most existing data layout schemes are inefficient for hybrid PFS due to their unawareness of server heterogeneities and workload changes in different parts of a file. In this study, we propose a heterogeneity-aware region-level data layout scheme, HARL, to improve the data distribution of a hybrid PFS. HARL first divides a file into fine-grained, varying sized regions according to the workload features of an application, then determines appropriate file stripe sizes on servers for each region based on the performance of heterogeneous servers. Furthermore, to further improve the performance of a hybrid PFS, we propose a dynamic region-level layout scheme, HARL-D, which creates multiple replicas for each region and redirects file requests to the proper replicas with the lowest access costs at the runtime. Experimental results of representative benchmarks and a real application show that HARL can greatly improve I/O system performance, and demonstrate the advantages of HARL-D over HARL.
URL标识	查看原文
语种	英语
内容类型	期刊论文
源URL	[http://ir.siat.ac.cn:8080/handle/172644/12519]
专题	深圳先进技术研究院_数字所
作者单位	IEEE Transactions on Computers
推荐引用方式 GB/T 7714	Shuibing He,Yang Wang,Xian-He Sun,et al. HARL: Optimizing Parallel File Systems with Heterogeneity-Aware Region-Level Data Layout.[J]. IEEE Transactions on Computers,2017.
APA	Shuibing He,Yang Wang,Xian-He Sun,&Chengzhong Xu.(2017).HARL: Optimizing Parallel File Systems with Heterogeneity-Aware Region-Level Data Layout..IEEE Transactions on Computers.
MLA	Shuibing He,et al."HARL: Optimizing Parallel File Systems with Heterogeneity-Aware Region-Level Data Layout.".IEEE Transactions on Computers (2017).