PARRAY: A Unifying Array Representation for Heterogeneous Parallelism

doi:10.1145/2370036.2145838

CORC > 北京大学 > 信息科学技术学院

	PARRAY: A Unifying Array Representation for Heterogeneous Parallelism
	Chen, Yifeng ; Cui, Xiang ; Mei, Hong
刊名	acm sigplan notices
	2012
关键词	Languages Performance Theory Parallel Programming Array Representation Heterogeneous Parallelism GPU Clusters
DOI	10.1145/2370036.2145838
英文摘要	This paper introduces a programming interface called PARRAY (or Parallelizing ARRAYs) that supports system-level succinct programming for heterogeneous parallel systems like GPU clusters. The current practice of software development requires combining several low-level libraries like Pthread, OpenMP, CUDA and MPI. Achieving productivity and portability is hard with different numbers and models of GPUs. PARRAY extends mainstream C programming with novel array types of the following features:1)the dimensions of an array type are nested in a tree structure, conceptually reflecting the memory hierarchy; 2) the definition of an array type may contain references to other array types, allowing sophisticated array types to be created for parallelization; 3) threads also form arrays that allow programming in a Single-Program Multiple-Code block (SPMC) style to unify various sophisticated communication patterns. This leads to shorter, more portable and maintainable parallel codes, while the programmer still has control over performance-related features necessary for deep manual optimization. Although the source-to-source code generator only faithfully generates low-level library calls according to the type information,higher-level programming and automatic performance optimization are still possible through building libraries of subprograms on top of PARRAY. The case study on cluster FFT illustrates a simple 30-line code that 2x-outperforms Intel Cluster MKL on the Tianhe-1A system with 7168 Fermi GPUs and 14336 CPUs.; Computer Science, Software Engineering; SCI(E); EI; 0; ARTICLE; 8; 171-180; 47
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/393075]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Chen, Yifeng,Cui, Xiang,Mei, Hong. PARRAY: A Unifying Array Representation for Heterogeneous Parallelism[J]. acm sigplan notices,2012.
APA	Chen, Yifeng,Cui, Xiang,&Mei, Hong.(2012).PARRAY: A Unifying Array Representation for Heterogeneous Parallelism.acm sigplan notices.
MLA	Chen, Yifeng,et al."PARRAY: A Unifying Array Representation for Heterogeneous Parallelism".acm sigplan notices (2012).