Parray: A unifying array representation for heterogeneous parallelism | |
Chen, Yifeng ; Cui, Xiang ; Mei, Hong | |
2012 | |
英文摘要 | This paper introduces a programming interface called PARRAY (or Parallelizing ARRAYs) that supports system-level succinct programming for heterogeneous parallel systems like GPU clusters. The current practice of software development requires combining several low-level libraries like Pthread, OpenMP, CUDA and MPI. Achieving productivity and portability is hard with different numbers and models of GPUs. PARRAY extends mainstream C programming with novel array types of the following features: 1) the dimensions of an array type are nested in a tree structure, conceptually reflecting the memory hierarchy; 2) the definition of an array type may contain references to other array types, allowing sophisticated array types to be created for parallelization; 3) threads also form arrays that allow programming in a Single-Program-Multiple-Codeblock (SPMC) style to unify various sophisticated communication patterns. This leads to shorter, more portable and maintainable parallel codes, while the programmer still has control over performance-related features necessary for deep manual optimization. Although the source-to-source code generator only faithfully generates low-level library calls according to the type information, higher-level programming and automatic performance optimization are still possible through building libraries of sub-programs on top of PARRAY. The case study on cluster FFT illustrates a simple 30-line code that 2x-outperforms Intel Cluster MKL on the Tianhe-1A system with 7168 Fermi GPUs and 14336 CPUs. Copyright ? 2012 ACM.; EI; 8; 171-180; 47 |
语种 | 英语 |
DOI标识 | 10.1145/2370036.2145838 |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/461451] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Chen, Yifeng,Cui, Xiang,Mei, Hong. Parray: A unifying array representation for heterogeneous parallelism. 2012-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论