QQ客服 官方微博 反馈留言

	A MapReduce approach to Gi*(d) spatial statistic
	Liu, Yan ; Wu, Kaichao ; Wang, Shaowen ; Zhao, Yanli ; Huang, Qian
	2010
英文摘要	Managing and analyzing massive spatial datasets as supported by GIS and spatial analysis is becoming crucial to geospatial problem-solving and decision-making. MapReduce provides a data-centric computational model through which highly scalable spatial analysis computation can be achieved. However, it is challenging to leverage multi-dimensional spatial characteristics on the horizontally-partitioned and transparently managed MapReduce data system for improving the computational performance of spatial analysis. This paper tackles this challenge through the development of MapReduce-based computation of G i*(d) - a spatial statistic for detecting local clustering. Without exploiting spatial characteristics, Gi* (d) computation for a particular location requires pair-wise distance calculation for all points of a given dataset. A spatial locality-based storage and indexing strategy is developed to associate spatial locality with storage locality on MapReduce platform. Based on a spatial indexing method, unnecessary map tasks can be eliminated for a MapReduce job, thus significantly improving the overall computation performance. To leverage underlying parallelism on storage nodes, an application-level load balancing mechanism is developed to produce even loads among map tasks based on adaptive spatial domain decomposition. Experiments show the effectiveness of the developed storage and indexing strategy with different distance parameter settings. Significant reduction on execution time for all-point computation is observed through the use of the application-level load balancing mechanism. Copyright 2010 ACM.; EI; 0
语种	英语
DOI标识	10.1145/1869692.1869695
内容类型	其他
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/329753]
专题	地球与空间科学学院
推荐引用方式 GB/T 7714	Liu, Yan,Wu, Kaichao,Wang, Shaowen,et al. A MapReduce approach to Gi*(d) spatial statistic. 2010-01-01.

个性服务

查看访问统计

相关权益政策

暂无数据

收藏/分享

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。