A Service Framework for Scientific Workflow Management in the Cloud

doi:10.1109/TSC.2014.2341235

CORC > 计算技术研究所 > 中国科学院计算技术研究所 > 中国科学院计算技术研究所期刊论文 > 英文

	A Service Framework for Scientific Workflow Management in the Cloud
	Zhao, Yong 2; Li, Youfu 2; Raicu, Ioan 1; Lu, Shiyong 3; Lin, Cui 4; Zhang, Yanzhe 5; Tian, Wenhong 2; Xue, Ruini 2
刊名	IEEE TRANSACTIONS ON SERVICES COMPUTING
	2015-11-01
卷号	8 期号:6 页码:930-944
关键词	Cloud workflow cloud resource management reference service framework swift virtual cluster provisioning workflow-as-a-service
ISSN号	1939-1374
DOI	10.1109/TSC.2014.2341235
英文摘要	Cloud computing is an emerging computing paradigm that can offer unprecedented scalability and resources on demand, and is getting more and more adoption in the science community, while scientific workflow management systems provide essential support such as management of data and task dependencies, job scheduling and execution, provenance tracking, etc., to scientific computing. As we are entering into a "big data" era, it is imperative to migrate scientific workflow management systems into the cloud to manage the ever increasing data scale and analysis complexity. We propose a reference service framework for integrating scientific workflow management systems into various cloud platforms, which consists of eight major components, including Cloud Workflow Management Service, Cloud Resource Manager, etc., and six interfaces between them. We also present a reference framework for the implementation of Cloud Resource Manager, which is responsible for the provisioning and management of virtual resources in the cloud. We discuss our implementation of the framework by integrating the Swift scientific workflow management system with the OpenNebula and Eucalyptus cloud platforms, and demonstrate the capability of the solution using a NASA MODIS image processing workflow and a production deployment on the Science@Guoshi network with support for the Montage image mosaic workflow.
资助项目	National Science Foundation of China[61272528] ; National Science Foundation of China[61034005] ; Central University Fund[ID-ZYGX2013J073]
WOS研究方向	Computer Science
语种	英语
出版者	IEEE COMPUTER SOC
WOS记录号	WOS:000367007100010
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/9059]
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhao, Yong
作者单位	1.IIT, Dept Comp Sci, Chicago, IL 60616 USA 2.Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China 3.Wayne State Univ, Dept Comp Sci, Detroit, MI 48202 USA 4.Calif State Univ Fresno, Dept Comp Sci, Sunnyvale, CA 94086 USA 5.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Zhao, Yong,Li, Youfu,Raicu, Ioan,et al. A Service Framework for Scientific Workflow Management in the Cloud[J]. IEEE TRANSACTIONS ON SERVICES COMPUTING,2015,8(6):930-944.
APA	Zhao, Yong.,Li, Youfu.,Raicu, Ioan.,Lu, Shiyong.,Lin, Cui.,...&Xue, Ruini.(2015).A Service Framework for Scientific Workflow Management in the Cloud.IEEE TRANSACTIONS ON SERVICES COMPUTING,8(6),930-944.
MLA	Zhao, Yong,et al."A Service Framework for Scientific Workflow Management in the Cloud".IEEE TRANSACTIONS ON SERVICES COMPUTING 8.6(2015):930-944.