High-performance Negative Database for Massive Data Management System of The Mingantu Spectral Radioheliograph

CORC > 云南天文台 > 中国科学院云南天文台 > 其他

	High-performance Negative Database for Massive Data Management System of The Mingantu Spectral Radioheliograph
	Shi, Congming 1; Wang, Feng 1,2; Deng, Hui 3; Liu, Yingbo4 ; Liu, Cuiyin 3; Wei, Shoulin3 ; Wang F(王锋)
刊名	PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC
	2017-08-01
卷号	129 期号:978
关键词	massive data management MUSER-astronomical instrument
ISSN号	0004-6280
通讯作者	Wang, Feng(Kunming Univ Sci & Technol, Key Lab Comp Technol Applicat Yunnan Prov, Fac Econ & Management, 747 Jingming Nan Rd,Chenggong Campus, Kunming 650500, Yunnan, Peoples R China)
产权排序	第2完成单位
英文摘要	As a dedicated synthetic aperture radio interferometer in China, the MingantU SpEctral Radioheliograph (MUSER), initially known as the Chinese Spectral RadioHeliograph (CSRH), has entered the stage of routine observation. More than 23 million data records per day need to be effectively managed to provide high-performance data query and retrieval for scientific data reduction. In light of these massive amounts of data generated by the MUSER, in this paper, a novel data management technique called the negative database (ND) is proposed and used to implement a data management system for the MUSER. Based on the key-value database, the ND technique makes complete utilization of the complement set of observational data to derive the requisite information. Experimental results showed that the proposed ND can significantly reduce storage volume in comparison with a relational database management system (RDBMS). Even when considering the time needed to derive records that were absent, its overall performance, including querying and deriving the data of the ND, is comparable with that of a relational database management system (RDBMS). The ND technique effectively solves the problem of massive data storage for the MUSER and is a valuable reference for the massive data management required in next-generation telescopes.
学科主题	天文学
WOS标题词	Science & Technology ; Physical Sciences
类目[WOS]	Astronomy & Astrophysics
研究领域[WOS]	Astronomy & Astrophysics
关键词[WOS]	LOFAR
收录类别	SCI
原文出处	http://stacks.iop.org/1538-3873/129/i=978/a=084501?key=crossref.957f9b8875a1c4cb3a8e66c9d56764d3
语种	英语
WOS记录号	WOS:000404352100001
内容类型	期刊论文
源URL	[http://ir.ynao.ac.cn/handle/114a53/10140]
专题	云南天文台_其他
通讯作者	Wang F(王锋)
作者单位	1.Kunming Univ Sci & Technol, Key Lab Comp Technol Applicat Yunnan Prov, Fac Econ & Management, 747 Jingming Nan Rd,Chenggong Campus, Kunming 650500, Yunnan, Peoples R China 2.Chinese Acad Sci, Yunnan Observ, Kunming 650011, Yunnan, Peoples R China 3.Kunming Univ Sci & Technol, Key Lab Comp Technol Applicat Yunnan Prov, 747 Jingming Nan Rd,Chenggong Campus, Kunming 650500, Yunnan, Peoples R China 4.Yunnan Acad Sci & Tech Informat, Kunming 650051, Yunnan, Peoples R China
推荐引用方式 GB/T 7714	Shi, Congming,Wang, Feng,Deng, Hui,et al. High-performance Negative Database for Massive Data Management System of The Mingantu Spectral Radioheliograph[J]. PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,2017,129(978).
APA	Shi, Congming.,Wang, Feng.,Deng, Hui.,Liu, Yingbo.,Liu, Cuiyin.,...&Wang F.(2017).High-performance Negative Database for Massive Data Management System of The Mingantu Spectral Radioheliograph.PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,129(978).
MLA	Shi, Congming,et al."High-performance Negative Database for Massive Data Management System of The Mingantu Spectral Radioheliograph".PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC 129.978(2017).