YNAO OpenIR  > 其他
Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap
Liu YB(刘应波)1,2; Dai, Huimei1; Wang F(王锋)1,2; Dai W(戴伟)1; Deng, Hui1
会议录名称IEEE International Conference on Systems Man and Cybernetics Conference Proceedings - 2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS
2015
页码1567-1572
DOI10.1109/SMC.2015.277
会议录编者/会议主办者IEEE
产权排序第2完成单位
收录类别CPCI
会议名称IEEE International Conference on Systems, Man, and Cybernetics (SMC)
会议日期2015-10-09
会议地点City Univ Hong Kong, Hong Kong, PEOPLES R CHINA
会议赞助商IEEE; IEEE Comp Soc; IEEE Syst Man & Cybernet Soc; Hong Kong Polytechn Univ; K C Wong Fdn
关键词Word-aligned Hybrid Bitmap Fastbit Indexing Nosql
摘要

New Vacuum Solar Telescope (NVST) possesses a world-class solar telescope which observes the sun by high-resolution image instruments and multi-wave spectrometer in visible and near infrared bands. NVST has gathered millions of Flexible Image Transport System(FITS) files since it has been for the routine observation and thousands of files are generated in a day. To search efficiently for a subset of these extremely large and linearly increasing FITS files with low latency and response time goes beyond traditional database systems. In this paper, We present an NVST indexing and querying framework(NIQF) based on an implementation of word-aligned hybrid bitmaps to deal with the issue, and design several simple and useful APIs, which are convenient for integrating with NVST data archiving system and meet the requirements of fast data indexing of massive data processing in NVST. We study the performance of NIQF by comparing with MySQL. The results demonstrate that the performance of NIQF is more efficient than MySQL in a huge amount of solar data set. This study indicates potential performance and feasibility of NIQF for large astronomical data indexing and querying in NVST.

资助项目National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[11263004] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018]
项目资助者National Natural Science Foundation of China ; Natural Science Foundation of Yunnan Province
语种英语
学科领域计算机科学技术
学科门类工学 ; 工学::计算机科学与技术(可授工学、理学学位)
文章类型Proceedings Paper
出版者IEEE COMPUTER SOC
出版地10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
ISBN号978-1-4799-8696-5
ISSN号1062-922X
URL查看原文
WOS记录号WOS:000368940201109
WOS研究方向Computer Science
WOS类目Computer Science, Cybernetics ; Computer Science, Information Systems ; Computer Science, Theory & Methods
关键词[WOS]High-resolution ; Framework ; Science
引用统计
文献类型会议论文
条目标识符http://ir.ynao.ac.cn/handle/114a53/9694
专题其他
通讯作者Liu YB(刘应波)
作者单位1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Kunming 650500, China
2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China
推荐引用方式
GB/T 7714
Liu YB,Dai, Huimei,Wang F,et al. Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap[C]//IEEE. 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA:IEEE COMPUTER SOC,2015:1567-1572.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Efficient Indexing a(312KB)会议论文 开放获取CC BY-NC-SA浏览 请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Liu YB(刘应波)]的文章
[Dai, Huimei]的文章
[Wang F(王锋)]的文章
百度学术
百度学术中相似的文章
[Liu YB(刘应波)]的文章
[Dai, Huimei]的文章
[Wang F(王锋)]的文章
必应学术
必应学术中相似的文章
[Liu YB(刘应波)]的文章
[Dai, Huimei]的文章
[Wang F(王锋)]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。