YNAO OpenIR  > 其他
Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap
Liu YB(刘应波)1,2; Dai, Huimei1; Wang F(王锋)1,2; Dai W(戴伟)1; Deng, Hui1
Source PublicationIEEE International Conference on Systems Man and Cybernetics Conference Proceedings - 2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS
2015
Pages1567-1572
DOI10.1109/SMC.2015.277
Author of SourceIEEE
Contribution Rank第2完成单位
Indexed ByCPCI
Conference NameIEEE International Conference on Systems, Man, and Cybernetics (SMC)
Conference Date2015-10-09
Conference PlaceCity Univ Hong Kong, Hong Kong, PEOPLES R CHINA
Conference SponsorIEEE; IEEE Comp Soc; IEEE Syst Man & Cybernet Soc; Hong Kong Polytechn Univ; K C Wong Fdn
KeywordWord-aligned Hybrid Bitmap Fastbit Indexing Nosql
Abstract

New Vacuum Solar Telescope (NVST) possesses a world-class solar telescope which observes the sun by high-resolution image instruments and multi-wave spectrometer in visible and near infrared bands. NVST has gathered millions of Flexible Image Transport System(FITS) files since it has been for the routine observation and thousands of files are generated in a day. To search efficiently for a subset of these extremely large and linearly increasing FITS files with low latency and response time goes beyond traditional database systems. In this paper, We present an NVST indexing and querying framework(NIQF) based on an implementation of word-aligned hybrid bitmaps to deal with the issue, and design several simple and useful APIs, which are convenient for integrating with NVST data archiving system and meet the requirements of fast data indexing of massive data processing in NVST. We study the performance of NIQF by comparing with MySQL. The results demonstrate that the performance of NIQF is more efficient than MySQL in a huge amount of solar data set. This study indicates potential performance and feasibility of NIQF for large astronomical data indexing and querying in NVST.

Funding ProjectNational Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[11263004] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018]
Funding OrganizationNational Natural Science Foundation of China ; Natural Science Foundation of Yunnan Province
Language英语
Subject Area计算机科学技术
MOST Discipline Catalogue工学 ; 工学::计算机科学与技术(可授工学、理学学位)
SubtypeProceedings Paper
PublisherIEEE COMPUTER SOC
Publication Place10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
ISBN978-1-4799-8696-5
ISSN1062-922X
URL查看原文
WOS IDWOS:000368940201109
WOS Research AreaComputer Science
WOS SubjectComputer Science, Cybernetics ; Computer Science, Information Systems ; Computer Science, Theory & Methods
WOS KeywordHigh-resolution ; Framework ; Science
Citation statistics
Document Type会议论文
Identifierhttp://ir.ynao.ac.cn/handle/114a53/9694
Collection其他
Corresponding AuthorLiu YB(刘应波)
Affiliation1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Kunming 650500, China
2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China
First Author AffilicationYunnan Observatories, Chinese Academy of Sciences
Corresponding Author AffilicationYunnan Observatories, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Liu YB,Dai, Huimei,Wang F,et al. Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap[C]//IEEE. 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA:IEEE COMPUTER SOC,2015:1567-1572.
Files in This Item:
File Name/Size DocType Version Access License
Efficient Indexing a(312KB)会议论文 开放获取CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liu YB(刘应波)]'s Articles
[Dai, Huimei]'s Articles
[Wang F(王锋)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liu YB(刘应波)]'s Articles
[Dai, Huimei]'s Articles
[Wang F(王锋)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liu YB(刘应波)]'s Articles
[Dai, Huimei]'s Articles
[Wang F(王锋)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.