YNAO OpenIR  > 其他
Investigation on distributed file system for scientific big data storage
Liu YB(刘应波)1,2; Wang F(王锋)1,2; Deng, Hui2; Ji, KF2; Dai W(戴伟)1,2
Source PublicationICIC Express Letters, Part B: Applications
2015
Volume6Issue:9Pages:2577-2582
Contribution Rank第1完成单位
Indexed ByEI
KeywordBig Data Distributed Computer Systems Storage
Abstract

With the quick development of new-generation scientific instruments, the storage of an unprecedented amount of scientific data (e.g., more than 14 exabytes per day in the SKA project) is becoming a critical problem. The amount of scientific data is growing at an exponential rate and doubling approximately every year. Traditional data storage techniques such as DAS, NAS and SAN, are impossible to fully meet the data access requirements because of the low access performance, limited scalability and weak availability. After the development for tens of years, distributed storage technology is re-garded as the most appropriate technology for massive scientific data storage and archive. In order to further promote the advancements of the distributed storage technology, in this paper, we make a deep investigation on the distributed file system (DFS). We discuss the general architecture of the DFS and describe the implementation of current four mainstream distributed file systems respectively in detail. We then compare several im- portant features of each DFS, and discuss the application situation of each DFS. Finally, we present a series of research directions for future studies of scientific data storage. The study presents a valuable reference for other studies, and also gives a valuable contribution to the current and/or future data intensive storage.

Funding ProjectN/A
Funding OrganizationN/A
Language英语
Subject Area计算机科学技术 ; 计算机软件 ; 计算机应用
MOST Discipline Catalogue工学 ; 工学::计算机科学与技术(可授工学、理学学位)
SubtypeJournal article (JA)
PublisherICIC Express Letters Office
ISSN2185-2766
Archive Date2015-11-27
EI Accession Number20153301170287
EI KeywordsBig data
EI Classification Number702Electric Batteries and Fuel Cells - 722.1Data Storage, Equipment and Techniques - 722.4Digital Computers and Systems - 723.3Database Systems
Document Type期刊论文
Identifierhttp://ir.ynao.ac.cn/handle/114a53/9678
Collection其他
Affiliation1.Yunnan Observatories, Chinese Academy of Sciences University of Chinese Academy of Sciences, P.O.Box110, Kunming, China
2.Computer Technology Application Key Lab of Yunnan Province Kunming, University of Science and Technology, No. 727, Jingming South Road, Chenggong District, Kunming, China
First Author AffilicationYunnan Observatories, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Liu YB,Wang F,Deng, Hui,et al. Investigation on distributed file system for scientific big data storage[J]. ICIC Express Letters, Part B: Applications,2015,6(9):2577-2582.
APA Liu YB,Wang F,Deng, Hui,Ji, KF,&Dai W.(2015).Investigation on distributed file system for scientific big data storage.ICIC Express Letters, Part B: Applications,6(9),2577-2582.
MLA Liu YB,et al."Investigation on distributed file system for scientific big data storage".ICIC Express Letters, Part B: Applications 6.9(2015):2577-2582.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liu YB(刘应波)]'s Articles
[Wang F(王锋)]'s Articles
[Deng, Hui]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liu YB(刘应波)]'s Articles
[Wang F(王锋)]'s Articles
[Deng, Hui]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liu YB(刘应波)]'s Articles
[Wang F(王锋)]'s Articles
[Deng, Hui]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.