YNAO OpenIR  > 其他
Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph
Wang F(王锋)1,2,3; Mei, Y1; Deng, H1; Wang, W4; Liu, CY1; Liu, DH4; Wei SL(卫守林)1,2,3; Dai W(戴伟)1,2,3; Liang, B1; Liu YB(刘应波)1,2,3; Zhang, XL1; Ji, KF1
Source PublicationPUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC
2015-04
Volume127Issue:950Pages:383-396
DOI10.1086/680852
Contribution Rank第3完成单位
Indexed BySCI
Abstract

The Mingantu Ultrawide Spectral Radioheliograph (MUSER) is a synthetic-aperture radio interferometer built in Ming'antu, Inner Mongolia, China. As a solar-dedicated interferometric array, the MUSER can produce high-quality radio images in a frequency range of 400 MHz-15 GHz with high temporal, spatial, and spectral resolution. Implementing of the data processing system for the MUSER is a major challenge to performing high-cadence imaging in wideband and obtaining more than two orders of higher multiple frequencies. There is an urgent need to build a pipeline for processing the massive amount of MUSER data generated each day. In this article, we present a high-performance distributed data processing pipeline (DDPP) built on the OpenCluster infrastructure for processing MUSER observational data, including data storage, preprocessing, image reconstruction, deconvolution, archiving, and real-time monitoring. We comprehensively elaborate the system architecture of the pipeline and the implementation of each subsystem. The DDPP is automatic, robust, scalable, and manageable. The processing performance under a parallel CPU/GPU hybrid system meets the requirements of MUSER data processing.

Funding ProjectNational Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[61462053] ; National Natural Science Foundation of China[1263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018]
Funding OrganizationNational Natural Science Foundation of China[U1231205, 61462053, 1263004, 11203011, 11163004, 11103005] ; Natural Science Foundation of Yunnan Province[2013FA013, 2013FA032, 2013FZ018]
Language英语
Subject Area天文学 ; 天文学其他学科 ; 计算机科学技术
MOST Discipline Catalogue理学 ; 理学::天文学 ; 工学 ; 工学::计算机科学与技术(可授工学、理学学位)
SubtypeArticle
PublisherUNIV CHICAGO PRESS
Publication Place1427 E 60TH ST, CHICAGO, IL 60637-2954 USA
ISSN0004-6280
URL查看原文
WOS IDWOS:000352231000007
WOS Research AreaAstronomy & Astrophysics
WOS SubjectAstronomy & Astrophysics
WOS KeywordFASTBIT
Citation statistics
Cited Times:6[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ynao.ac.cn/handle/114a53/4265
Collection其他
Corresponding AuthorWang F(王锋)
Affiliation1.Computer Technology Application Key Lab of Yunnan Province, Kunming
2.University of Chinese Academy of Sciences, Beijing 100049, China
3.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011,
4.Chinese National Observatory, Chinese Academy of Sciences, Beijing
First Author AffilicationYunnan Observatories, Chinese Academy of Sciences
Corresponding Author AffilicationYunnan Observatories, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Wang F,Mei, Y,Deng, H,et al. Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph[J]. PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,2015,127(950):383-396.
APA Wang F.,Mei, Y.,Deng, H.,Wang, W.,Liu, CY.,...&Ji, KF.(2015).Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph.PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,127(950),383-396.
MLA Wang F,et al."Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph".PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC 127.950(2015):383-396.
Files in This Item:
File Name/Size DocType Version Access License
Distributed Data-Pro(623KB)期刊论文出版稿开放获取CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang F(王锋)]'s Articles
[Mei, Y]'s Articles
[Deng, H]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang F(王锋)]'s Articles
[Mei, Y]'s Articles
[Deng, H]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang F(王锋)]'s Articles
[Mei, Y]'s Articles
[Deng, H]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.