Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph | |
Wang F(王锋)1,2,3![]() ![]() ![]() ![]() ![]() ![]() ![]() | |
Source Publication | PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC
![]() |
2015-04 | |
Volume | 127Issue:950Pages:383-396 |
DOI | 10.1086/680852 |
Contribution Rank | 第3完成单位 |
Indexed By | SCI |
Abstract | The Mingantu Ultrawide Spectral Radioheliograph (MUSER) is a synthetic-aperture radio interferometer built in Ming'antu, Inner Mongolia, China. As a solar-dedicated interferometric array, the MUSER can produce high-quality radio images in a frequency range of 400 MHz-15 GHz with high temporal, spatial, and spectral resolution. Implementing of the data processing system for the MUSER is a major challenge to performing high-cadence imaging in wideband and obtaining more than two orders of higher multiple frequencies. There is an urgent need to build a pipeline for processing the massive amount of MUSER data generated each day. In this article, we present a high-performance distributed data processing pipeline (DDPP) built on the OpenCluster infrastructure for processing MUSER observational data, including data storage, preprocessing, image reconstruction, deconvolution, archiving, and real-time monitoring. We comprehensively elaborate the system architecture of the pipeline and the implementation of each subsystem. The DDPP is automatic, robust, scalable, and manageable. The processing performance under a parallel CPU/GPU hybrid system meets the requirements of MUSER data processing. |
Funding Project | National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[61462053] ; National Natural Science Foundation of China[1263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018] |
Funding Organization | National Natural Science Foundation of China[U1231205, 61462053, 1263004, 11203011, 11163004, 11103005] ; Natural Science Foundation of Yunnan Province[2013FA013, 2013FA032, 2013FZ018] |
Language | 英语 |
Subject Area | 天文学 ; 天文学其他学科 ; 计算机科学技术 |
MOST Discipline Catalogue | 理学 ; 理学::天文学 ; 工学 ; 工学::计算机科学与技术(可授工学、理学学位) |
Subtype | Article |
Publisher | UNIV CHICAGO PRESS |
Publication Place | 1427 E 60TH ST, CHICAGO, IL 60637-2954 USA |
ISSN | 0004-6280 |
URL | 查看原文 |
WOS ID | WOS:000352231000007 |
WOS Research Area | Astronomy & Astrophysics |
WOS Subject | Astronomy & Astrophysics |
WOS Keyword | FASTBIT |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://ir.ynao.ac.cn/handle/114a53/4265 |
Collection | 其他 |
Corresponding Author | Wang F(王锋) |
Affiliation | 1.Computer Technology Application Key Lab of Yunnan Province, Kunming 2.University of Chinese Academy of Sciences, Beijing 100049, China 3.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, 4.Chinese National Observatory, Chinese Academy of Sciences, Beijing |
First Author Affilication | Yunnan Observatories, Chinese Academy of Sciences |
Corresponding Author Affilication | Yunnan Observatories, Chinese Academy of Sciences |
Recommended Citation GB/T 7714 | Wang F,Mei, Y,Deng, H,et al. Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph[J]. PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,2015,127(950):383-396. |
APA | Wang F.,Mei, Y.,Deng, H.,Wang, W.,Liu, CY.,...&Ji, KF.(2015).Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph.PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,127(950),383-396. |
MLA | Wang F,et al."Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph".PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC 127.950(2015):383-396. |
Files in This Item: | ||||||
File Name/Size | DocType | Version | Access | License | ||
Distributed Data-Pro(623KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View Application Full Text |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment