학술논문

Big data challenges for large radio arrays
Document Type
Conference
Source
2012 IEEE Aerospace Conference Aerospace Conference, 2012 IEEE. :1-6 Mar, 2012
Subject
Aerospace
Transportation
Signal Processing and Analysis
Fields, Waves and Electromagnetics
Components, Circuits, Devices and Systems
Arrays
Data handling
Data storage systems
Transient analysis
Information management
Radio astronomy
Antennas
Language
ISSN
1095-323X
Abstract
Future large radio astronomy arrays, particularly the Square Kilometre Array (SKA), will be able to generate data at rates far higher than can be analyzed or stored affordably with current practices. This is, by definition, a "big data" problem, and requires an end-to-end solution if future radio arrays are to reach their full scientific potential. Similar data processing, transport, storage, and management challenges face next-generation facilities in many other fields. The Jet Propulsion Laboratory is developing technologies to address big data issues, with an emphasis in three areas: 1) Lower-power digital processing architectures to make highvolume data generation operationally affordable, 2) Date-adaptive machine learning algorithms for real-time analysis (or "data triage") of large data volumes, and 3) Scalable data archive systems that allow efficient data mining and remote user code to run locally where the data are stored. 1