학술논문
A new parallel python tool for the standardization of earth system model data
Document Type
Conference
Author
Source
2016 IEEE International Conference on Big Data (Big Data) Big Data (Big Data), 2016 IEEE International Conference on. :2953-2959 Dec, 2016
Subject
Language
Abstract
We have developed a new parallel Python tool for the standardization of Earth System Model (ESM) data for publication as part of Model Intercomparison Projects (MIPs). It was specifically designed to aid Community Earth System Model (CESM) scientists at the National Center for Atmospheric Research (NCAR) in preparation for the Coupled Model Intercomparison Project, Phase 6 (CMIP6), expected to start in early 2017. However, the tool is general to any and all MIPs and ESMs. The tool is implemented with MPI parallelism using mpi4py, and it performs the data standardization computation with a directed acyclic graph (DAG) data structure capable of streaming data from ESM input data to standardized output files. In this paper, we describe the tool, its design and testing.