Monday, 11 January 2016
Hall E ( New Orleans Ernest N. Morial Convention Center)
The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) is a framework designed to automate the retrieval and integration of time-series NetCDF data. The ARM program developed ADI to streamline the development of processes that convert raw instrument data to netCDF, and algorithms that use existing ARM data products to create data products with higher scientific value. ADI's use of a graphical interface to collect the details of the input data to retrieve, the target coordinate system, and content of the output data products significantly decreased the time and complexity associated with combining heterogeneous netCDF data files by eliminating the need to write any source code to execute these steps. Originally released to run on a rh6 operating system configured to meet the ARM program's needs, ADI has been updated to run on OSX to expand use to non-ARM developers on their local computers. This poster describes how to run ADI on a local OSX server, how to define a process through the ARM ADI graphical interface, how to port the process's inputs, transformations, and output specifications to a local SQLite database, and lastly how to execute the process using the ADI data consolidation application, or execute by using a provided template generator to produce a python algorithm. The python algorithm includes hooks that allow users to add additional code to ADI's basic retrieve, transform, and store logic.
- Indicates paper has been withdrawn from meeting
- Indicates an Award Winner