Management of data for the NCAR S-band polarimetric radar

The NCAR S-band Polarimetric radar (S-Pol) is a highly capable research system that produces a variety of radar data parameters and products. Parameters include the full matrix of polarization measurables, the derived fields of precipitation accumulation (by several methods), particle identification, and refractive index (which is related to relative humidity). Additionally, S-Pol can be coupled with bi-static receivers, producing a multiple Doppler data stream. Total measured data produced by S-Pol can exceed 1 Gigabyte per hour; derived products can add another .5 Gbyte per hour or more. Over the course of a single deployment, data volume can exceed 1 Terabyte. Distribution of the data to multiple users compounds the data-handling load of the S-Pol data management group.

A system for management of S-Pol data and products has evolved over the past 5 years and eight S-Pol deployments. The system includes 1) rigorous checks of radar system calibration, measurement of parameter biases, and checks for proper pointing, ranging, and scanning of the radar, 2) compilation of meta-information (inventories of data on tape, tabulation of radar scan sequences, compilation of radar data images, etc.), 3) production of a final dataset, and 4) a multi-level archive strategy with options for direct ftp access by the scientific and academic community, as well as distribution on a requested media.

An overview is provided of S-Pol data management operations. The discussion includes a review of successes and shortcomings, improvements currently underway, and desired directions for the future.