Tuesday, 24 January 2012
Testing GOES-R Product Performance: The Reproducibility of Research Baseline Results in Implemented Algorithms
Hall E (New Orleans Convention Center )
The research to operations transition for satellite observations is an area of active interest as identified by The National Research Council Committee on NASA-NOAA Transition from Research to Operations. Their report recommends improved transitional processes for bridging technology from research to operations. Assuring the accuracy of operational algorithm results as compared to research baselines, called reproducibility in this paper, is a critical step in the GOES-R transition process. This paper defines reproducibility methods and measurements for verifying that operationally implemented algorithms conform to research baselines, demonstrated with examples from GOES-R software development. The approach defines reproducibility for implemented algorithms that produce continuous data in terms of a traditional goodness-of-fit measure (i.e., correlation coefficient), while the reproducibility for discrete categorical data is measured using a classification matrix. These reproducibility metrics have been incorporated in a set of Test Tools developed for GOES-R and the software processes have been developed to include these metrics in the validation of both the scientific and numerical implementation for the GOES-R algorithms. This approach addresses the operational accuracy of algorithms that generate vital products used by meteorologists, researchers, and the public and is a key element of the GOES-R transition to operations methodology.
Supplementary URL: