Extending the Capability of the Model Evaluation Tools Using Python

Verification and validation activities are critical for the success of modelling and prediction efforts at organizations around the world, including the National Oceanic and Atmospheric Administration (NOAA), the US Military, commercial entities, and academia. Over a decade ago, the Developmental Testbed Center released a suite of community tools called the Model Evaluation Tools (MET). Under the auspices of the US Next Generation Global Prediction System (NGGPS) program an endeavour was undertaken to develop a comprehensive verification capability for the Unified Forecast System based on MET. Development of this extended capability, called METplus, started in 2015. The METplus system consists of several components, including a C++/Fortran code-base (MET), for the computation of verification statistics based on gridded forecasts and either a gridded analysis or point-based observations. The system also incorporates a database and display system (METviewer) for aggregating statistics and plotting graphical results. These tools are designed to be highly flexible to allow for quick adaption to meet additional evaluation and diagnostic needs. A suite of python wrappers have been implemented to facilitate a quick set-up and implementation of the system, and to enhance the pre-existing plotting capabilities.

It is envisioned that this effort will expand to development of a unified verification system that will encompass a variety of spatial scales and provide a basis for evaluation of individual earth system component models (including atmosphere, atmospheric composition, land, ocean, ice and waves) and of the entire earth system model including coupling among system components and the evaluation of critical space weather fields and forecast products. This presentation will provide an overview of the METplus unified verification system, and will highlight how the system might be used by both research and operational users.