The Role in Verification in R2O Testing and Evaluation

Robust testing and evaluation of research innovations is a critical component of the Research-to-Operations (R2O) process. The Developmental Testbed Center (DTC) and The Met Office have both used components of the Model Evaluations Tools (MET) for their R2O evaluation efforts for operational systems in the U.S. and U.K. respectively. This presentation will demonstrate successful applications of MET from both institutions with an emphasis on interpretation of traditional and object-based output. It will elucidate methods for conveying actionable information from MET's Grid-Stat, Point-Stat and Series Analysis tools through the use of confidence intervals, box-plots, pairwise differences and summary tables. New approaches to using the Method for Object-based Diagnostic Evaluation (MODE) attributes for decision-making will also be demonstrated. Finally, this presentation will touch on new features introduced in the latest release of MET.