Monday, 23 January 2012
Land Surface Verification Toolkit (LVT): A Formal Benchmarking and Evaluation Framework for Land Surface Models
Hall E (New Orleans Convention Center )
Though there is a vast amount of literature on land surface model development, model simulation studies and multi-model intercomparison projects, the evaluation methods and metrics used in them tend to be specific for individual case studies and mostly deterministic. These studies have not typically converged on standard measures of model performance for evaluating different LSMs. In this presentation, we describe the development and capabilities of a formal system for land surface model evaluation called the Land surface Verification Toolkit (LVT). LVT is designed to provide an automated, consolidated environment for model evaluation and includes approaches for conducting both traditional deterministic and probabilistic verification. LVT employs observational datasets in their native formats, enabling the continued use of the system without requiring additional implementation or data re-processing. Currently a large suite of in-situ, remotely sensed and other model and reanalysis datasets are implemented in LVT. Aside from the accuracy-based measures, LVT also includes metrics to aid model identification, such as entropy, complexity and information content. These measures can be used to characterize the tradeoffs in model performance relative to the information content of the model outputs. Finally, LVT also includes uncertainty and ensemble diagnostics based on Bayesian approaches that enable the quantification of predictive uncertainty in land surface model outputs. These capabilities provide novel ways to characterize LSM performance, enable rapid model evaluation efforts, and are expected to help in the definition and refinement of a formal benchmarking and evaluation process for the land surface modeling community. A suite of examples of using LVT for the evaluation of land surface model and data assimilation integrations will be presented.
Supplementary URL: