Extended Abstract (1016K)J7.12
An update on MADIS observation ingest, integration, quality control, and distribution capabilities
Patricia A. Miller, NOAA/ERL/FSL, Boulder, CO; and M. F. Barth and L. A. Benjamin*
*[In collaboration with Systems Research Group. Inc.]
NOAA's Forecast Systems Laboratory (FSL) has established the MADIS (Meteorological Assimilation Data Ingest System) project to make integrated, quality-controlled datasets available to the greater meteorological community. The goals of MADIS are to promote comprehensive data collection and distribution of operational and experimental observation systems, and to decrease the cost and time required to move observation systems from research to operations. Users of the MADIS database have access to a reliable and easy-to-use database containing real-time and saved real-time datasets available via ftp, Local Data Manager (LDM), or through the use of web-based OPen source project for Network Data Access Protocol (OPeNDAP) clients.
Observational datasets currently available via MADIS include radiosonde soundings, automated aircraft reports, NOAA and non-NOAA wind profilers, non-NOAA experimental microwave radiometer observations, operational and experimental GOES winds, and several types of surface datasets. The latter includes water vapor observations from geo-positioning satellite (GPS) and a unique, national collection of over 8,500 mesonet stations from local, state, and federal agencies, and private firms. MADIS also supports NOAA with ingest, quality control (QC), and distribution of surface observations from modernized COOP stations, and has been tasked to contribute to the development of a national transportation mesonet consisting of integrated Road Weather Information System (RWIS) data from state Department of Transportation (DOTs) as an integral part of the NOAA/FHWA surface transportation partnership.
MADIS data files are available in uniform formats with uniform QC structures within the data files. They are compatible with the NWS AWIPS systems, and with data assimilation systems such as the Weather Research and Forecasting 3D-variational (WRF 3DVAR) system. Software support is also provided for the datasets through the use of an Application Program Interface (API) that provides users with easy access to the data and QC information. The API allows each user to specify station and observation types, as well as QC choices, and domain and time boundaries. Many of the implementation details that arise in data ingest programs are automatically performed, greatly simplifying user access to the disparate datasets, and effectively integrating the database by allowing, for example, users to access many different types of surface observations (e.g. ASOS, modernized COOP, maritime, and non-NOAA mesonets) through a single interface.
First made publicly available in July 2001, MADIS datasets have proven to be popular within the meteorological community. FSL now supports hundreds of MADIS users, including the majority of NWS forecast offices, NCDC, NCEP, and many universities and private companies. Additionally, MADIS supplies non-NOAA data providers with QC and station monitoring information which have proven useful in their maintenance activities.
This paper will cover the current status of the MADIS project, including details on how to access the MADIS datasets, API, and documentation, and will also cover future plans.
Corresponding author: Patty Miller NOAA Forecast Systems Laboratory R/FS4 325 Broadway, Boulder CO 80305-3328
Email: patricia.a.miller@noaa.gov
Joint Session 7, Cyberinfrastructure to support atmospheric and Oceanic Education: Examples and strategies (Joint with 21IIPS and Education)
Tuesday, 11 January 2005, 1:30 PM-5:30 PM
Previous paper Next paper
Recorded presentation