12th Conference on IOAS-AOLS

2.1

An Improved Data Reduction Tool in Support of the Real-Time Assimilation of NASA Satellite Data Streams

Michael Splitt, Florida Institute of Technology, Melbourne, FL; and S. M. Lazarus, M. Lueken, R. Ramachandran, X. Li, S. Movva, B. T. Zavodsky, S. Graves, and W. Lapenta

Today's research and operational forecast models and data assimilation systems have difficulty ingesting and utilizing large volumes of satellite data, in part due to prohibitively large computational costs, time constraints and bandwidth issues. To address this problem, a NASA-funded project aimed at refining, testing and customizing an existing automated Intelligent Data Thinning (IDT) algorithm developed at the University of Alabama in Huntsville (UAH) in conjunction with commonly used data assimilation systems for numerical weather prediction models. The most significant measure of a successful data reduction algorithm is its ability to retain valuable information--that which has maximum impact on the model forecast--while simultaneously reducing the data volume. The IDT algorithm is specifically designed to retain information dense regions of a data set while removing redundant data. This recursive simplification algorithm is based on the computer graphics concept of data decimation and retains data within regions of high spatial frequency (large variances) while subsampling regions of low spatial frequency (low variances) to thin the data. The goal of this project is to test, refine and customize the IDT algorithm in support of real-time applications to dense data streams in operational communities. Comparisons of the IDT algorithm with conventional thinning approaches are presented using selected synthetic data sets and various assimilation methodologies. IDT is also examined in the context of real data with applications to MODerate resolution Imaging Spectroradiometer (MODIS) sea surface temperatures and Atmospheric InfraRed Sounder (AIRS) temperature profiles.

extended abstract  Extended Abstract (380K)

wrf recording  Recorded presentation

Session 2, Atmospheric Observations for Weather and Climate-II
Monday, 21 January 2008, 10:45 AM-11:45 AM, 204

Next paper

Browse or search entire meeting

AMS Home Page