NOAA/NESDIS ESPDS - Enterprise Product Generation and Distribution for NESDIS

As part of the NOAA/NESDIS Environmental Satellite Processing and Distribution System (ESPDS) Development program, Team Solers (comprised of Solers, Lockheed Martin, IMSG, Innovim, ASRC Aerospace Corp.) is building an enterprise system for NESDIS' Environmental Satellite Processing Center (ESPC) that provides robust data ingest, processing, product generation, and distribution functions by employing enhanced computing methodologies and the latest technology improvements, including a Service Oriented Architecture (SOA). These enhancements provide a secure, scalable, and adaptable infrastructure in response to changing demands of the ESPC. In this presentation, Team Solers will provide an overview of the ESPDS architecture and design, progress since last year, and an updated schedule.

ESPDS provides a flexible SOA-based Product Generation subsystem known as NDE, which is capable of scheduling and executing any science algorithm, with a streamlined algorithm integration process that reduces the overall Research to Operations (RTO) timeline for product algorithms.

ESPDS also provides an enterprise Product Distribution capability including SOA-based interfaces for integrating with data providers, as well as support for secure versions of FTP for non-SOA-enabled (legacy) data providers. It leverages push and pull approaches for consumers to obtain weather data, including HTTP(S), SOAP web services, and secure versions of FTP. A subscription-based distribution solution allows consumers to submit subscription requests and either receive the data directly via secure push, or receive notification when the data is available. ESPDS consumers will be able to search the 7-day PDA inventory, and submit one-time (ad-hoc) requests for data from the inventory. ESPDS uses virtualization and resource management (leveraging VMware technology) to automatically manage the deployment of services and allocation of computing resources across a cluster of commodity x86 blade computing hardware. It also uses NWAVE as an enterprise NOAA network communications provider to enable network connectivity with various NOAA facilities, as well as the Internet.

Since last year ESPDS has successfully connected to NWAVE, and has held several successful integration and test events with external data providers and consumers including GOES-R, JPSS, NWS, NCEP, AFWA, FNMOC, NIC, and Legacy ESPC systems. ESPDS personnel also continue to work closely with STAR to update and integrate product algorithms into the NDE Product Generation subsystem.