SatCORPS Global Cloud Composite (GCC): The role of Continuous Integration / Continuous Deployment in meeting the challenge of near-real-time cloud product creation and delivery.

The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) has worked on the development of an analysis ready and cloud-optimized data transformation pipeline and geospatial service enablement of a global cloud composite (GCC) product derived from global geostationary and Low Earth Orbit (LEO) satellite imagery. This geospatial service will be available at high temporal and spatial resolution via the SatCORPS web mapping application for visualization and analysis as well as direct ingestion to common geospatial software and custom programming.

The Global Cloud Composite product brings together several different programming systems developed by specialist science teams. Because the system delivers products as soon as information is available, the system is sensitive to seemingly mundane changes. We describe the Continuous Integration / Continuous Deployment pipeline that has been created along with the differing code control models used to ensure the continuous operation and delivery of research grade cloud product information.

The GCC system is constantly evolving as new challenges are identified. We discuss the lessons learned from our experience operating the GCC system and how those translated into operational changes and improvements.