Challenges and Recent Developments in ECMWF's Product Generation

Starting 2014, ECMWF has embarked on a 10 year research programme on HPC Scalability, aiming to achieve Exascale numerical weather prediction systems by 2025.
ECMWF operational forecast system generates daily millions of meteorological products that are disseminated to member states and commercial clients all over the world.

These products are processed from the raw output of the IFS model, within the time critical path and under strict delivery schedule.
Upcoming resolution increases and growing popularity will increase both the size and number of these products.
Coupled with limited HPC I/O performance developments, this creates a strong challenge to meet the strict operational schedule.

We present a new software stack that ECMWF is developing to tackle these future challenges in the scalability of product generation.