238 Revolutionizing Weather Forecasting: AI Emulator Optimizes Radiation Parameterization Efficiency using WRF Adios2 IO Framework

Monday, 29 January 2024
Hall E (The Baltimore Convention Center)
Erick Fredj, Jerusalem College of Technology, Jerusalem, Israel; Jerusalem College of Technology, Jerusalem, Israel; and N. Lavi, I. Segev-Gal, D. Danial, Y. Delorme, Z. Ding, M. Wasserman, and S. jubran

This research introduces an innovative approach centered around the development of a specialized AI emulator for radiation parameterization using real-time AI training methods. This emulator seamlessly integrates into version 4.5 of the Weather Research and Forecasting (WRF) model, incorporating the Adios2 IO framework. The emulator's creation involves a wide array of training data, encompassing diverse radiation elements and scenarios such as longwave and shortwave radiation, various months, land-ocean differentiations, and differing clear-cloudy conditions.

Within the domain of real-time training techniques, the role of Input/Output (I/O) takes on a position of utmost significance. The novel methodology effectively bridges the gap between the newly introduced AI-driven emulator and the exacting demands of AI-HPC's I/O requirements. This entails optimizing data movement and transfer rates through the utilization of Storage System Scalability, Metadata Management, Burst Buffer and Caching, Data Compression and Encoding, and similar techniques. As a consequence, a comprehensive framework is established to enhance the efficiency and performance of AI workloads within intricate computational environments.

The substitution of the traditional radiation parameterization approach with the AI emulator has resulted in accelerated radiation processes, leading to an approximately 35% reduction in overall computation time. The precision of the AI emulator has undergone rigorous assessment, being compared against sporadic utilization of the original radiation scheme with equivalent computational costs. Moreover, the AI emulator has achieved an accuracy level of approximately 95%.

Future works will delve into assessing the resilience of the radiation emulator, even when dealing with incomplete coverage of training data. To sum up, the designed AI emulator for radiation parameterization not only enhances precision but also significantly amplifies computational efficiency. This firmly establishes its role as a valuable asset for refining weather forecasting models.

- Indicates paper has been withdrawn from meeting
- Indicates an Award Winner