A key input into outage prediction models (OPM) are forecasts of meteorological parameters that are related to the cause of the outages. The critical parameters are typically different from the standard meteorological parameters that are provided in public weather forecasts and typically evaluated in forecast model performance analyses. Some examples of such parameters are (1) event-maximum 10-m wind gust (2) maximum 4-hr average 10-m wind speed during an event, (3) average precipitation rate during the period of 4-hr maximum wind, (4) maximum hourly precipitation and snow/ice accumulation rate, (4) total event precipitation and snow/ice accumulation, (5) density and amount of snow accumulated on elevated surfaces.
Of course, the relative importance of the OPM input parameters will vary with the type of case (e.g. winter storm with frozen precipitation, large scale rain and wind event, convective scale wind and rain etc.). In order to optimize the performance of an OPM it is desirable to maximize the accuracy of the forecasts of the key parameters in a way that maximizes the skill of the outage predictions for each type of case
In this investigation, an evaluation of several alternative methods of producing deterministic predictions of the key OPM input parameters over the state of New York for 373 outage events in the 2017 to 2021 period. The data from the 126 New York State Mesonet (NYSM) surface observing stations were used to evaluate the forecasts. The alternative forecasts were based on:
- the interpolated output from NCEP operational models (GFS, NAM, RAP and HRRR)
- the interpolated output from a custom configured 2 km WRF forecast initialized from the HRRR forecast dataset
- machine learning models developed individually from each of the above NWP datasets using different objective functions
- machine learning models developed from the ensemble of all of the above NWP models using different objective functions
A targeted set of verification metrics were employed with the objective of assessing a range of prediction attributes including (1) the temporal and spatial correlation of the observed and forecasted values, (2) event forecast metrics for threshold values of variables (e.g. hit rate, false alarm rate, CSI etc.), (3) standard metrics that measure the typical error of a forecast time series (bias, mean absolute error, root mean square error etc.).
- Indicates paper has been withdrawn from meeting
- Indicates an Award Winner