IDSS Performance Metrics

The Evolve National Weather Service’s (NWS) PMO Measuring Impact-based Decision Support Services (IDSS) Team was developing methods for measuring the quality and consistency of IDSS provided to Core Partners. It was decided that this will be best accomplished in two parts: developing and testing a set of both internal and external performance measures. Internal measures are currently being refined, which consist mainly of checklist items ranging from forecaster training to routine partner interactions. To address external measures, a questionnaire was developed to examine consistency, accuracy, comprehension, accessibility, decision-making, and timeliness of rendered IDSS. The survey tool also seeks to evaluate the trust relationship between the NWS and its partners. A pilot test was conducted in Southern and Central Regions which measured the two types of IDSS - episodic and recurring. This presentation will discuss the findings of the initial pilot. The veracity of the survey tool will be considered with recommendations given for potential improvement, along with an inspection of initial responses.