1.5
Techniques for tuning fuzzy logic algorithms
John K. Williams, NCAR, Boulder, CO; and G. Meymaris
In recent years, fuzzy logic (FL) has been shown to provide an efficient and practical way to encode human expertise in producing automated weather forecast and decision support systems. In NCAR's Research Applications Program, for instance, FL algorithms have been developed to perform quality control of anemometer and aircraft data, to detect hazardous turbulence, microbursts, hydrometeor particle types, in-flight icing conditions and anomalous propagation using radar data, and to forecast turbulence, icing, convective weather, and road conditions, among many other applications. However, the parameters of many FL algorithms are often chosen via "best guesses" or by trial and error. In this paper, principled alternatives are explored for improving an FL algorithm's performance by "tuning" its various parameters.
The authors begin by reviewing several promising approaches, including Kiefer-Wolfowitz algorithms, neural networks, genetic algorithms, and reinforcement learning. In addition, it is shown that linear classification and support vector machines may be used to optimize the combination of multiple predictive modules. The objective function, or performance metric, to be optimized may be derived from comparison of the algorithm's output with a human-truthed value, an objective measurement, data from a different instrument, a simulation, or even from some measure of consistency. However, simple metrics such as mean-squared error or common skill scores are typically inadequate; instead, a suitable training set and performance metric must be constructed that incorporate the selective sampling required to properly treat rare events and take into account the operational significance of the algorithm's output (e.g., warning or failure to warn). In addition, an FL algorithm design that allows modules to be tuned independently greatly facilitates the optimization process. Practical application of these concepts is illustrated using FL radar detection and aircraft data quality control algorithms.
.
Session 1, AI Techniques
Monday, 10 January 2005, 9:00 AM-11:15 AM
Previous paper Next paper