Evaluating learning and performance in the Warning Decision Training Branch's Distance Learning Operation Courses

In 2004 and 2005, the Warning Decision Training Branch (WDTB) delivered training to approximately 2300 students as part of the Distance Learning Operations Course (DLOC), and the Advanced Warning Operations Course (AWOC). WDTB's two courses are designed for forecasters with warning responsibilities in the National Oceanic and Atmospheric Administration's (NOAA) National Weather Service (NWS). Both courses offer blended learning opportunities in the areas of science, technology, and human factors associated with basic radar operations and warning decision making. To help determine training effectiveness from these courses, we will present results of training evaluation data. Based on the four level evaluation model developed originally by Kirkpatrick (1959, 1960), level 1 measures reaction to training, level 2 measures the extent that learning has occurred from training, level 3 measures the extent that learning has been applied and transferred to the job, and level 4 measures training impacts. The results of DLOC/AWOC evaluation data support the notion that learning can be applied if adequate time and opportunities exist to apply the training. This is important as there is a measurable loss of learning retention over time. In addition, based on results from a questionnaire sent to AWOC students, facilitators, and management, there are significant factors, such as supports and barriers, that are related to forecasters' abilities in applying training to their work. The authors also present evidence that attempts to assess the impact of WDTB's training to job performance.