This study utilizes real-time NEWS-e forecasts generated during the 2016 -2018 NOAA Hazardous Weather Testbed Spring Forecasting Experiments and low-level azimuthal shear analyses from the NSSL Multi-Radar/Multi-Sensor (MRMS) product suite as input data for training various machine learning algorithms to produce calibrated 1-h probabilistic forecasts of low-level rotation. Given that strong low-level rotation occurs infrequently, we are oversampling the grid points within the MRMS azimuthal shear tracks to produce a more balanced dataset, which has been shown to improve machine-learning performance. Given that traditional, grid point verification statistics are limited in rare events, forecasts are evaluated in an object-matching framework following the methodology of Skinner et al. (2018). Results suggest that while machine learning does not always improve upon raw ensemble forecasts, it sometimes substantially increases forecast probabilities in regions of observed low-level rotation that are missed by the uncalibrated probabilities.