Six surface parameters were considered: 2 m temperature, 10 m wind speed, total cloud amount (TCA), cloud base height (CBH), visibility and hourly precipitation. The results show that more than precipitation forecast skill is compromised when using a traditional verification approach. Adopting this inherently probabilistic approach enables the comparison of near-convection-resolving ensemble prediction systems (EPS). Thus far the strategy has been tested when comparing two models of different resolutions, and comparing deterministic to a convective-scale ensemble. Asm part of the "proof of concept" it has also been applied to the "test vs control" case which is so important for operational NWP in accepting model upgrade packages. The strategy also offers pointers for the optimization of post-processing to ensure optimal skill of forecast products.