The summer heavy precipitation in Northeast China is characterized by its localized nature, short duration, and high intensity. Such extreme weather events have always been a challenge for numerical forecasting. The traditional precipitation skill scores are often ineffective for verifying heavy precipitation processes in Northeast China due to the "double penalty" effect caused by minor spatial and temporal discrepancies. The ensemble precipitation spatial verification technique can effectively improve the validity of precipitation assessment. In this paper, the heavy precipitation events in Northeast China during the summer of 2018 were categorized into westward trough, shear line, and low vortex types,with typical precipitation cases selected for each weather process.A comparative analysis involving process analysis, ensemble equitable threat score (EETS), and the developed ensemble precipitation spatial verification method was conducted.The results indicate that EETS have certain evaluative capabilities when the precipitation area is extensive and the intensity is high. However, when heavy precipitation is scattered and point rainfall dominates, the inherent evaluation disadvantages become evident. Specifically, it becomes challenging to achieve a perfect match between forecasts and observations in point-to-point verification, leading to significant reliability and discernibility issues in the evaluation conclusions due to the serious "double penalty" problem. However, the ensemble precipitation spatial verification method can effectively compensate for these shortcomings, significantly enhancing the discernibility of the assessment.
SUNLi, ANGang, DINGLi,et al.A climatic analysis of summer precipitation features and anomaly in Northeast China[J].Acta Meteorologica Sinica,2000,58(1):70-82.(in Chinese)
LIYang, WANGYuhui, LVXiaomin,et al.Spatial distribution and temporal change in extreme weather events in three provinces in Northeast China[J].Resources Science,2015,37(12):2501-2513.(in Chinese)
BAIZhina, XIAOTiangui, ANJuan,et al.Climate characteristics of strong precipitation in Liaoning Province from 1986 to 2016[J].Desert and Oasis Meteorology,2019,13(3):112-117.(in Chinese)
SUNZhaobo, CAORong, NIDonghong.A classification of summer precipitation patterns over Northeast China and their atmospheric circulation characteristics[J].Transactions of Atmospheric Sciences,2016,39(1):18-27.(in Chinese)
CUIJin, ZHOUXiaoshan, ZHANGAizhong,et al.Application of synoptic verification in autumn and winter precipitation forecast of NWP model in Northeast China[J].Journal of Meteorology and Environment,2009,25(4):17-21.(in Chinese)
HANJing, LUYaqi, CAOYanchao,et al.Error analysis of short-term rainstorm forecast product based on spatial test technology in Hedong area of Gansu[J].Desert and Oasis Meteorology,2023,17(1):83-89.(in Chinese)
WUYingxu, MENGYingying, ZHOUYi,et al.Short time heavy rain potential prediction and inspection based on ECMWF fine grid and GRAPES_GRAPES[J].Desert and Oasis Meteorology,2021,15(5):30-40.(in Chinese)
[15]
BaldwinM E, KainJ S.Sensitivity of several performance measures to displacement error,bias,and event frequency[J].Weather and Forecasting,2006,21(4):636-648.
[16]
YatesE, AnquetinS, DucrocqV,et al.Point and areal validation of forecast precipitation fields[J].Meteorological Applications,2006,13(1):1-20.
[17]
WalserA, LüthiD, SchärC.Predictability of precipitation in a cloud-resolving model[J].Monthly Weather Review,2004,132(2):560-577.
[18]
Zepeda-ArceJ, Foufoula-GeorgiouE, DroegemeierK K.Space-time rainfall organization and its role in validating quantitative precipitation forecasts[J].Journal of Geophysical Research Atmosphere,2000,105(8):10129-10146.
[19]
RobertsN M, LeanH W.Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events[J].Monthly Weather Review,2008,136(1):78-97.
[20]
SkokG, RobertsN.Analysis of Fractions Skill Score properties for random precipitation fields and ECMWF forecasts[J].Quarterly Journal of the Royal Meteorological Society,2016,142(700):2599-2610.
[21]
Gallus JrW A.Application of object-based verification techniques to ensemble precipitation forecasts[J].Weather and Forecasting,2010,25(1):144-158.
[22]
SkinnerP S, WickerL J, WheatleyD M,et al.Application of two spatial verification methods to ensemble forecasts of low-level rotation[J].Weather and Forecasting,2016,31(3):713-735.
[23]
RadanovicsS, VidalJ P, SauquetE.Spatial verification of ensemble precipitation:an ensemble version of SAL[J].Weather and Forecasting,2018,33(4):1001-1020.
[24]
BouallègueZ B, TheisS E.Spatial techniques applied to precipitation ensemble forecasts:from verification results to probabilistic products[J].Meteorological Applications,2014,21(4):922-929.
[25]
DucL, SaitoK, SekoH.Spatial-temporal fractions verification for high-resolution ensemble forecasts[J].Tellus A:Dynamic Meteorology and Oceanography,2013,65(1):18171.
[26]
SchwartzC S, SobashR A.Generating probabilistic forecasts from convection-allowing ensembles using neighborhood approaches:a review and recommendations[J].Monthly Weather Review,2017,145(9):3397-3418.
PANYang, SHENYan, YUJingjing,et al.An experiment of high-resolution gauge-radar-satellite combined precipitation retrieval based on the Bayesian merging method[J].Acta Meteorologica Sinica,2015,73(1):177-186.(in Chinese)
[31]
赵滨,张博.邻域空间检验方法在降水评估中的应用[J].暴雨灾害,2018,37(1):1-7.
[32]
ZHAOBin, ZHANGBo.Application of neighborhood spatial verification method on precipitation evaluation[J].Torrential Rain and Disasters,2018,37(1):1-7.(in Chinese)