the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Benchmarking KDP in Rainfall: A Quantitative Assessment of Estimation Algorithms Using C-Band Weather Radar Observations
Abstract. Accurate and precise KDP estimates are essential for radar-based applications, especially in quantitative precipitation estimation and radar data quality control routines. The accuracy of these estimates largely depends on the post-processing of the radar's measured ΦDP, which aims to reduce noise and backscattering effects while preserving fine-scale precipitation features. In this study, we evaluate the performance of several publicly available KDP estimation methods implemented in open-source libraries such as PyArt and Wradlib, and the method used in the Vaisala weather radars. To benchmark these methods, we employ a polarimetric self-consistency approach that relates KDP to reflectivity and differential reflectivity in rain, providing a reference self-consistency KDP (KDPSC ) for comparison. This approach allows for the construction of the reference KDP observations that can be used to assess the accuracy and robustness of the studied KDP estimation methods. We assess each method by quantifying uncertainties using C-band weather radar observations where the reflectivity values ranged between 20 and 50 dBZ.
Using the proposed evaluation framework we could define optimized parameter settings for the methods that have user-configurable parameters. Most of such methods showed significant reduction in the estimation errors after the optimization with respect to the default settings. We have found significant differences in the performances of the studied methods, where the best performing methods showed smaller normalized biases in the high reflectivity values (i.e., ≥ 40 dBZ) and overall smaller normalized root mean squared errors across the range of reflectivity values.
- Preprint
(8233 KB) - Metadata XML
- BibTeX
- EndNote
Status: final response (author comments only)
-
CC1: 'Comment on amt-2024-155', Kultegin Aydin, 25 Sep 2024
This is a well prepared paper with interesting and useful results. There are many references to relevant publications on the topic. There is one paper that I believe should be included because it was the first paper that provided relationships between C-band polarimetric radar observables in rainfall, including KDP:C-Band Dual-Polarization Radar Observables in RainK. Aydin and V. GiridharPrint Publication: 01 Aug 1992DOI: https://doi.org/10.1175/1520-0426(1992)009<0383:CBDPRO>2.0.CO;2 Page(s): 383–390Citation: https://doi.org/
10.5194/amt-2024-155-CC1 -
RC1: 'Comment on amt-2024-155', Anonymous Referee #1, 04 Oct 2024
This article discusses an attempt to objectively assess the performance of KDP retrievals in rain. The authors make use of the self-consistency in rain of Zh, Zdr and KDP to retrieve KDP from Zh and Zdr observations from a heavily quality-controlled dataset. They then proceed to compare the self-consistency KDP with optimized KDP retrieval algorithms available from open-source libraries Py-ART and wradlib and the KDP retrieval available in the IRIS software.
It is undoubtedly an interesting and worthy exercise. The article is well written, and the topic is of interest. I have some general comments that I would like that they are addressed before it being accepted for publication.
General comments:
- Many Met Services (including WSR-88D) use a simpler KDP retrieval consisting of one or two moving median windows to smooth PhiDP and a least square retrieval of the KDP. The MeteoSwiss version of Py-ART has functions kdp_leastsquare_single_window, kdp_leastsquare_double_window, smooth_phidp_single_window and smooth_phidp_double_window available. I suggest the authors add those into the evaluated methods. It might be of interest for many Met Services to see where they retrievals stand.
- I do not understand why the authors did not try to tune KDP Schneebeli and KDP iris. KDP Schneebeli has some parameters that can be tuned (Measurement Error Covariance Matrix, Scaled State Transition Error Covariance Matrix and all the arguments for the pre-filtering of the PsiDP (which is not performed in the article). I am not familiar with the IRIS implementation, but I would assume there are also parameters that can be tuned. Not tuning those algorithms while tuning the others puts them in an unfair position when performing the evaluation.
- The conclusions should emphasize more the limits of this study. With all the data filtering performed the authors are evaluating KDP in effectively idealised conditions. In operational conditions, robustness to outliers, performance in low SNR, performance in the presence of residual clutter and/or non-liquid precipitation are also important factors. It would be interesting also to have some data on computational time of each of the retrievals.
Specific comments:
- According to the github repository the right way to write the name of the software package is Py-ART.
- For the sake of completeness, and since they have such a long list of citations, the authors maybe should cite Figueras i Ventura and Tabary (2013) since it was one of the first papers demonstrating the superior performance of KDP-based algorithms at all 3 regularly used weather radar bands (S, C and X) in an operational context in Europe.
- A recapitulative table with the parameters chosen for each tunned algorithm would be appreciated. It will also be helpful to highlight the effective range resolution achieved after tunning the retrievals.
References
2013: The new French operational polarimetric radar rainfall rate product, J Figueras i Ventura, P Tabary, Journal of Applied Meteorology and Climatology 52 (8), 1817-1835
https://github.com/meteoswiss/pyart
Citation: https://doi.org/10.5194/amt-2024-155-RC1 -
RC2: 'Comment on amt-2024-155', Anonymous Referee #2, 04 Nov 2024
Review report of
Benchmarking KDP in Rainfall: a Quantitative Assessment of Estimation Algorithms Using C-Band Weather Radar Observations
By Aldana et al.
Summary of paper:
The manuscript examines the performance of several commonly-used methods for KDP retrievals in rainfall observations with a C-band weather radar, which is located near Helsinki, Finland. The authors firstly determined carefully quality-controlling radar data by applying several filters to the measured ZH and Zdr and, then, deployed a polarimetric self-consistency approach to compute a reference KDP from radar quantities in rainfall observations. The self-consistency KDP was compared with the derived KDP applying different methods available in Py-ART and wradlib which were optimized accordingly under different conditions. With the performance assessment of different methods, the authors finally directly compared the optimized KDP and calculated their correlation coefficients, which, however indicates generally a high-level difference between different methods.
As general comments, I think the work is very important and comprehensive for the relevant studies in the radar community. It is well written and certainly worthy for publication.
I would like to recommend to add a short introduction to the self-consistency method that is used to probably improve the accuracy of different variables against each other for given hydrometeor types. For the direct comparison between the estimated KDP with different methods, a significance test should be given.
Here are the lists of typos and suggestions (but not limited to):
- Lines 17-18, to my knowledge, Höller et al., (1994) developed one of the first algorithms for hydrometeor classification by using ZDR, LDR, KDP and phiHV measurements during the evolution of a thunderstorm and the authors should probably cite it.
Reference: Höller, H., Hagen, M., Meischner, P. F., Bringi, V. N., and Hubbert, J.: Life Cycle and Precipitation Formation in a Hybrid-Type Hailstorm Revealed by Polarimetric and Doppler Radar Measurements, J. Atmos. Sci., 51, 2500– 2522, https://doi.org/10.1175/1520-0469(1994)051<_x0032_500:LCAPFI>2.0.CO;2, 1994.
- Lines 102-103, is Thurai et al. (2007) one of the settings? Please check it.
- Lines 109-110, please rephrase the sentence “Observations were … only.”
- Figure 4 (probably also other figures), Please add numbers (or letters) to the labels of figure.
- Lines 233-234, please rephrase the sentence “whereas …”
- Line 256, kDP -> KDP
- Figure 6, which panel is (a)-(p)? Please add.
- Lines 343-348, is this paragraph necessary? Please make a check.
- Line 400, remove one of the “using”.
- Line 426, it’s -> its.
- Line 427, it’s -> its.
- Line 433, remove “from methods”
- Line 456, a significance test should be given when the comparisons between two KDP are conducted.
- Figure 15, remove “plot”.
- Lines 478-479, please rephrase the sentence “both use …… independent.”
- Line 496, in 8 -> in Figure 8 (I think).
- Lines 669-670, it seems the reference is not complete. Please revise it.
Citation: https://doi.org/10.5194/amt-2024-155-RC2
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
187 | 38 | 88 | 313 | 2 | 3 |
- HTML: 187
- PDF: 38
- XML: 88
- Total: 313
- BibTeX: 2
- EndNote: 3
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1