Articles | Volume 18, issue 22
https://doi.org/10.5194/amt-18-6997-2025
© Author(s) 2025. This work is distributed under the Creative Commons Attribution 4.0 License.
Evaluation of biases and uncertainties in ROMEX radio occultation observations
Download
- Final revised paper (published on 24 Nov 2025)
- Supplement to the final revised paper
- Preprint (discussion started on 27 May 2025)
- Supplement to the preprint
Interactive discussion
Status: closed
Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor
| : Report abuse
-
RC1: 'Comment on egusphere-2025-2089', Anonymous Referee #1, 12 Jul 2025
- AC1: 'Reply on RC1', Richard Anthes, 19 Aug 2025
-
RC2: 'Comment on egusphere-2025-2089', Anonymous Referee #2, 21 Jul 2025
- AC2: 'Reply on RC2', Richard Anthes, 19 Aug 2025
Peer review completion
AR – Author's response | RR – Referee report | ED – Editor decision | EF – Editorial file upload
AR by Richard Anthes on behalf of the Authors (24 Aug 2025)
Author's response
Author's tracked changes
Manuscript
ED: Publish as is (25 Aug 2025) by Peter Alexander
ED: Referee Nomination & Report Request started (27 Aug 2025) by Peter Alexander
RR by Anonymous Referee #1 (15 Sep 2025)
RR by Anonymous Referee #2 (05 Oct 2025)
ED: Publish subject to minor revisions (review by editor) (14 Oct 2025) by Peter Alexander
AR by Richard Anthes on behalf of the Authors (17 Oct 2025)
Author's response
Author's tracked changes
EF by Katja Gänger (23 Oct 2025)
Manuscript
ED: Publish as is (25 Oct 2025) by Peter Alexander
AR by Richard Anthes on behalf of the Authors (03 Nov 2025)
Author's response
Manuscript
Paper Summary:
This paper analyses the random and bias error characteristics of data that was made available as part of the Radio Occultation Modeling Experiment (ROMEX). ROMEX is an agency and scientific community effort to quantify the benefits of assimilating increasing numbers of RO profiles for numerical weather prediction. In the three-month ROMEX experimental period, in excess of 35,000 profiles per day were made available to ROMEX participants who agreed to the terms and conditions of using ROMEX data. (This compares to less than 10,000 RO profiles per day that are available operationally.) The paper focuses on the three largest datasets from ROMEX: COSMIC-2 (C2), Spire, and Yunyao. The three-cornered-hat (3CH) method is used to determine the uncertainties of the C2, Spire, and Yunyao bending angles and refractivities. The analysis covers height dependence and geographic variations. Reanalyses are used as two corners of the 3CH method to estimate the uncertainty of the combined C2-Spire-Yunyao data set.
Review Summary:
The paper provides valuable scientific information on the ROMEX data, which is an unprecedented data set for RO and also involves new commercial sources of data such as Yunyao which has not been extensively analyzed in the past. This is the first time that such a large data set is evaluated for its error characteristics. Understanding the error characteristics is very important for data assimilation and numerical weather prediction. Before publication, the paper should clarify certain aspects of the analysis and address questions as detailed below. After suitably addressing these aspects, the paper should be ready for publication.
Citation of the literature is generally appropriate, but with reliance on an unpublished document that could be given a DOI. The reference Aparicio 2024 is to a presentation that could be put online with a DOI.
The material is presented well in a logical and clear manner.
Detailed Comments:
Line 107: a brief explanation of “excess phase data” should be provided so that the paper is accessible to a less specialized audience.
Lines 150-166: while the theory of the 3CH method is explained elsewhere, this brief summary does not fully serve the paper. The paper compares different data sets to one another, and no data set is claimed to be “truth”, so why is “truth” referred to here? Rather than truth, the authors might be referring to a reference data set for which biases and variances are determined relative to that reference. Wouldn’t these equations still hold if one of the data sets is viewed as “reference” instead of truth? Or are these equations only valid if one of the data sets is actually “truth”, which has zero bias and zero random error? The term “bias” in this paper appears to refer to a bias between two data sets, and not between one data set and truth. What is meant by “bias” in the paper should be clarified.
Another way this brief introduction is not serving the paper is that the paper analyzes various subsets of data for which it becomes clear there is not a single bias applicable to all subsets. For example, bias appears to vary geographically, and the authors apply the analysis to the global data set which is not characterized by a single bias. Is the global bias expected to be the mean of the regional biases? Is equation (1) valid for a dataset that is characterized by multiple biases? The authors should clarify how the equations 1-3 apply to the data sets being analyzed in the paper.
The following phrase is used on line 211: “but at the expense of fewer pairs in the sample and greater noise in the statistics.” The description in lines 150-161 does not contain terms corresponding to this “statistical noise”. For such a term to exist would require the concept of a sample mean as an estimate of the mean of a theoretical parent distribution. (Similarly for the parent standard deviation, etc.). The authors apparently are not concerned with statistical noise in their analyses, relying on large enough sample sizes to render the statistical noise negligible. The authors should make some reference to this implicit assumption in the paper.
Line 270: provide some sense of what “impact height” is and how it relates to geometric height, for the less specialized reader.
Line 276-279: please clarify this sentence. It is hard to understand.
Line 313-317: this paragraph and example should be better defined. There are numerous references that suggest RO can be used to advantage to improve predictions related to tropical cyclones (TC). What is meant by “resolve” here is not clear. RO inherently has relatively poor horizontal resolution per observation, which will not change with increasing numbers of observations. Even if RO cannot spatially “resolve” TC, increasing numbers of RO could improve predictions related to TC, such as intensification and track. This paragraph is not convincing regarding whether increasing numbers of RO have no benefit for TC.
Lines 324-325: if C2 does not exhibit the same count variation as Spire near the equator, it is worth commenting on why this might be case, if true. Both data sets sample the equatorial anomaly.
Line 452: please provide the quantity (approximate) of operational data assimilated so that this statement can be provided in better context.
Lines 459-460: weren’t the Yunyao data adjusted after the initial processing, so why does this artifact remain?
Line 502: Figure 7 is indeed impressive, but also somewhat puzzling. Whereas RO-RO comparisons have consistently shown growing uncertainties below 10 km, such uncertainty growth for the models is unexpected. For example, Figure 11 of Hersbach et al. (DOI 10.1002/qj.3803) for ERA5 temperature uncertainty does not appear to match what would occur with ERA5 bending angle uncertainty as indicated in Figure 7. While there is a modest increase of temperature uncertainty below ~8 km in the ERA5 paper, it does not increase dramtically towards the surface and is not much larger than uncertainty near 10 km. Please reconcile Figure 7 with Figure 11 of Hersbach et al.
Line 525: please clarify what BFRPRF in Figure 8 refers to. What are the dashed blue and green lines?
Line 531: processing provenance is somewhat unclear. Were the Yunyao data used here reprocessed by EUMETSAT or UCAR?
Line 583: please clarify what is the location of the ERA5 model and how is that determined. Is it a nearby grid point value? Isn’t it straightforward to interpolate ERA5 values on a grid to an RO location, thus eliminating collocation error for all ERA5 comparisons?
Line 594: what is meant by short-range forecast of a reanalysis and why use that rather than the reanalysis value that is based on all contemporaneous data?
Line 620: how is it known that above 30 km ERA5 biases are dominant?
Line 627: same comment – how is it known that ERA5 biases are dominant?
Line 718: missing close of parentheses.
Line 747: this suggests that the bias caused by Rc should not create model biases after assimilation because N does not exhibit the bias. The forward operator applied to bending angle should remove the bias. Please reconcile the small N bias with a bias in the model that assimilates BA. Note that Zhou et al. (DOI 10.1029/2024JD041295) detected tempature biases in C2 data. How do such biases arise if N is not biased due to Rc variations?
Lines 760-773: the DD examples used here relate to reducing collocation error. It’s not immediately clear how DD reduces Rc error. Please provide more details regarding the algorithm that reduces Rc error. Include a discussion of how bending angle is computed from the model.
Lines 800-802: so the claim is being made here that the local radius of curvature computed for each occultation is only computed at one altitude, and not repeatedly as the raypath drifts?
Line 808: What of negative azimuths?
Line 848: this section should explicitly note whether bending angles or refractivity are being referred to.