Preprints
https://doi.org/10.5194/amt-2024-164
https://doi.org/10.5194/amt-2024-164
06 Nov 2024
 | 06 Nov 2024
Status: this preprint is currently under review for the journal AMT.

Quality Control for Second-Level Radiosonde Data Based on Bezier Curve Fitting

Huixia Lai, Lian Chen, Hualin Zhang, Ye Tian, Weijie Zhang, Bo Wang, and Shi Zhang

Abstract. The balloon-borne radiosonde observations provide high-resolution profile observations of pressure, temperature, relative humidity, and winds from the surface to the middle stratosphere. These observations help validate space-based data and are used in climate research, weather forecasting. For the large amount of second-level radiosonde data, it is tedious and time-consuming for the manual quality control (QC). Furthermore, varying experiences and different judgment standards may lead to inconsistent judgments for abnormal data. To address these issues, we propose a two-stage QC method for second-level radiosonde data based on the Bezier curve fitting. In the stage QC1, the gross errors are filtered out according to the measurement range of the sensors, the change rates and extreme temperature values based on pressure segmentations. Also, the algorithm of the longest descending sequence(LDS) is used to identify the moment of sounding termination and eliminate items after that moment. In the stage QC2, we score each item with deviations calculated using Bezier curve fitting, and then use a decision tree model ,CART, to identify anomalies in second-level radiosonde data. The experiment results first demonstrate the efficacy of QC at each step, and finally validate the rationality of our method by comparing the statistical characteristics before and after QC. After QC, the error items are greatly reduced, and the percentile profile distribution of temperature, pressure and relative humidity becomes more reasonable. The overlap of items identified by manual QC and automatic QC reaches 86 %, verifying the effectiveness of our method. This research significantly boosts QC efficiency and unifies the QC standards, providing quality assurance for various applications.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Huixia Lai, Lian Chen, Hualin Zhang, Ye Tian, Weijie Zhang, Bo Wang, and Shi Zhang

Status: open (until 11 Dec 2024)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Huixia Lai, Lian Chen, Hualin Zhang, Ye Tian, Weijie Zhang, Bo Wang, and Shi Zhang
Huixia Lai, Lian Chen, Hualin Zhang, Ye Tian, Weijie Zhang, Bo Wang, and Shi Zhang
Metrics will be available soon.
Latest update: 06 Nov 2024
Download
Short summary
The radiosonde data contains unrealistic observations. A two-stage quality control (QC) method is proposed. In stage 1, gross errors are screened out. In stage 2, some random errors, systematic errors, and micro meteorological errors are filtered out. After QC, errors are reduced. The percentile profiles of 3 variables are more reasonable. The overlap ratio between automatic and manual QC results reaches 86 %. The method reduces the human resource cost, helps unify the QC standards.