Articles | Volume 16, issue 8
https://doi.org/10.5194/amt-16-2197-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-16-2197-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
25 Apr 2023
Research article |
| 25 Apr 2023
| 25 Apr 2023
Gap filling of turbulent heat fluxes over rice–wheat rotation croplands using the random forest model
Jianbin Zhang
Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration, School of Atmospheric Physics, Nanjing University of Information Science and Technology, Nanjing, China
Zexia Duan
Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration, School of Atmospheric Physics, Nanjing University of Information Science and Technology, Nanjing, China
Shaohui Zhou
Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration, School of Atmospheric Physics, Nanjing University of Information Science and Technology, Nanjing, China
Yubin Li
CORRESPONDING AUTHOR
Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration, School of Atmospheric Physics, Nanjing University of Information Science and Technology, Nanjing, China
Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai, China
China Meteorological Administration Xiong'an Atmospheric Boundary Layer Key Laboratory, Xiong'an New Area, China
Zhiqiu Gao
State Key Laboratory of Atmospheric Boundary Layer Physics and Atmospheric Chemistry, Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing, China
Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration, School of Atmospheric Physics, Nanjing University of Information Science and Technology, Nanjing, China
Related authors
Jianbin Zhang, Zhiqiu Gao, Yubin Li, and Yuncong Jiang
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-187, https://doi.org/10.5194/gmd-2023-187, 2023
Preprint withdrawn
Short summary
Short summary
This study developed a deep learning model called CNN-BiLSTM-AM for convective weather forecasting. The results showed that the CNN-BiLSTM-AM model outperformed traditional machine learning algorithms in predicting convective weather, with higher accuracy as the forecast lead time increased. When compared to subjective forecasts by forecasters, the objective approach of the CNN-BiLSTM-AM model also demonstrated advantages in various metrics.
Zining Yang, Qiuyan Du, Qike Yang, Chun Zhao, Gudongze Li, Zihan Xia, Mingyue Xu, Renmin Yuan, Yubin Li, Kaihui Xia, Jun Gu, and Jiawang Feng
Atmos. Chem. Phys., 25, 8831–8857, https://doi.org/10.5194/acp-25-8831-2025, https://doi.org/10.5194/acp-25-8831-2025, 2025
Short summary
Short summary
This study investigates the impact of turbulent mixing on black carbon (BC) concentrations in urban areas simulated at 25, 5, and 1 km resolutions. Significant variations in BC and turbulent mixing occur mainly at night. Higher resolutions reduce BC overestimation due to enhanced mixing coefficients and vertical wind fluxes. Small-scale eddies at higher resolutions increase the BC lifetime and column concentrations. Land use and terrain variations across multiple resolutions affect turbulent mixing.
Quanzhe Hou, Zhiqiu Gao, Zexia Duan, and Minghui Yu
Geosci. Model Dev., 18, 4625–4641, https://doi.org/10.5194/gmd-18-4625-2025, https://doi.org/10.5194/gmd-18-4625-2025, 2025
Short summary
Short summary
This study evaluates various machine learning and statistical methods for interpolating turbulent heat flux data over the Tibetan Plateau. The Transformer model showed the best performance, leading to the development of the Transformer_CNN model, which combines global and local attention mechanisms. Results show that Transformer_CNN outperforms the other models and was successfully applied to interpolate heat flux data from 2007 to 2016.
Shaohui Zhou, Chloe Yuchao Gao, Zexia Duan, Xingya Xi, and Yubin Li
Geosci. Model Dev., 16, 6247–6266, https://doi.org/10.5194/gmd-16-6247-2023, https://doi.org/10.5194/gmd-16-6247-2023, 2023
Short summary
Short summary
The proposed wind speed correction model (VMD-PCA-RF) demonstrates the highest prediction accuracy and stability in the five southern provinces in nearly a year and at different heights. VMD-PCA-RF evaluation indices for 13 months remain relatively stable: the forecasting accuracy rate FA is above 85 %. In future research, the proposed VMD-PCA-RF algorithm can be extrapolated to the 3 km grid points of the five southern provinces to generate a 3 km grid-corrected wind speed product.
Jianbin Zhang, Zhiqiu Gao, Yubin Li, and Yuncong Jiang
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-187, https://doi.org/10.5194/gmd-2023-187, 2023
Preprint withdrawn
Short summary
Short summary
This study developed a deep learning model called CNN-BiLSTM-AM for convective weather forecasting. The results showed that the CNN-BiLSTM-AM model outperformed traditional machine learning algorithms in predicting convective weather, with higher accuracy as the forecast lead time increased. When compared to subjective forecasts by forecasters, the objective approach of the CNN-BiLSTM-AM model also demonstrated advantages in various metrics.
Naifu Shao, Chunsong Lu, Xingcan Jia, Yuan Wang, Yubin Li, Yan Yin, Bin Zhu, Tianliang Zhao, Duanyang Liu, Shengjie Niu, Shuxian Fan, Shuqi Yan, and Jingjing Lv
Atmos. Chem. Phys., 23, 9873–9890, https://doi.org/10.5194/acp-23-9873-2023, https://doi.org/10.5194/acp-23-9873-2023, 2023
Short summary
Short summary
Fog is an important meteorological phenomenon that affects visibility. Aerosols and the planetary boundary layer (PBL) play critical roles in the fog life cycle. In this study, aerosol-induced changes in fog properties become more remarkable in the second fog (Fog2) than in the first fog (Fog1). The reason is that aerosol–cloud interaction (ACI) delays Fog1 dissipation, leading to the PBL meteorological conditions being more conducive to Fog2 formation and to stronger ACI in Fog2.
Lian Zong, Yuanjian Yang, Haiyun Xia, Meng Gao, Zhaobin Sun, Zuofang Zheng, Xianxiang Li, Guicai Ning, Yubin Li, and Simone Lolli
Atmos. Chem. Phys., 22, 6523–6538, https://doi.org/10.5194/acp-22-6523-2022, https://doi.org/10.5194/acp-22-6523-2022, 2022
Short summary
Short summary
Heatwaves (HWs) paired with higher ozone (O3) concentration at surface level pose a serious threat to human health. Taking Beijing as an example, three unfavorable synoptic weather patterns were identified to dominate the compound HW and O3 pollution events. Under the synergistic stress of HWs and O3 pollution, public mortality risk increased, and synoptic patterns and urbanization enhanced the compound risk of events in Beijing by 33.09 % and 18.95 %, respectively.
Hamidreza Omidvar, Ting Sun, Sue Grimmond, Dave Bilesbach, Andrew Black, Jiquan Chen, Zexia Duan, Zhiqiu Gao, Hiroki Iwata, and Joseph P. McFadden
Geosci. Model Dev., 15, 3041–3078, https://doi.org/10.5194/gmd-15-3041-2022, https://doi.org/10.5194/gmd-15-3041-2022, 2022
Short summary
Short summary
This paper extends the applicability of the SUEWS to extensive pervious areas outside cities. We derived various parameters such as leaf area index, albedo, roughness parameters and surface conductance for non-urban areas. The relation between LAI and albedo is also explored. The methods and parameters discussed can be used for both online and offline simulations. Using appropriate parameters related to non-urban areas is essential for assessing urban–rural differences.
Shaohui Zhou, Yuanjian Yang, Zhiqiu Gao, Xingya Xi, Zexia Duan, and Yubin Li
Atmos. Meas. Tech., 15, 757–773, https://doi.org/10.5194/amt-15-757-2022, https://doi.org/10.5194/amt-15-757-2022, 2022
Short summary
Short summary
Our research has determined the possible relationship between Weibull natural wind mesoscale parameter c and shape factor k with height under the conditions of a desert steppe terrain in northern China, which has great potential in wind power generation. We have gained an enhanced understanding of the seasonal changes in the surface roughness of the desert grassland and the changes in the incoming wind direction.
Shihan Chen, Yuanjian Yang, Fei Deng, Yanhao Zhang, Duanyang Liu, Chao Liu, and Zhiqiu Gao
Atmos. Meas. Tech., 15, 735–756, https://doi.org/10.5194/amt-15-735-2022, https://doi.org/10.5194/amt-15-735-2022, 2022
Short summary
Short summary
This paper proposes a method for evaluating canopy UHI intensity (CUHII) at high resolution by using remote sensing data and machine learning with a random forest (RF) model. The spatial distribution of CUHII was evaluated at 30 m resolution based on the output of the RF model. The present RF model framework for real-time monitoring and assessment of high-resolution CUHII provides scientific support for studying the changes and causes of CUHII.
Yixiong Lu, Tongwen Wu, Yubin Li, and Ben Yang
Geosci. Model Dev., 14, 5183–5204, https://doi.org/10.5194/gmd-14-5183-2021, https://doi.org/10.5194/gmd-14-5183-2021, 2021
Short summary
Short summary
The spurious precipitation in the tropical southeastern Pacific and southern Atlantic is one of the most prominent systematic biases in coupled atmosphere–ocean general circulation models. This study significantly promotes the marine stratus simulation and largely alleviates the excessive precipitation biases through improving parameterizations of boundary-layer turbulence and shallow convection, providing an effective solution to the long-standing bias in the tropical precipitation simulation.
Lian Zong, Yuanjian Yang, Meng Gao, Hong Wang, Peng Wang, Hongliang Zhang, Linlin Wang, Guicai Ning, Chao Liu, Yubin Li, and Zhiqiu Gao
Atmos. Chem. Phys., 21, 9105–9124, https://doi.org/10.5194/acp-21-9105-2021, https://doi.org/10.5194/acp-21-9105-2021, 2021
Short summary
Short summary
In recent years, summer O3 pollution over eastern China has become more serious, and it is even the case that surface O3 and PM2.5 pollution can co-occur. However, the synoptic weather pattern (SWP) related to this compound pollution remains unclear. Regional PM2.5 and O3 compound pollution is characterized by various SWPs with different dominant factors. Our findings provide insights into the regional co-occurring high PM2.5 and O3 levels via the effects of certain meteorological factors.
Cited articles
Alavi, N., Warland, J. S., and Berg, A. A.: Filling gaps in evapotranspiration
measurements for water budget studies: Evaluation of a Kalman filtering
approach, Agr. Forest Meteorol., 141, 57–66,
https://doi.org/10.1016/j.agrformet.2006.09.011, 2006.
Anapalli, S. S., Fisher, D. K., Reddy, K. N., Krutz, J. L., Pinnamaneni, S. R., and
Sui, R.: Quantifying water and CO2 fluxes and water use efficiencies
across irrigated C3 and C4 crops in a humid climate, Sci. Total Environ.,
663, 338–350, https://doi.org/10.1016/j.scitotenv.2018.12.471, 2018.
Baareh, A. K., Elsayad, A., and Al-Dhaifallah, M.: Recognition of splice-junction
genetic sequences using random forest and Bayesian optimization,
Multimed. Tools Appl., 80, 30505–30522,
https://doi.org/10.1007/s11042-021-10944-7, 2021.
Belgiu, M. and Dragut, L.: Random forest in remote sensing: A review of
applications and future directions, Remote Sens.,
114, 24–31, https://doi.org/10.1016/j.isprsjprs.2016.01.011, 2016.
Beringer, J., McHugh, I., Hutley, L. B., Isaac, P., and Kljun, N.: Technical note: Dynamic INtegrated Gap-filling and partitioning for OzFlux (DINGO), Biogeosciences, 14, 1457–1460, https://doi.org/10.5194/bg-14-1457-2017, 2017.
Best, M. J., Pryor, M., Clark, D. B., Rooney, G. G., Essery, R. L. H., Ménard, C. B., Edwards, J. M., Hendry, M. A., Porson, A., Gedney, N., Mercado, L. M., Sitch, S., Blyth, E., Boucher, O., Cox, P. M., Grimmond, C. S. B., and Harding, R. J.: The Joint UK Land Environment Simulator (JULES), model description – Part 1: Energy and water fluxes, Geosci. Model Dev., 4, 677–699, https://doi.org/10.5194/gmd-4-677-2011, 2011.
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S.,
and Deledalle, C.-A.: Machine learning in acoustics: Theory and applications,
Acoust. Soc. Am., 146, 3590–3628, https://doi.org/10.1121/1.5133944,2019.
Breiman, L.: Random Forests, Mach. Learn., 45, 5–32,
https://doi.org/10.1023/A:1010933404324, 2001.
Cai, J. C., Xu, K., Zhu, Y. H., Hu, F., and Li, L. H.: Prediction and analysis of
net ecosystem carbon exchange based on gradient boosting regression and
random forest, Appl. Energ., 262, 114566,
https://doi.org/10.1016/j.apenergy.2020.114566, 2020.
Duan, Z., Grimmond, C., Gao, C. Y., Sun, T., Liu, C., Wang, L., Li, Y., and Gao,
Z.: Seasonal and interannual variations in the surface energy fluxes of a
rice–wheat rotation in Eastern China, J. Appl. Meteorol. Climatol., 60,
877–891, https://doi.org/10.1175/JAMC-D-20-0233.1, 2021a.
Duan, Z., Yang, Y., Wang, L., Liu, C., Fan, S., Chen, C., Tong, Y., and Lin, X.,
Gao, Z.: Temporal characteristics of carbon dioxide and ozone over a
rural-cropland area in the Yangtze River Delta of eastern China, Sci.
Total Environ., 757, e143750,
https://doi.org/10.1016/j.scitotenv.2020.143750, 2021b.
Falge, E., Baldocchi, D., Olson, R., Anthoni, P., Aubinet, M., Bernhofer,
C., Burba, G., Ceulemans, R., Clement, R., and Dolman, H.: Gap filling
strategies for defensible annual sums of net ecosystem exchange, Agr. Forest Meteorol., 107, 43–69, https://doi.org/10.1016/S0168-1923(00)00225-2,
2001.
Foltýnová, L., Fischer, M., and McGloin, R. P.: Recommendations for
gap-filling eddy covariance latent heat flux measurements using marginal
distribution sampling, Theor. Appl. Climatol., 139, 677–688,
https://doi.org/10.1007/s00704-019-02975-w, 2020.
Frazier, P. I.: A Tutorial on Bayesian Optimization, arXiv [preprint], https://doi.org/10.48550/arXiv.1807.02811, 2018.
Gao, Z. Q., Bian, L. G., and Zhou, X. J.: Measurements of turbulent transfer
in the near-surface layer over a rice paddy in China, J. Geophys. Res.,
108, 4387–4387, https://doi.org/10.1029/2002JD002779, 2003.
Hui, D., Wan, S., Su, B., Katul, G., Monson, R., and Luo, Y.: Gap-filling
missing data in eddy covariance measurements using multiple imputation (MI)
for annual estimations, Agr. Forest Meteorol., 121, 93–111,
https://doi.org/10.1016/S0168-1923(03)00158-8, 2004.
Isaac, P., Cleverly, J., McHugh, I., van Gorsel, E., Ewenz, C., and Beringer, J.: OzFlux data: network integration from collection to curation, Biogeosciences, 14, 2903–2928, https://doi.org/10.5194/bg-14-2903-2017, 2017.
Jiang, L., Zhang, B., Han, S., Chen, H., and Wei, Z.: Upscaling
evapotranspiration from the instantaneous to the daily time scale: Assessing
six methods including an optimized coefficient based on worldwide eddy
covariance flux network, J. Hydrol., 596, 126135,
https://doi.org/10.1016/j.jhydrol.2021.126135, 2021.
Khan, M. S., Liaqat, U. W., Baik, J., and Choi, M.: Stand-alone uncertainty
characterization of GLEAM, GLDAS and MOD16 evapotranspiration products using
an extended triple collocation approach, Agr. Forest Meteorol., 252,
256–268, https://doi.org/10.1016/j.agrformet.2018.01.022, 2018.
Khan, M. S., Jeon, S. B., and Jeong, M. H.: Gap-Filling Eddy Covariance Latent Heat
Flux: Inter-Comparison of Four Machine Learning Model Predictions and
Uncertainties in Forest Ecosystem, Remote Sens., 13, 4976,
https://doi.org/10.3390/rs13244976, 2021.
Kim, Y., Johnson, M. S., Knox, S. H., Black, T. A., Dalmagro, H. J., Kang, M.,
Kim, J., and Baldocchi, D.: Gap-filling approaches for eddy covariance methane
fluxes: A comparison of three machine learning algorithms and a traditional
method with principal component analysis, Global Change Biol., 26,
1499–1518, https://doi.org/10.1111/gcb.14845, 2020.
Kunwor, S., Starr, G., Loescher, H. W., and Staudhammer, C. L.: Preserving
the variance in imputed eddycovariance measurements: Alternative methods for
defensible gap filling, Agr. Forest Meteorol., 232, 635–649,
https://doi.org/10.1016/j.agrformet.2016.10.018, 2017.
Li, X., Gao, Z., Li, Y., and Tong, B.: Comparison of sensible heat fluxes
measured by a large aperture scintillometer and eddy covariance system over
a heterogeneous farmland in East China, Atmosphere, 8, 101,
https://doi.org/10.3390/atmos8060101, 2017.
Liu, J., Zuo, Y., Wang, N., Yuan, F., Zhu, X., Zhang, L., Zhang, J., Sun, Y., Guo, Z., Guo, Y., Song, X., Song, C., and Xu, X.: Comparative Analysis of Two Machine Learning
Algorithms in Predicting Site-Level Net Ecosystem Exchange in Major Biomes,
Remote Sens., 13, 2242, https://doi.org/10.3390/rs13122242, 2021.
McCandless, T., Gagne, D. J., Kosović, B., Haupt, S. E., Yang, B.,
Becker, C., and Schreck, J.: Machine Learning for Improving
Surface-Layer-Flux Estimates, Bound.-Lay. Meteorol., 185, 199–228, 2022.
Moffat, A. M., Papale, D., Reichstein, M., Hollinger, D. Y., Richardson, A.
D., Barr, A. G., Beckstein, C., Braswell, B. H., Churkin G., Desai, A. R.,
Falge, E., Gove, J. H., Heimann, M., Hui, D., Jarvis, A. J., Kattge, J.,
Noormets, A., and Stauch, V. J.: Comprehensive comparison of gap-filling
techniques for eddy covariance net carbon fluxes, Agr. Forest Meteorol.,
147, 209–232, https://doi.org/10.1016/j.agrformet.2007.08.011, 2007.
Monin, A. S. and Obukhov, A. M.: Basic laws of turbulent mixing in
the surface layer of the atmosphere, Contrib. Geophys. Inst. Acad. Sci.
USSR, 151, e187, 1954.
Nisa, Z., Khan, M. S., Govind, A., Marchetti, M., Lasserre, B., Magliulo, E.,
and Manco, A.: Evaluation of SEBS, METRIC-EEFlux, and QWaterModel Actual
Evapotranspiration for a Mediterranean Cropping System in Southern Italy,
Remote Sens., 13, 497618, https://doi.org/10.3390/agronomy11020345,
2021.
Papale, D., Reichstein, M., Aubinet, M., Canfora, E., Bernhofer, C., Kutsch, W., Longdoz, B., Rambal, S., Valentini, R., Vesala, T., and Yakir, D.: Towards a standardized processing of Net Ecosystem Exchange measured with eddy covariance technique: algorithms and uncertainty estimation, Biogeosciences, 3, 571–583, https://doi.org/10.5194/bg-3-571-2006, 2006.
Reichstein, M., Falge, E., Baldocchi, D., Papale, D., Aubinet, M., Berbigier, P., Bernhofer, C., Buchmann, N., Gilmanov, T., Granier, A., and Grünwald, T.: On the separation of net ecosystem exchange into
assimilation and ecosystem respiration: Review and improved algorithm,
Global Change Biol., 11, 1424–1439,
https://doi.org/10.1111/j.1365-2486.2005.001002.x, 2005.
Richard, A., Fine, L., Rozenstein, O., Tanny, J., Geist, M., and Pradalier, C.:
Filling Gaps in Micro-Meteorological Data, Switzerland,
https://doi.org/10.1007/978-3-030-67670-4_7, 2020.
Stauch, V. J. and Jarvis, A. J.: A semi-parametric gap-filling model for eddy
covariance CO2 flux time series data, Global Change Biol., 12, 1707–1716,
https://doi.org/10.1111/j.1365-2486.2006.01227.x, 2006.
Wang, L., Wu, B., Elnashar, A., Zeng, H., Zhu, W., and Yan, N.: Synthesizing a
Regional Territorial Evapotranspiration Dataset for Northern China,
Remote Sens., 13, 1076, https://doi.org/10.3390/rs13061076, 2021.
Webb, E. K., Pearman, G. I., and Leuning, R.: Correction of flux measurements for
density effects due to heat and water vapor Transfer, Q. J. Roy. Meteor. Soc., 106, 85–100,
https://doi.org/10.1002/qj.49710644707, 1980.
Wilson, K. B., Hanson, P. J., Mulholland, P. J., Baldocchi, D. D., and Wullschleger,
S. D.: A comparison of methods for determining forest evapotranspiration and
its components: Sap-flow, soil water budget, eddy covariance and catchment
water balance, Agr. Forest Meteorol., 106, 153–168,
https://doi.org/10.1016/S0168-1923(00)00199-4, 2001.
Wutzler, T., Lucas-Moffat, A., Migliavacca, M., Knauer, J., Sickel, K., Šigut, L., Menzer, O., and Reichstein, M.: Basic and extensible post-processing of eddy covariance flux data with REddyProc, Biogeosciences, 15, 5015–5030, https://doi.org/10.5194/bg-15-5015-2018, 2018.
Yu, T. C., Fang, S. Y. Chiu, H. S., Hu, K. S., Tai, P. H. Y., Shen, C. C. F.,
and Sheng, H.: Pin accessibility prediction and optimization with deep
learning-based pin pattern recognition, J. IEEE T. Comput.-Aided Des.
Integr. Circuits Syst., 40, 2345–2356,
https://doi.org/10.1145/3316781.3317882, 2019.
Zhang, J., Duan, Z., Zhou, S., Li, Y., and Gao, Z.: The data and code for “Gap-Filling of Turbulent Heat Fluxes over Rice-Wheat-Rotation Croplands Using the Random Forest Model” Zenodo [data set], https://doi.org/10.5281/zenodo.7765608, 2023.
Short summary
In this paper, we used a random forest model to fill the observation gaps of the fluxes measured during 2015–2019. We found that the net radiation was the most important input variable. And we justified the reliability of the model. Further, it was revealed that the model performed better after relative humidity was removed from the input. Lastly, we compared the results of the model with those of three other machine learning models, and we found that the model outperformed all of them.
In this paper, we used a random forest model to fill the observation gaps of the fluxes measured...
