Articles | Volume 17, issue 3
https://doi.org/10.5194/amt-17-961-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-17-961-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Artificial intelligence (AI)-derived 3D cloud tomography from geostationary 2D satellite data
Sarah Brüning
CORRESPONDING AUTHOR
Institute for Physics of the Atmosphere, Johannes Gutenberg University Mainz, Johann-Joachim-Becher-Weg 21, Mainz 55128, Rhineland-Palatinate, Germany
Stefan Niebler
Institute of Computer Science, Johannes Gutenberg University Mainz, Staudingerweg 9, Mainz 55128, Rhineland-Palatinate, Germany
Institute for Physics of the Atmosphere, Johannes Gutenberg University Mainz, Johann-Joachim-Becher-Weg 21, Mainz 55128, Rhineland-Palatinate, Germany
Related authors
Sarah Brüning and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2025-374, https://doi.org/10.5194/egusphere-2025-374, 2025
Short summary
Short summary
This study analyses the temporal variability and life-cycle of spatially organised convective clouds, frequently associated with severe weather. We derive the data from a machine learning-based 3D extrapolation of 2D satellite data. The results highlight the impact of convective organisation on horizontal and vertical cloud properties and a prolonged cloud life-cycle. Overall, our findings emphasise a more intense activity over land but enhanced seasonal changes over the ocean.
Sarah Brüning and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2025-376, https://doi.org/10.5194/egusphere-2025-376, 2025
Short summary
Short summary
The connection between convective cloud organisation and severe weather demands a robust characterisation of hazardous clouds. This study sets on to investigate spatio-temporal patterns and regional hotspots of convective organisation using machine learning-based 3D data and combining different organisation indices. While limitations arise due to overlapping effects of isolated and clustered convection, we emphasise the impact of a surface-specific seasonality that depends on the hemisphere.
Helena Zoe Schuh, Philipp Reutter, Stefan Niebler, and Peter Spichtinger
EGUsphere, https://doi.org/10.5194/egusphere-2025-2498, https://doi.org/10.5194/egusphere-2025-2498, 2025
This preprint is open for discussion and under review for Atmospheric Chemistry and Physics (ACP).
Short summary
Short summary
We studied ice-supersaturated regions in the upper troposphere and lower stratosphere where high humidity can lead to cloud and contrail formation. Using data from 2010 to 2020, we found these regions to have fractal characteristics by applying an area-perimeter method. The fractal dimension follows a seasonal cycle. Our results can help improve climate models and have possible implications on contrail mitigation.
Matthias Kohl, Christoph Brühl, Jennifer Schallock, Holger Tost, Patrick Jöckel, Adrian Jost, Steffen Beirle, Michael Höpfner, and Andrea Pozzer
Geosci. Model Dev., 18, 3985–4007, https://doi.org/10.5194/gmd-18-3985-2025, https://doi.org/10.5194/gmd-18-3985-2025, 2025
Short summary
Short summary
SO2 from explosive volcanic eruptions reaching the stratosphere can oxidize and form sulfur aerosols, potentially persisting for several years. We developed a new submodel, Explosive Volcanic ERuptions (EVER), that seamlessly includes stratospheric volcanic SO2 emissions in global numerical simulations based on a novel standard historical model setup, successfully evaluated with satellite observations. Sensitivity studies on the Nabro eruption in 2011 evaluate different emission methods.
Ryan Vella, Sergey Gromov, Clara M. Nussbaumer, Laura Stecher, Matthias Kohl, Samuel Ruhl, Holger Tost, Jos Lelieveld, and Andrea Pozzer
EGUsphere, https://doi.org/10.5194/egusphere-2025-1800, https://doi.org/10.5194/egusphere-2025-1800, 2025
Short summary
Short summary
We evaluated how replacing forests with farmland and grazing areas affects atmospheric composition. Using a global climate-chemistry model, we found that deforestation reduces BVOCs, increases farming pollutants, and shifts ozone chemistry. These changes lead to a small cooling effect on the climate. Restoring natural vegetation could reverse some of these effects.
Sina Jost, Ralf Weigel, Konrad Kandler, Luis Valero, Jessica Girdwood, Chris Stopford, Warren Stanley, Luca Katharina Eichhorn, Christian von Glahn, and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2025-451, https://doi.org/10.5194/egusphere-2025-451, 2025
Short summary
Short summary
For the balloon-borne detection of particles (diameter 0.4 < Dp < 40 µm), a Universal Cloud and Aerosol Sounding System (UCASS) was used, whose sample flow is determined by GPS-measured ascent rates. In flights, actual UCASS sample flows rarely match the ascent rates. Errors are minimized by real-time detection of the UCASS flows, e.g. by implementing a thermal flow sensor (TFS) within the UCASS. The TFSs were tested in flight, and calibrated at up to 10 m s-1 and at variable angles of attack.
Adrienne Jeske and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2025-293, https://doi.org/10.5194/egusphere-2025-293, 2025
Short summary
Short summary
Thunderstorms lead to a vertical redistribution of tracers throughout the troposphere. We applied a new tool, the convective exchange matrix, in historical simulations with a chemistry-climate model to investigate the trends in convective transport. This reveals that convection reaches higher but deep convection occurs less often in the time period from 2011 to 2020 than in the 1980ies. Thus, convective transport towards the upper troposphere has declined as an adaptation to climate change.
Sarah Brüning and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2025-374, https://doi.org/10.5194/egusphere-2025-374, 2025
Short summary
Short summary
This study analyses the temporal variability and life-cycle of spatially organised convective clouds, frequently associated with severe weather. We derive the data from a machine learning-based 3D extrapolation of 2D satellite data. The results highlight the impact of convective organisation on horizontal and vertical cloud properties and a prolonged cloud life-cycle. Overall, our findings emphasise a more intense activity over land but enhanced seasonal changes over the ocean.
Sarah Brüning and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2025-376, https://doi.org/10.5194/egusphere-2025-376, 2025
Short summary
Short summary
The connection between convective cloud organisation and severe weather demands a robust characterisation of hazardous clouds. This study sets on to investigate spatio-temporal patterns and regional hotspots of convective organisation using machine learning-based 3D data and combining different organisation indices. While limitations arise due to overlapping effects of isolated and clustered convection, we emphasise the impact of a surface-specific seasonality that depends on the hemisphere.
Ryan Vella, Matthew Forrest, Andrea Pozzer, Alexandra P. Tsimpidi, Thomas Hickler, Jos Lelieveld, and Holger Tost
Atmos. Chem. Phys., 25, 243–262, https://doi.org/10.5194/acp-25-243-2025, https://doi.org/10.5194/acp-25-243-2025, 2025
Short summary
Short summary
This study examines how land cover changes influence biogenic volatile organic compound (BVOC) emissions and atmospheric states. Using a coupled chemistry–climate–vegetation model, we compare present-day land cover (deforested for crops and grazing) with natural vegetation and an extreme reforestation scenario. We find that vegetation changes significantly impact global BVOC emissions and organic aerosols but have a relatively small effect on total aerosols, clouds, and radiative effects.
Chun Hang Chau, Peter Hoor, and Holger Tost
EGUsphere, https://doi.org/10.5194/egusphere-2024-3805, https://doi.org/10.5194/egusphere-2024-3805, 2024
Short summary
Short summary
This study examines how the turbulence in the upper troposphere/lower stratosphere could modify the tracer distribution under different situations. Using a multi-scale chemistry model, we find that both the pre-existing tracer gradient and the dynamical and thermodynamically forcing play a role in modifying the tracer distribution. These results allow further research on the UTLS turbulent mixing and its implications for the climate system.
Anna Martin, Veronika Gayler, Benedikt Steil, Klaus Klingmüller, Patrick Jöckel, Holger Tost, Jos Lelieveld, and Andrea Pozzer
Geosci. Model Dev., 17, 5705–5732, https://doi.org/10.5194/gmd-17-5705-2024, https://doi.org/10.5194/gmd-17-5705-2024, 2024
Short summary
Short summary
The study evaluates the land surface and vegetation model JSBACHv4 as a replacement for the simplified submodel SURFACE in EMAC. JSBACH mitigates earlier problems of soil dryness, which are critical for vegetation modelling. When analysed using different datasets, the coupled model shows strong correlations of key variables, such as land surface temperature, surface albedo and radiation flux. The versatility of the model increases significantly, while the overall performance does not degrade.
Edward Groot, Patrick Kuntze, Annette Miltenberger, and Holger Tost
Weather Clim. Dynam., 5, 779–803, https://doi.org/10.5194/wcd-5-779-2024, https://doi.org/10.5194/wcd-5-779-2024, 2024
Short summary
Short summary
Deep convective clouds (thunderstorms), which may cause severe weather, tend to coherently organise into structured cloud systems. Accurate representation of these systems in models is difficult due to their complex dynamics and, in numerical simulations, the dependence of their dynamics on resolution. Here, the effect of convective organisation and geometry on their outflow winds (altitudes of 7–14 km) is investigated. Representation of their dynamics and outflows improves at higher resolution.
Simon Rosanka, Holger Tost, Rolf Sander, Patrick Jöckel, Astrid Kerkweg, and Domenico Taraborrelli
Geosci. Model Dev., 17, 2597–2615, https://doi.org/10.5194/gmd-17-2597-2024, https://doi.org/10.5194/gmd-17-2597-2024, 2024
Short summary
Short summary
The capabilities of the Modular Earth Submodel System (MESSy) are extended to account for non-equilibrium aqueous-phase chemistry in the representation of deliquescent aerosols. When applying the new development in a global simulation, we find that MESSy's bias in modelling routinely observed reduced inorganic aerosol mass concentrations, especially in the United States. Furthermore, the representation of fine-aerosol pH is particularly improved in the marine boundary layer.
Ryan Vella, Andrea Pozzer, Matthew Forrest, Jos Lelieveld, Thomas Hickler, and Holger Tost
Biogeosciences, 20, 4391–4412, https://doi.org/10.5194/bg-20-4391-2023, https://doi.org/10.5194/bg-20-4391-2023, 2023
Short summary
Short summary
We investigated the effect of the El Niño–Southern Oscillation (ENSO) on biogenic volatile organic compound (BVOC) emissions from plants. ENSO events can cause a significant increase in these emissions, which have a long-term impact on the Earth's atmosphere. Persistent ENSO conditions can cause long-term changes in vegetation, resulting in even higher BVOC emissions. We link ENSO-induced emission anomalies with driving atmospheric and vegetational variables.
Edward Groot and Holger Tost
Atmos. Chem. Phys., 23, 6065–6081, https://doi.org/10.5194/acp-23-6065-2023, https://doi.org/10.5194/acp-23-6065-2023, 2023
Short summary
Short summary
It is shown that the outflow from cumulonimbus clouds or thunderstorms in the upper troposphere and lower stratosphere in idealized high-resolution simulations (LESs) depends linearly on the net amount of latent heat released by the cloud for fixed geometry of the clouds. However, it is shown that, in more realistic situations, convective organization and aggregation (collecting mechanisms of cumulonimbus clouds) affect the amount of outflow non-linearly through non-idealized geometry.
Ryan Vella, Matthew Forrest, Jos Lelieveld, and Holger Tost
Geosci. Model Dev., 16, 885–906, https://doi.org/10.5194/gmd-16-885-2023, https://doi.org/10.5194/gmd-16-885-2023, 2023
Short summary
Short summary
Biogenic volatile organic compounds (BVOCs) are released by vegetation and have a major impact on atmospheric chemistry and aerosol formation. Non-interacting vegetation constrains the majority of numerical models used to estimate global BVOC emissions, and thus, the effects of changing vegetation on emissions are not addressed. In this work, we replace the offline vegetation with dynamic vegetation states by linking a chemistry–climate model with a global dynamic vegetation model.
Edward Groot and Holger Tost
Atmos. Chem. Phys., 23, 565–585, https://doi.org/10.5194/acp-23-565-2023, https://doi.org/10.5194/acp-23-565-2023, 2023
Short summary
Short summary
Thunderstorm systems play an important role in the dynamics of the Earth’s atmosphere, and some of them form a well-organised line: squall lines. Simulations of such squall lines with very small initial perturbations are compared to a reference simulation. The evolution of perturbations and processes amplifying them are analysed. It is shown that the formation of new secondary thunderstorm cells (after the initial primary cells) directly ahead of the line affects the spread strongly.
Mohamed Abdelkader, Georgiy Stenchikov, Andrea Pozzer, Holger Tost, and Jos Lelieveld
Atmos. Chem. Phys., 23, 471–500, https://doi.org/10.5194/acp-23-471-2023, https://doi.org/10.5194/acp-23-471-2023, 2023
Short summary
Short summary
We study the effect of injected volcanic ash, water vapor, and SO2 on the development of the volcanic cloud and the stratospheric aerosol optical depth (AOD). Both are sensitive to the initial injection height and to the aging of the volcanic ash shaped by heterogeneous chemistry coupled with the ozone cycle. The paper explains the large differences in AOD for different injection scenarios, which could improve the estimate of the radiative forcing of volcanic eruptions.
Andrea Pozzer, Simon F. Reifenberg, Vinod Kumar, Bruno Franco, Matthias Kohl, Domenico Taraborrelli, Sergey Gromov, Sebastian Ehrhart, Patrick Jöckel, Rolf Sander, Veronica Fall, Simon Rosanka, Vlassis Karydis, Dimitris Akritidis, Tamara Emmerichs, Monica Crippa, Diego Guizzardi, Johannes W. Kaiser, Lieven Clarisse, Astrid Kiendler-Scharr, Holger Tost, and Alexandra Tsimpidi
Geosci. Model Dev., 15, 2673–2710, https://doi.org/10.5194/gmd-15-2673-2022, https://doi.org/10.5194/gmd-15-2673-2022, 2022
Short summary
Short summary
A newly developed setup of the chemistry general circulation model EMAC (ECHAM5/MESSy for Atmospheric Chemistry) is evaluated here. A comprehensive organic degradation mechanism is used and coupled with a volatility base model.
The results show that the model reproduces most of the tracers and aerosols satisfactorily but shows discrepancies for oxygenated organic gases. It is also shown that this model configuration can be used for further research in atmospheric chemistry.
Stefan Niebler, Annette Miltenberger, Bertil Schmidt, and Peter Spichtinger
Weather Clim. Dynam., 3, 113–137, https://doi.org/10.5194/wcd-3-113-2022, https://doi.org/10.5194/wcd-3-113-2022, 2022
Short summary
Short summary
We use machine learning to create a network that detects and classifies four types of synoptic-scale weather fronts from ERA5 atmospheric reanalysis data. We present an application of our method, showing its use case in a scientific context. Additionally, our results show that multiple sources of training data are necessary to perform well on different regions, implying differences within those regions. Qualitative evaluation shows that the results are physically plausible.
Ralf Weigel, Christoph Mahnke, Manuel Baumgartner, Martina Krämer, Peter Spichtinger, Nicole Spelten, Armin Afchine, Christian Rolf, Silvia Viciani, Francesco D'Amato, Holger Tost, and Stephan Borrmann
Atmos. Chem. Phys., 21, 13455–13481, https://doi.org/10.5194/acp-21-13455-2021, https://doi.org/10.5194/acp-21-13455-2021, 2021
Short summary
Short summary
In July and August 2017, the StratoClim mission took place in Nepal with eight flights of the M-55 Geophysica at up to 20 km in the Asian monsoon anticyclone. New particle formation (NPF) next to cloud ice was detected in situ by abundant nucleation-mode aerosols (> 6 nm) along with ice particles (> 3 µm). NPF was observed mainly below the tropopause, down to 15 % being non-volatile residues. Observed intra-cloud NPF indicates its importance for the composition in the tropical tropopause layer.
Vinod Kumar, Julia Remmers, Steffen Beirle, Joachim Fallmann, Astrid Kerkweg, Jos Lelieveld, Mariano Mertens, Andrea Pozzer, Benedikt Steil, Marc Barra, Holger Tost, and Thomas Wagner
Atmos. Meas. Tech., 14, 5241–5269, https://doi.org/10.5194/amt-14-5241-2021, https://doi.org/10.5194/amt-14-5241-2021, 2021
Short summary
Short summary
We present high-resolution regional atmospheric chemistry model simulations focused around Germany. We highlight the importance of spatial resolution of the model itself as well as the input emissions inventory and short-scale temporal variability of emissions for simulations. We propose a consistent approach for evaluating the simulated vertical distribution of NO2 using MAX-DOAS measurements while also considering its spatial sensitivity volume and change in sensitivity within this volume.
Sara Bacer, Sylvia C. Sullivan, Odran Sourdeval, Holger Tost, Jos Lelieveld, and Andrea Pozzer
Atmos. Chem. Phys., 21, 1485–1505, https://doi.org/10.5194/acp-21-1485-2021, https://doi.org/10.5194/acp-21-1485-2021, 2021
Short summary
Short summary
We investigate the relative importance of the rates of both microphysical processes and unphysical correction terms that act as sources or sinks of ice crystals in cold clouds. By means of numerical simulations performed with a global chemistry–climate model, we assess the relevance of these rates at global and regional scales. This estimation is of fundamental importance to assign priority to the development of microphysics parameterizations and compare model output with observations.
Edward Groot and Holger Tost
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2020-1142, https://doi.org/10.5194/acp-2020-1142, 2020
Publication in ACP not foreseen
Short summary
Short summary
Sensitivities and variability of upper tropospheric flow (~10 km height) resulting immediately and as a direct consequence of (thunder)storm activity have been modeled in detail down to resolutions of 100–200 m and explored for different (organisation/) storm types. It is shown that the amount of water condensation explains much of emerging variability in upper atmospheric flow. Part of the effects on the nearby upper atmospheric flow is suggested to be explained by (organisation/) storm type.
Cited articles
Amato, F., Guignard, F., Robert, S., and Kanevski, M.: A novel framework for spatio-temporal prediction of environmental data using deep learning, Sci. Rep.-UK, 10, 22243, https://doi.org/10.1038/s41598-020-79148-7, 2020. a, b, c
Barker, H. W., Jerg, M. P., Wehr, T., Kato, S., Donovan, D. P., and Hogan, R. J.: A 3D cloud-construction algorithm for the EarthCARE satellite mission, Q. J. Roy. Meteor. Soc., 137, 1042–1058, https://doi.org/10.1002/qj.824, 2011. a, b
Bedka, K., Brunner, J., Dworak, R., Feltz, W., Otkin, J., and Greenwald, T.: Objective Satellite-Based Detection of Overshooting Tops Using Infrared Window Channel Brightness Temperature Gradients, J. Appl. Meteorol. Clim., 49, 181–202, https://doi.org/10.1175/2009JAMC2286.1, 2010. a
Benas, N., Finkensieper, S., Stengel, M., van Zadelhoff, G.-J., Hanschmann, T., Hollmann, R., and Meirink, J. F.: The MSG-SEVIRI-based cloud property data record CLAAS-2, Earth Syst. Sci. Data, 9, 415–434, https://doi.org/10.5194/essd-9-415-2017, 2017. a
Bieliński, T.: A Parallax Shift Effect Correction Based on Cloud Height for Geostationary Satellites and Radar Observations, Remote Sens.-UK, 12, 365, https://doi.org/10.3390/rs12030365, 2020. a
Bocquet, M., Elbern, H., Eskes, H., Hirtl, M., Žabkar, R., Carmichael, G. R., Flemming, J., Inness, A., Pagowski, M., Pérez Camaño, J. L., Saide, P. E., San Jose, R., Sofiev, M., Vira, J., Baklanov, A., Carnevale, C., Grell, G., and Seigneur, C.: Data assimilation in atmospheric chemistry models: current status and future prospects for coupled chemistry meteorology models, Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, 2015. a
Bony, S., Stevens, B., Frierson, D. M. W., Jakob, C., Kageyama, M., Pincus, R., Shepherd, T. G., Sherwood, S. C., Siebesma, A. P., Sobel, A. H., Watanabe, M., and Webb, M. J.: Clouds, circulation and climate sensitivity, Nat. Geosci., 8, 261–268, https://doi.org/10.1038/ngeo2398, 2015. a
Boulesteix, A.-L., Janitza, S., Kruppa, J., and König, I. R.: Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics, WIREs Data Min. Knowl., 2, 493–507, https://doi.org/10.1002/widm.1072, 2012. a
Breiman, L.: Random Forests, Mach. Learn., 45, 5–32, https://doi.org/10.1023/A:1010933404324, 2001. a
Brüning, S.: AI-derived 3D cloud tomography, Zenodo [code], https://doi.org/10.5281/zenodo.8238110, 2023. a
Bruno, O., Hoose, C., Storelvmo, T., Coopman, Q., and Stengel, M.: Exploring the Cloud Top Phase Partitioning in Different Cloud Types Using Active and Passive Satellite Sensors, Geophys. Res. Lett., 48, e2020GL089863, https://doi.org/10.1029/2020GL089863, 2021. a
Cao, K. and Zhang, X.: An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images, Remote Sens.-UK, 12, 1228, https://doi.org/10.3390/rs12071128, 2020. a
Carrer, D., Roujean, J.-L., Hautecoeur, O., and Elias, T.: Daily estimates of aerosol optical thickness over land surface based on a directional and temporal analysis of SEVIRI MSG visible observations, J. Geophys. Res.-Atmos., 115, D10, https://doi.org/10.1029/2009JD012272, 2010. a
Chen, Y., Chen, G., Cui, C., Zhang, A., Wan, R., Zhou, S., Wang, D., and Fu, Y.: Retrieval of the vertical evolution of the cloud effective radius from the Chinese FY-4 (Feng Yun 4) next-generation geostationary satellites, Atmos. Chem. Phys., 20, 1131–1145, https://doi.org/10.5194/acp-20-1131-2020, 2020. a
Cintineo, J. L., Pavolonis, M. J., Sieglaff, J. M., Wimmers, A., Brunner, J., and Bellon, W.: A Deep-Learning Model for Automated Detection of Intense Midlatitude Convection Using Geostationary Satellite Images, Weather Forecast., 35, 2567–2588, https://doi.org/10.1175/WAF-D-20-0028.1, 2020. a
CloudSat Data Processing Center: Level 2B GEOPROF, Data Products, CloudSat DPC, https://www.cloudsat.cira.colostate.edu/data-products/2b-geoprof (last access: 27 July 2023), 2023. a
Denby, L.: Discovering the Importance of Mesoscale Cloud Organization Through Unsupervised Classification, Geophys. Res. Lett., 47, e2019GL085190, https://doi.org/10.1029/2019GL085190, 2020. a
Diakogiannis, F. I., Waldner, F., Caccetta, P., and Wu, C.: ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data, ISPRS J. Photogramm., 162, 94–114, https://doi.org/10.1016/j.isprsjprs.2020.01.013, 2020. a, b, c
Dixit, M., Chaurasia, K., and Kumar Mishra, V.: Dilated-ResUnet: A novel deep learning architecture for building extraction from medium resolution multi-spectral satellite imagery, Expert Syst. Appl., 184, 115530, https://doi.org/10.1016/j.eswa.2021.115530, 2021. a
Dubovik, O., Schuster, G., Xu, F., Hu, Y., Bösch, H., Landgraf, J., and Li, Z.: Grand Challenges in Satellite Remote Sensing, Front. Remote Sens., 2, 619818, https://doi.org/10.3389/frsen.2021.619818, 2021. a, b
Enitan, I. and Ilesanmi, T.: Methods for image denoising using convolutional neural network: a review, Complex & Intelligent Systems, 7, 2189–2198, https://doi.org/10.1007/s40747-021-00428-4, 2021. a
EUMETSAT Data Services: High Rate SEVIRI Level 1.5 Image Data – MSG – 0 degree, available at https://navigator.eumetsat.int/product/EO:EUM:DAT:MSG:HRSEVIRI (last access: 27 July 2023), 2023. a
Finkensieper, S., Meirink, J. F., van Zadelhoff, G.-J., Hanschmann, T., Benas, N., Stengel, M., Fuchs, P., Hollmann, R., Kaiser, J., and Werscheck, M.: CLAAS-2.1: CM SAF CLoud property dAtAset using SEVIRI – Edition 2.1, EUMESTST [data set], https://doi.org/10.5676/EUM_SAF_CM/CLAAS/V002_01, 2020. a, b
Forster, L., Davis, A. B., Diner, D. J., and Mayer, B.: Toward Cloud Tomography from Space Using MISR and MODIS: Locating the “Veiled Core” in Opaque Convective Clouds, J. Atmos. Sci., 78, 155–166, https://doi.org/10.1175/JAS-D-19-0262.1, 2021. a
Guillaume, A., Kahn, B. H., Yue, Q., Fetzer, E. J., Wong, S., Manipon, G. J., Hua, H., and Wilson, B. D.: Horizontal and Vertical Scaling of Cloud Geometry Inferred from CloudSat Data, J. Atmos. Sci., 75, 2187–2197, https://doi.org/10.1175/JAS-D-17-0111.1, 2018. a
Ham, S.-H., Kato, S., Barker, H. W., Rose, F. G., and Sun-Mack, S.: Improving the modelling of short-wave radiation through the use of a 3D scene construction algorithm, Q. J. Roy. Meteor. Soc., 141, 1870–1883, https://doi.org/10.1002/qj.2491, 2015. a
Han, L., Liang, H., Chen, H., Zhang, W., and Ge, Y.: Convective Precipitation Nowcasting Using U-Net Model, IEEE T. Geosci. Remote, 60, 1–8, https://doi.org/10.1109/TGRS.2021.3100847, 2022. a
Henken, C. C., Schmeits, M. J., Deneke, H., and Roebeling, R. A.: Using MSG-SEVIRI Cloud Physical Properties and Weather Radar Observations for the Detection of Cb/TCu Clouds, J. Appl. Meteorol. Clim., 50, 1587–1600, https://doi.org/10.1175/2011JAMC2601.1, 2011. a
Holmlund, K., Grandell, J., Schmetz, J., Stuhlmann, R., Bojkov, B., Munro, R., Lekouara, M., Coppens, D., Viticchie, B., August, T., Theodore, B., Watts, P., Dobber, M., Fowler, G., Bojinski, S., Schmid, A., Salonen, K., Tjemkes, S., Aminou, D., and Blythe, P.: Meteosat Third Generation (MTG): Continuation and Innovation of Observations from Geostationary Orbit, B. Am. Meteorol. Soc., 102, 990–1015, https://doi.org/10.1175/BAMS-D-19-0304.1, 2021. a
Hu, K., Zhang, D., and Xia, M.: CDUNet: Cloud Detection UNet for Remote Sensing Imagery, Remote Sens.-UK, 13, 4533, https://doi.org/10.3390/rs13224533, 2021. a, b
Huo, J., Lu, D., Duan, S., Bi, Y., and Liu, B.: Comparison of the cloud top heights retrieved from MODIS and AHI satellite data with ground-based Ka-band radar, Atmos. Meas. Tech., 13, 1–11, https://doi.org/10.5194/amt-13-1-2020, 2020. a
Irrgang, C., Boers, N., Sonnewald, M., Barnes, E. A., Kadow, C., Staneva, J., and Saynisch-Wagner, J.: Towards neural Earth system modelling by integrating artificial intelligence in Earth system science, Nat. Mach. Intell., 3, 667–674, https://doi.org/10.1038/s42256-021-00374-3, 2021. a
Jiao, L., Huo, L., Hu, C., and Tang, P.: Refined UNet: UNet-Based Refinement Network for Cloud and Shadow Precise Segmentation, Remote Sens.-UK, 12, 2001, https://doi.org/10.3390/rs12122001, 2020. a, b, c
Jones, N.: How machine learning could help to improve climate forecasts, Nature, 548, 379–379, https://doi.org/10.1038/548379a, 2017. a
Jordahl, K., Bossche, J. V. D., Fleischmann, M., Wasserman, J., McBride, J., Gerard, J., Tratner, J., Perry, M., Badaracco, A. D., Cochran, M., Gillies, S., Culbertson, L., Bartos, M., Eubank, N., Maxalbert, Bilogour, A., Rey, S., Ren, C., Arribas-Bel, D., Wasser, L., Wolf, L. J., Journois, M., Wilson, J., Greenhall, A., Holdgraf, C., Filipe, and Leblanc, F.: geopandas/geopandas: v0.8.1, Zenodo [code], https://doi.org/10.5281/ZENODO.3946761, 2020. a
Karpatne, A., Ebert-Uphoff, I., Ravela, S., Babaie, H. A., and Kumar, V.: Machine Learning for the Geosciences: Challenges and Opportunities, IEEE T. Knowl. Data En., 31, 1544–1554, https://doi.org/10.1109/TKDE.2018.2861006, 2019. a
Kingma, D. P. and Ba, J.: Adam: A Method for Stochastic Optimization, arXiv [preprint], https://doi.org/10.48550/arXiv.1412.6980, 2014. a
Kühnlein, M., Appelhans, T., Thies, B., and Nauss, T.: Improving the accuracy of rainfall rates from optical satellite sensors with machine learning – A random forests-based approach applied to MSG SEVIRI, Remote Sens. Environ., 141, 129–143, https://doi.org/10.1016/j.rse.2013.10.026, 2014. a
Le Goff, M., Tourneret, J.-Y., Wendt, H., Ortner, M., and Spigai, M.: Deep learning for cloud detection, in: 8th International Conference of Pattern Recognition Systems (ICPRS 2017), 1–6, https://doi.org/10.1049/cp.2017.0139, Madrid, Spain, 11–13 July 2017, 2017. a, b
Lee, Y., Kummerow, C. D., and Ebert-Uphoff, I.: Applying machine learning methods to detect convection using Geostationary Operational Environmental Satellite-16 (GOES-16) advanced baseline imager (ABI) data, Atmos. Meas. Tech., 14, 2699–2716, https://doi.org/10.5194/amt-14-2699-2021, 2021. a, b, c, d, e
Li, R., Liu, W., Yang, L., Sun, S., Hu, W., Zhang, F., and Li, W.: DeepUNet: A Deep Fully Convolutional Network for Pixel-Level Sea-Land Segmentation, IEEE J. Sel. Top. Appl., 11, 3954–3962, https://doi.org/10.1109/JSTARS.2018.2833382, 2018. a
Liu, Y., Racah, E., Prabhat, M., Correa, J., Khosrowshahi, A., Lavers, D., Kunkel, K., Wehner, M., and Collins, W.: Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets, arXiv [preprint], https://doi.org/10.48550/arXiv.1605.01156, 2016. a
Marais, W. J., Holz, R. E., Reid, J. S., and Willett, R. M.: Leveraging spatial textures, through machine learning, to identify aerosols and distinct cloud types from multispectral observations, Atmos. Meas. Tech., 13, 5459–5480, https://doi.org/10.5194/amt-13-5459-2020, 2020. a, b, c
Marchand, R., Mace, G. G., Ackerman, T., and Stephens, G.: Hydrometeor Detection Using Cloudsat–An Earth-Orbiting 94 GHz Cloud Radar, J. Atmos. Ocean. Tech., 25, 519–533, https://doi.org/10.1175/2007JTECHA1006.1, 2008. a, b, c, d
Mathieu, M., Couprie, C., and LeCun, Y.: Deep multi-scale video prediction beyond mean square error, arXiv [preprint], https://doi.org/10.48550/arXiv.1511.05440, 2016. a
McCandless, T. and Jiménez, P. A.: Examining the Potential of a Random Forest Derived Cloud Mask from GOES-R Satellites to Improve Solar Irradiance Forecasting, Energies, 13, 1671, https://doi.org/10.3390/en13071671, 2020. a
Miller, S. D., Forsythe, J. M., Partain, P. T., Haynes, J. M., Bankert, R. L., Sengupta, M., Mitrescu, C., Hawkins, J. D., and Haar, T. H. V.: Estimating Three-Dimensional Cloud Structure via Statistically Blended Satellite Observations, J. Appl. Meteorol. Clim., 53, 437–455, https://doi.org/10.1175/JAMC-D-13-070.1, 2014. a
Noh, Y.-J., Haynes, J. M., Miller, S. D., Seaman, C. J., Heidinger, A. K., Weinrich, J., Kulie, M. S., Niznik, M., and Daub, B. J.: A Framework for Satellite-Based 3D Cloud Data: An Overview of the VIIRS Cloud Base Height Retrieval and User Engagement for Aviation Applications, Remote Sens.-UK, 14, 5524, https://doi.org/10.3390/rs14215524, 2022. a, b, c
Norris, J. R., Allen, R. J., Evan, A. T., Zelinka, M. D., O'Dell, C. W., and Klein, S. A.: Evidence for climate change in the satellite cloud record, Nature, 536, 72–75, https://doi.org/10.1038/nature18273, 2016. a
Pan, X., Lu, Y., Zhao, K., Huang, H., Wang, M., and Chen, H.: Improving Nowcasting of Convective Development by Incorporating Polarimetric Radar Variables Into a Deep-Learning Model, Geophys. Res. Lett., 48, e2021GL095302, https://doi.org/10.1029/2021GL095302, 2021. a
Platnick, S., Meyer, K. G., King, M. D., Wind, G., Amarasinghe, N., Marchant, B., Arnold, G. T., Zhang, Z., Hubanks, P. A., Holz, R. E., Yang, P., Ridgway, W. L., and Riedi, J.: The MODIS Cloud Optical and Microphysical Products: Collection 6 Updates and Examples From Terra and Aqua, IEEE T. Geosci. Remote, 55, 502–525, https://doi.org/10.1109/TGRS.2016.2610522, 2017. a
Rasp, S., Pritchard, M. S., and Gentine, P.: Deep learning to represent sub-grid processes in climate models, P. Natl. Acad. Sci. USA, 115, 9684–9689, https://doi.org/10.1073/pnas.1810286115, 2018. a, b
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., and Prabhat: Deep learning and process understanding for data-driven Earth system science, Nature, 566, 195–204, https://doi.org/10.1038/s41586-019-0912-1, 2019. a
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., Luccioni, A. S., Maharaj, T., Sherwin, E. D., Mukkavilli, S. K., Kording, K. P., Gomes, C. P., Ng, A. Y., Hassabis, D., Platt, J. C., Creutzig, F., Chayes, J., and Bengio, Y.: Tackling Climate Change with Machine Learning, ACM Comput. Surv., 55, 1–96, https://doi.org/10.1145/3485128, 2022. a
Ronneberger, O., Fischer, P., and Brox, T.: U-Net: Convolutional Networks for Biomedical Image Segmentation., in: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, edited by: Navab, N., Hornegger, J., Wells, W. M., and Frangi, A. F., Springer International Publishing, Cham, 234–241, https://doi.org/10.1007/978-3-319-24574-4_28, 2015. a, b
Runge, J., Bathiany, S., Bollt, E., Camps-Valls, G., Coumou, D., Deyle, E., Glymour, C., Kretschmer, M., Mahecha, M. D., Muñoz-Marí, J., van Nes, E. H., Peters, J., Quax, R., Reichstein, M., Scheffer, M., Schölkopf, B., Spirtes, P., Sugihara, G., Sun, J., Zhang, K., and Zscheischler, J.: Inferring causation from time series in Earth system sciences, Nat. Commun., 10, 2553, https://doi.org/10.1038/s41467-019-10105-3, 2019. a
Schmetz, J., Pili, P., Tjemkes, S., Just, D., Kerkmann, J., Rota, S., and Ratier, A.: An Introduction to Meteosat Second Generation (MSG), B. Am. Meteorol. Soc., 83, 977–992, https://doi.org/10.1175/1520-0477(2002)083<0977:AITMSG>2.3.CO;2, 2002. a, b, c, d
Seiz, G. and Davies, R.: Reconstruction of cloud geometry from multi-view satellite images, Remote Sens. Environ., 100, 143–149, https://doi.org/10.1016/j.rse.2005.09.016, 2006. a
Shepherd, T. G.: Atmospheric circulation as a source of uncertainty in climate change projections, Nat. Geosci., 7, 703–708, https://doi.org/10.1038/ngeo2253, 2014. a
Sieglaff, J., Hartung, D., Feltz, W., Cronce, L., and Lakshmanan, V.: A Satellite-Based Convective Cloud Object Tracking and Multipurpose Data Fusion Tool with Application to Developing Convection, J. Atmos. Ocean. Tech., 30, 510–525, https://doi.org/10.1175/JTECH-D-12-00114.1, 2013. a
Steiner, M., Houze, R. A., and Yuter, S. E.: Climatological Characterization of Three-Dimensional Storm Structure from Operational Radar and Rain Gauge Data, J. Appl. Meteorol. Clim., 34, 1978–2007, https://doi.org/10.1175/1520-0450(1995)034<1978:CCOTDS>2.0.CO;2, 1995. a, b
Stephens, G. L., Vane, D. G., Tanelli, S., Im, E., Durden, S., Rokey, M., Reinke, D., Partain, P., Mace, G. G., Austin, R., L'Ecuyer, T., Haynes, J., Lebsock, M., Suzuki, K., Waliser, D., Wu, D., Kay, J., Gettelman, A., Wang, Z., and Marchand, R.: CloudSat mission: Performance and early science after the first year of operation, J. Geophys. Res.-Atmos., 113, D8, https://doi.org/10.1029/2008JD009982, 2008. a, b, c, d, e
Stevens, B. and Bony, S.: What Are Climate Models Missing?, Science, 340, 1053–1054, https://doi.org/10.1126/science.1237554, 2013. a
Tarrio, K., Tang, X., Masek, J. G., Claverie, M., Ju, J., Qiu, S., Zhu, Z., and Woodcock, C. E.: Comparison of cloud detection algorithms for Sentinel-2 imagery, Science of Remote Sens., 2, 100010, https://doi.org/10.1016/j.srs.2020.100010, 2020. a
Thies, B. and Bendix, J.: Satellite based remote sensing of weather and climate: recent achievements and future perspectives, Meteorol. Appl., 18, 262–295, https://doi.org/10.1002/met.288, 2011. a, b
Troyanskaya, O., Cantor, M., Sherlock, G., Brown, P., Hastie, T., Tibshirani, R., Botstein, D., and Altman, R. B.: Missing value estimation methods for DNA microarrays, Bioinformatics, 17, 520–525, https://doi.org/10.1093/bioinformatics/17.6.520, 2001. a
Vial, J., Dufresne, J.-L., and Bony, S.: On the interpretation of inter-model spread in CMIP5 climate sensitivity estimates, Clim. Dynam., 41, 3339–3362, https://doi.org/10.1007/s00382-013-1725-9, 2013. a
Wang, F., Liu, Y., Zhou, Y., Sun, R., Duan, J., Li, Y., Ding, Q., and Wang, H.: Retrieving Vertical Cloud Radar Reflectivity from MODIS Cloud Products with CGAN: An Evaluation for Different Cloud Types and Latitudes, Remote Sens.-UK, 15, 816, https://doi.org/10.3390/rs15030816, 2023. a, b, c, d, e, f, g, h
Wang, S., Chen, W., Xie, S. M., Azzari, G., and Lobell, D. B.: Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery, Remote Sens.-UK, 12, 207, https://doi.org/10.3390/rs12020207, 2020. a
Wang, Z., Zhao, J., Zhang, R., Li, Z., Lin, Q., and Wang, X.: UATNet: U-Shape Attention-Based Transformer Net for Meteorological Satellite Cloud Recognition, Remote Sens.-UK, 14, 104, https://doi.org/10.3390/rs14010104, 2022. a
Wieland, M., Li, Y., and Martinis, S.: Multi-sensor cloud and cloud shadow segmentation with a convolutional neural network, Remote Sens. Environ., 230, 111203, https://doi.org/10.1016/j.rse.2019.05.022, 2019. a
Zantedeschi, V., Falasca, F., Douglas, A., Strange, R., Kusner, M. J., and Watson-Parris, D.: Cumulo: A Dataset for Learning Cloud Classes, arXiv [preprint], https://doi.org/10.48550/arXiv.1911.04227, 2022. a
Zhang, D., He, Y., Li, X., Zhang, L., and Xu, N.: PrecipGradeNet: A New Paradigm and Model for Precipitation Retrieval with Grading of Precipitation Intensity, Remote Sens.-UK, 15, 227, https://doi.org/10.3390/rs15010227, 2023. a, b
Zhang, Z., Ackerman, A. S., Feingold, G., Platnick, S., Pincus, R., and Xue, H.: Effects of cloud horizontal inhomogeneity and drizzle on remote sensing of cloud droplet effective radius: Case studies based on large-eddy simulations, J. Geophys. Res.-Atmos., 117, D19, https://doi.org/10.1029/2012JD017655, 2012. a
Short summary
We apply the Res-UNet to derive a comprehensive 3D cloud tomography from 2D satellite data over heterogeneous landscapes. We combine observational data from passive and active remote sensing sensors by an automated matching algorithm. These data are fed into a neural network to predict cloud reflectivities on the whole satellite domain between 2.4 and 24 km height. With an average RMSE of 2.99 dBZ, we contribute to closing data gaps in the representation of clouds in observational data.
We apply the Res-UNet to derive a comprehensive 3D cloud tomography from 2D satellite data over...