Articles | Volume 14, issue 12
https://doi.org/10.5194/amt-14-7729-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-14-7729-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
09 Dec 2021
Research article |
| 09 Dec 2021
| 09 Dec 2021
Inpainting radar missing data regions with deep learning
Pacific Northwest National Laboratory, Atmospheric Sciences and Global Change Division, Richland, WA, USA
Joseph C. Hardin
Pacific Northwest National Laboratory, Atmospheric Sciences and Global Change Division, Richland, WA, USA
Related authors
Andrew Geiss and Po-Lun Ma
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-30, https://doi.org/10.5194/gmd-2024-30, 2024
Preprint under review for GMD
Short summary
Short summary
Particles in the Earth’s atmosphere strongly impact the planet’s energy budget and atmosphere simulations require accurately representing their interaction with light. This work introduces two approaches to representing light scattering by small particles. The first is a scattering simulation based on Mie theory implemented in Python. The second is a neural network emulator that is more accurate than existing methods and is fast enough to be used in climate and weather simulations.
Andrew Geiss, Po-Lun Ma, Balwinder Singh, and Joseph C. Hardin
Geosci. Model Dev., 16, 2355–2370, https://doi.org/10.5194/gmd-16-2355-2023, https://doi.org/10.5194/gmd-16-2355-2023, 2023
Short summary
Short summary
Atmospheric aerosols play a critical role in Earth's climate, but it is too computationally expensive to directly model their interaction with radiation in climate simulations. This work develops a new neural-network-based parameterization of aerosol optical properties for use in the Energy Exascale Earth System Model that is much more accurate than the current one; it also introduces a unique model optimization method that involves randomly generating neural network architectures.
Andrew Geiss, Sam J. Silva, and Joseph C. Hardin
Geosci. Model Dev., 15, 6677–6694, https://doi.org/10.5194/gmd-15-6677-2022, https://doi.org/10.5194/gmd-15-6677-2022, 2022
Short summary
Short summary
This work demonstrates the use of modern machine learning techniques to enhance the resolution of atmospheric chemistry simulations. We evaluate the schemes for an 8 x 10 increase in resolution and find that they perform substantially better than conventional methods. Methods are introduced to target machine learning methods towards this type of problem, most notably by ensuring they do not break known physical constraints.
Andrew Geiss and Roger Marchand
Atmos. Chem. Phys., 19, 7547–7565, https://doi.org/10.5194/acp-19-7547-2019, https://doi.org/10.5194/acp-19-7547-2019, 2019
Short summary
Short summary
The 13-year trends in cloud occurrence, observed by NASA's Multi-angle Imaging SpectroRadiometer, over the world's extratropical ocean basins are compared to trends in meteorological variables. We identify several patterns of changing cloud occurrence that correspond to specific patterns in trending meteorology. We find that many of these trends are related to changes in major modes of climate variability.
Andrew Geiss and Po-Lun Ma
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-30, https://doi.org/10.5194/gmd-2024-30, 2024
Preprint under review for GMD
Short summary
Short summary
Particles in the Earth’s atmosphere strongly impact the planet’s energy budget and atmosphere simulations require accurately representing their interaction with light. This work introduces two approaches to representing light scattering by small particles. The first is a scattering simulation based on Mie theory implemented in Python. The second is a neural network emulator that is more accurate than existing methods and is fast enough to be used in climate and weather simulations.
Shuaiqi Tang, Adam C. Varble, Jerome D. Fast, Kai Zhang, Peng Wu, Xiquan Dong, Fan Mei, Mikhail Pekour, Joseph C. Hardin, and Po-Lun Ma
Geosci. Model Dev., 16, 6355–6376, https://doi.org/10.5194/gmd-16-6355-2023, https://doi.org/10.5194/gmd-16-6355-2023, 2023
Short summary
Short summary
To assess the ability of Earth system model (ESM) predictions, we developed a tool called ESMAC Diags to understand how aerosols, clouds, and aerosol–cloud interactions are represented in ESMs. This paper describes its version 2 functionality. We compared the model predictions with measurements taken by planes, ships, satellites, and ground instruments over four regions across the world. Results show that this new tool can help identify model problems and guide future development of ESMs.
Zhe Feng, Joseph Hardin, Hannah C. Barnes, Jianfeng Li, L. Ruby Leung, Adam Varble, and Zhixiao Zhang
Geosci. Model Dev., 16, 2753–2776, https://doi.org/10.5194/gmd-16-2753-2023, https://doi.org/10.5194/gmd-16-2753-2023, 2023
Short summary
Short summary
PyFLEXTRKR is a flexible atmospheric feature tracking framework with specific capabilities to track convective clouds from a variety of observations and model simulations. The package has a collection of multi-object identification algorithms and has been optimized for large datasets. This paper describes the algorithms and demonstrates applications for tracking deep convective cells and mesoscale convective systems from observations and model simulations at a wide range of scales.
Andrew Geiss, Po-Lun Ma, Balwinder Singh, and Joseph C. Hardin
Geosci. Model Dev., 16, 2355–2370, https://doi.org/10.5194/gmd-16-2355-2023, https://doi.org/10.5194/gmd-16-2355-2023, 2023
Short summary
Short summary
Atmospheric aerosols play a critical role in Earth's climate, but it is too computationally expensive to directly model their interaction with radiation in climate simulations. This work develops a new neural-network-based parameterization of aerosol optical properties for use in the Energy Exascale Earth System Model that is much more accurate than the current one; it also introduces a unique model optimization method that involves randomly generating neural network architectures.
Andrew Geiss, Sam J. Silva, and Joseph C. Hardin
Geosci. Model Dev., 15, 6677–6694, https://doi.org/10.5194/gmd-15-6677-2022, https://doi.org/10.5194/gmd-15-6677-2022, 2022
Short summary
Short summary
This work demonstrates the use of modern machine learning techniques to enhance the resolution of atmospheric chemistry simulations. We evaluate the schemes for an 8 x 10 increase in resolution and find that they perform substantially better than conventional methods. Methods are introduced to target machine learning methods towards this type of problem, most notably by ensuring they do not break known physical constraints.
Shuaiqi Tang, Jerome D. Fast, Kai Zhang, Joseph C. Hardin, Adam C. Varble, John E. Shilling, Fan Mei, Maria A. Zawadowicz, and Po-Lun Ma
Geosci. Model Dev., 15, 4055–4076, https://doi.org/10.5194/gmd-15-4055-2022, https://doi.org/10.5194/gmd-15-4055-2022, 2022
Short summary
Short summary
We developed an Earth system model (ESM) diagnostics package to compare various types of aerosol properties simulated in ESMs with aircraft, ship, and surface measurements from six field campaigns across spatial scales. The diagnostics package is coded and organized to be flexible and modular for future extension to other field campaign datasets and adapted to higher-resolution model simulations. Future releases will include comprehensive cloud and aerosol–cloud interaction diagnostics.
Christopher R. Williams, Karen L. Johnson, Scott E. Giangrande, Joseph C. Hardin, Ruşen Öktem, and David M. Romps
Atmos. Meas. Tech., 14, 4425–4444, https://doi.org/10.5194/amt-14-4425-2021, https://doi.org/10.5194/amt-14-4425-2021, 2021
Short summary
Short summary
In addition to detecting clouds, vertically pointing cloud radars detect individual insects passing over head. If these insects are not identified and removed from raw observations, then radar-derived cloud properties will be contaminated. This work identifies clouds in radar observations due to their continuous and smooth structure in time, height, and velocity. Cloud masks are produced that identify cloud vertical structure that are free of insect contamination.
Sam J. Silva, Po-Lun Ma, Joseph C. Hardin, and Daniel Rothenberg
Geosci. Model Dev., 14, 3067–3077, https://doi.org/10.5194/gmd-14-3067-2021, https://doi.org/10.5194/gmd-14-3067-2021, 2021
Short summary
Short summary
The activation of aerosol into cloud droplets is an important but uncertain process in the Earth system. The physical and chemical interactions that govern this process are too computationally expensive to explicitly resolve in modern Earth system models. Here, we demonstrate how hybrid machine learning approaches can provide a potential path forward, enabling the representation of the more detailed physics and chemistry at a reduced computational cost while still retaining physical information.
Alexis Hunzinger, Joseph C. Hardin, Nitin Bharadwaj, Adam Varble, and Alyssa Matthews
Atmos. Meas. Tech., 13, 3147–3166, https://doi.org/10.5194/amt-13-3147-2020, https://doi.org/10.5194/amt-13-3147-2020, 2020
Short summary
Short summary
The calibration of weather radars is one of the most dominant sources of errors hindering their use. This work takes a technique for tracking the changes in radar calibration using the radar clutter from the ground and extends it to higher-frequency research radars. It demonstrates that after modifications the technique is successful but that special care needs to be taken in its application at high frequencies. The technique is verified using data from multiple DOE ARM field campaigns.
Andrew Geiss and Roger Marchand
Atmos. Chem. Phys., 19, 7547–7565, https://doi.org/10.5194/acp-19-7547-2019, https://doi.org/10.5194/acp-19-7547-2019, 2019
Short summary
Short summary
The 13-year trends in cloud occurrence, observed by NASA's Multi-angle Imaging SpectroRadiometer, over the world's extratropical ocean basins are compared to trends in meteorological variables. We identify several patterns of changing cloud occurrence that correspond to specific patterns in trending meteorology. We find that many of these trends are related to changes in major modes of climate variability.
Christopher R. Williams, Maximilian Maahn, Joseph C. Hardin, and Gijs de Boer
Atmos. Meas. Tech., 11, 4963–4980, https://doi.org/10.5194/amt-11-4963-2018, https://doi.org/10.5194/amt-11-4963-2018, 2018
Short summary
Short summary
This study presents three signal-processing methods to improve estimates derived from a vertically pointing 35 GHz cloud radar deployed at Oliktok Point, Alaska. The first method removes ground clutter from the Doppler velocity spectra. The second method estimates multiple peaks and high-order moments from the improved spectra. The third method removes high-frequency variability in high-order moments by shifting original 2 s spectra to a common reference before averaging over a 15 s interval.
Die Wang, Scott E. Giangrande, Mary Jane Bartholomew, Joseph Hardin, Zhe Feng, Ryan Thalman, and Luiz A. T. Machado
Atmos. Chem. Phys., 18, 9121–9145, https://doi.org/10.5194/acp-18-9121-2018, https://doi.org/10.5194/acp-18-9121-2018, 2018
Related subject area
Subject: Clouds | Technique: Remote Sensing | Topic: Data Processing and Information Retrieval
A cloud-by-cloud approach for studying aerosol–cloud interaction in satellite observations
Geometrical and optical properties of cirrus clouds in Barcelona, Spain: analysis with the two-way transmittance method of 4 years of lidar measurements
Determination of the vertical distribution of in-cloud particle shape using SLDR-mode 35 GHz scanning cloud radar
Artificial intelligence (AI)-derived 3D cloud tomography from geostationary 2D satellite data
The EarthCARE mission: science data processing chain overview
Cloud optical and physical properties retrieval from EarthCARE multi-spectral imager: the M-COP products
Cloud top heights and aerosol columnar properties from combined EarthCARE lidar and imager observations: the AM-CTH and AM-ACD products
Raman lidar-derived optical and microphysical properties of ice crystals within thin Arctic clouds during PARCS campaign
Evaluation of four ground-based retrievals of cloud droplet number concentration in marine stratocumulus with aircraft in situ measurements
Deep convective cloud system size and structure across the global tropics and subtropics
A neural-network-based method for generating synthetic 1.6 µm near-infrared satellite images
Numerical model generation of test frames for pre-launch studies of EarthCARE's retrieval algorithms and data management system
Segmentation of polarimetric radar imagery using statistical texture
Retrieval of surface solar irradiance from satellite imagery using machine learning: pitfalls and perspectives
Retrieving 3D distributions of atmospheric particles using Atmospheric Tomography with 3D Radiative Transfer – Part 2: Local optimization
Particle inertial effects on radar Doppler spectra simulation
Detection of aerosol and cloud features for the EarthCARE atmospheric lidar (ATLID): the ATLID FeatureMask (A-FM) product
A unified synergistic retrieval of clouds, aerosols, and precipitation from EarthCARE: the ACM-CAP product
Incorporating EarthCARE observations into a multi-lidar cloud climate record: the ATLID (Atmospheric Lidar) cloud climate product
Introduction to EarthCARE synthetic data using a global storm-resolving simulation
Validation of a camera-based intra-hour irradiance nowcasting model using synthetic cloud data
Liquid cloud optical property retrieval and associated uncertainties using multi-angular and bispectral measurements of the airborne radiometer OSIRIS
Global evaluation of Doppler velocity errors of EarthCARE cloud-profiling radar using a global storm-resolving simulation
Multiple-scattering effects on single-wavelength lidar sounding of multi-layered clouds
Cloud and precipitation microphysical retrievals from the EarthCARE Cloud Profiling Radar: the C-CLD product
Cloud mask algorithm from the EarthCARE Multi-Spectral Imager: the M-CM products
Across-track extension of retrieved cloud and aerosol properties for the EarthCARE mission: the ACMB-3D product
Insights into 3D cloud radiative transfer effects for the Orbiting Carbon Observatory
Evaluation of polarimetric ice microphysical retrievals with OLYMPEX campaign data
Retrieving 3D distributions of atmospheric particles using Atmospheric Tomography with 3D Radiative Transfer – Part 1: Model description and Jacobian calculation
Simulation and sensitivity analysis for cloud and precipitation measurements via spaceborne millimeter-wave radar
The Virga-Sniffer – a new tool to identify precipitation evaporation using ground-based remote-sensing observations
Near-global distributions of overshooting tops derived from Terra and Aqua MODIS observations
Climatology of estimated liquid water content and scaling factor for warm clouds using radar–microwave radiometer synergy
Optimizing cloud motion estimation on the edge with phase correlation and optical flow
A semi-Lagrangian method for detecting and tracking deep convective clouds in geostationary satellite observations
The CHROMA cloud-top pressure retrieval algorithm for the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite mission
High-spatial-resolution retrieval of cloud droplet size distribution from polarized observations of the cloudbow
Evaluation of the spectral misalignment on the Earth Clouds, Aerosols and Radiation Explorer/multi-spectral imager cloud product
Retrieval of terahertz ice cloud properties from airborne measurements based on the irregularly shaped Voronoi ice scattering models
Latent heating profiles from GOES-16 and its impacts on precipitation forecasts
A CO2-independent cloud mask from Infrared Atmospheric Sounding Interferometer (IASI) radiances for climate applications
Retrieval of ice water path from the Microwave Humidity Sounder (MWHS) aboard FengYun-3B (FY-3B) satellite polarimetric measurements based on a deep neural network
Intercomparison of Sentinel-5P TROPOMI cloud products for tropospheric trace gas retrievals
Improved spectral processing for a multi-mode pulse compression Ka–Ku-band cloud radar system
Uncertainty-bounded estimates of ash cloud properties using the ORAC algorithm: application to the 2019 Raikoke eruption
Ice water path retrievals from Meteosat-9 using quantile regression neural networks
An optimal estimation algorithm for the retrieval of fog and low cloud thermodynamic and micro-physical properties
Identifying cloud droplets beyond lidar attenuation from vertically pointing cloud radar observations using artificial neural networks
Segmentation-based multi-pixel cloud optical thickness retrieval using a convolutional neural network
Fani Alexandri, Felix Müller, Goutam Choudhury, Peggy Achtert, Torsten Seelig, and Matthias Tesche
Atmos. Meas. Tech., 17, 1739–1757, https://doi.org/10.5194/amt-17-1739-2024, https://doi.org/10.5194/amt-17-1739-2024, 2024
Short summary
Short summary
We present a novel method for studying aerosol–cloud interactions. It combines cloud-relevant aerosol concentrations from polar-orbiting lidar observations with the development of individual clouds from geostationary observations. Application to 1 year of data gives first results on the impact of aerosols on the concentration and size of cloud droplets and on cloud phase in the regime of heterogeneous ice formation. The method could enable the systematic investigation of warm and cold clouds.
Cristina Gil-Díaz, Michäel Sicard, Adolfo Comerón, Daniel Camilo Fortunato dos Santos Oliveira, Constantino Muñoz-Porcar, Alejandro Rodríguez-Gómez, Jasper R. Lewis, Ellsworth J. Welton, and Simone Lolli
Atmos. Meas. Tech., 17, 1197–1216, https://doi.org/10.5194/amt-17-1197-2024, https://doi.org/10.5194/amt-17-1197-2024, 2024
Short summary
Short summary
In this paper, a statistical study of cirrus geometrical and optical properties based on 4 years of continuous ground-based lidar measurements with the Barcelona (Spain) Micro Pulse Lidar (MPL) is analysed. The cloud optical depth, effective column lidar ratio and linear cloud depolarisation ratio have been calculated by a new approach to the two-way transmittance method, which is valid for both ground-based and spaceborne lidar systems. Their associated errors are also provided.
Audrey Teisseire, Patric Seifert, Alexander Myagkov, Johannes Bühl, and Martin Radenz
Atmos. Meas. Tech., 17, 999–1016, https://doi.org/10.5194/amt-17-999-2024, https://doi.org/10.5194/amt-17-999-2024, 2024
Short summary
Short summary
The vertical distribution of particle shape (VDPS) method, introduced in this study, aids in characterizing the density-weighted shape of cloud particles from scanning slanted linear depolarization ratio (SLDR)-mode cloud radar observations. The VDPS approach represents a new, versatile way to study microphysical processes by combining a spheroidal scattering model with real measurements of SLDR.
Sarah Brüning, Stefan Niebler, and Holger Tost
Atmos. Meas. Tech., 17, 961–978, https://doi.org/10.5194/amt-17-961-2024, https://doi.org/10.5194/amt-17-961-2024, 2024
Short summary
Short summary
We apply the Res-UNet to derive a comprehensive 3D cloud tomography from 2D satellite data over heterogeneous landscapes. We combine observational data from passive and active remote sensing sensors by an automated matching algorithm. These data are fed into a neural network to predict cloud reflectivities on the whole satellite domain between 2.4 and 24 km height. With an average RMSE of 2.99 dBZ, we contribute to closing data gaps in the representation of clouds in observational data.
Michael Eisinger, Fabien Marnas, Kotska Wallace, Takuji Kubota, Nobuhiro Tomiyama, Yuichi Ohno, Toshiyuki Tanaka, Eichi Tomita, Tobias Wehr, and Dirk Bernaerts
Atmos. Meas. Tech., 17, 839–862, https://doi.org/10.5194/amt-17-839-2024, https://doi.org/10.5194/amt-17-839-2024, 2024
Short summary
Short summary
The Earth Cloud Aerosol and Radiation Explorer (EarthCARE) is an ESA–JAXA satellite mission to be launched in 2024. We presented an overview of the EarthCARE processors' development, with processors developed by teams in Europe, Japan, and Canada. EarthCARE will allow scientists to evaluate the representation of cloud, aerosol, precipitation, and radiative flux in weather forecast and climate models, with the objective to better understand cloud processes and improve weather and climate models.
Anja Hünerbein, Sebastian Bley, Hartwig Deneke, Jan Fokke Meirink, Gerd-Jan van Zadelhoff, and Andi Walther
Atmos. Meas. Tech., 17, 261–276, https://doi.org/10.5194/amt-17-261-2024, https://doi.org/10.5194/amt-17-261-2024, 2024
Short summary
Short summary
The ESA cloud, aerosol and radiation mission EarthCARE will provide active profiling and passive imaging measurements from a single satellite platform. The passive multi-spectral imager (MSI) will add information in the across-track direction. We present the cloud optical and physical properties algorithm, which combines the visible to infrared MSI channels to determine the cloud top pressure, optical thickness, particle size and water path.
Moritz Haarig, Anja Hünerbein, Ulla Wandinger, Nicole Docter, Sebastian Bley, David Donovan, and Gerd-Jan van Zadelhoff
Atmos. Meas. Tech., 16, 5953–5975, https://doi.org/10.5194/amt-16-5953-2023, https://doi.org/10.5194/amt-16-5953-2023, 2023
Short summary
Short summary
The atmospheric lidar (ATLID) and Multi-Spectral Imager (MSI) will be carried by the EarthCARE satellite. The synergistic ATLID–MSI Column Products (AM-COL) algorithm described in the paper combines the strengths of ATLID in vertically resolved profiles of aerosol and clouds (e.g., cloud top height) with the strengths of MSI in observing the complete scene beside the satellite track and in extending the lidar information to the swath. The algorithm is validated against simulated test scenes.
Patrick Chazette and Jean-Christophe Raut
Atmos. Meas. Tech., 16, 5847–5861, https://doi.org/10.5194/amt-16-5847-2023, https://doi.org/10.5194/amt-16-5847-2023, 2023
Short summary
Short summary
The vertical profiles of the effective radii of ice crystals and ice water content in Arctic semi-transparent stratiform clouds were assessed using quantitative ground-based lidar measurements. The field campaign was part of the Pollution in the ARCtic System (PARCS) project which took place from 13 to 26 May 2016 in Hammerfest (70° 39′ 48″ N, 23° 41′ 00″ E). We show that under certain cloud conditions, lidar measurement combined with a dedicated algorithmic approach is an efficient tool.
Damao Zhang, Andrew M. Vogelmann, Fan Yang, Edward Luke, Pavlos Kollias, Zhien Wang, Peng Wu, William I. Gustafson Jr., Fan Mei, Susanne Glienke, Jason Tomlinson, and Neel Desai
Atmos. Meas. Tech., 16, 5827–5846, https://doi.org/10.5194/amt-16-5827-2023, https://doi.org/10.5194/amt-16-5827-2023, 2023
Short summary
Short summary
Cloud droplet number concentration can be retrieved from remote sensing measurements. Aircraft measurements are used to validate four ground-based retrievals of cloud droplet number concentration. We demonstrate that retrieved cloud droplet number concentrations align well with aircraft measurements for overcast clouds, but they may substantially differ for broken clouds. The ensemble of various retrievals can help quantify retrieval uncertainties and identify reliable retrieval scenarios.
Eric M. Wilcox, Tianle Yuan, and Hua Song
Atmos. Meas. Tech., 16, 5387–5401, https://doi.org/10.5194/amt-16-5387-2023, https://doi.org/10.5194/amt-16-5387-2023, 2023
Short summary
Short summary
A new database is constructed from over 20 years of satellite records that comprises millions of deep convective clouds and spans the global tropics and subtropics. The database is a collection of clouds ranging from isolated cells to giant cloud systems. The cloud database provides a means of empirically studying the factors that determine the spatial structure and coverage of convective cloud systems, which are strongly related to the overall radiative forcing by cloud systems.
Florian Baur, Leonhard Scheck, Christina Stumpf, Christina Köpken-Watts, and Roland Potthast
Atmos. Meas. Tech., 16, 5305–5326, https://doi.org/10.5194/amt-16-5305-2023, https://doi.org/10.5194/amt-16-5305-2023, 2023
Short summary
Short summary
Near-infrared satellite images have information on clouds that is complementary to what is available from the visible and infrared parts of the spectrum. Using this information for data assimilation and model evaluation requires a fast, accurate forward operator to compute synthetic images from numerical weather prediction model output. We discuss a novel, neural-network-based approach for the 1.6 µm near-infrared channel that is suitable for this purpose and also works for other solar channels.
Zhipeng Qu, David P. Donovan, Howard W. Barker, Jason N. S. Cole, Mark W. Shephard, and Vincent Huijnen
Atmos. Meas. Tech., 16, 4927–4946, https://doi.org/10.5194/amt-16-4927-2023, https://doi.org/10.5194/amt-16-4927-2023, 2023
Short summary
Short summary
The EarthCARE satellite mission Level 2 algorithm development requires realistic 3D cloud and aerosol scenes along the satellite orbits. One of the best ways to produce these scenes is to use a high-resolution numerical weather prediction model to simulate atmospheric conditions at 250 m horizontal resolution. This paper describes the production and validation of three EarthCARE test scenes.
Adrien Guyot, Jordan P. Brook, Alain Protat, Kathryn Turner, Joshua Soderholm, Nicholas F. McCarthy, and Hamish McGowan
Atmos. Meas. Tech., 16, 4571–4588, https://doi.org/10.5194/amt-16-4571-2023, https://doi.org/10.5194/amt-16-4571-2023, 2023
Short summary
Short summary
We propose a new method that should facilitate the use of weather radars to study wildfires. It is important to be able to identify the particles emitted by wildfires on radar, but it is difficult because there are many other echoes on radar like clear air, the ground, sea clutter, and precipitation. We came up with a two-step process to classify these echoes. Our method is accurate and can be used by fire departments in emergencies or by scientists for research.
Hadrien Verbois, Yves-Marie Saint-Drenan, Vadim Becquet, Benoit Gschwind, and Philippe Blanc
Atmos. Meas. Tech., 16, 4165–4181, https://doi.org/10.5194/amt-16-4165-2023, https://doi.org/10.5194/amt-16-4165-2023, 2023
Short summary
Short summary
Solar surface irradiance (SSI) estimations inferred from satellite images are essential to gain a comprehensive understanding of the solar resource, which is crucial in many fields. This study examines the recent data-driven methods for inferring SSI from satellite images and explores their strengths and weaknesses. The results suggest that while these methods show great promise, they sometimes dramatically underperform and should probably be used in conjunction with physical approaches.
Jesse Loveridge, Aviad Levis, Larry Di Girolamo, Vadim Holodovsky, Linda Forster, Anthony B. Davis, and Yoav Y. Schechner
Atmos. Meas. Tech., 16, 3931–3957, https://doi.org/10.5194/amt-16-3931-2023, https://doi.org/10.5194/amt-16-3931-2023, 2023
Short summary
Short summary
We test a new method for measuring the 3D spatial variations of water within clouds, using measurements of reflections of the Sun's light observed at multiple angles by satellites. This is a great improvement on older methods, which typically assume that clouds occur in a slab shape. Our study used computer modeling to show that our 3D method will work well in cumulus clouds, where older slab methods do not. Our method will inform us about these clouds and their role in our climate.
Zeen Zhu, Pavlos Kollias, and Fan Yang
Atmos. Meas. Tech., 16, 3727–3737, https://doi.org/10.5194/amt-16-3727-2023, https://doi.org/10.5194/amt-16-3727-2023, 2023
Short summary
Short summary
We show that large rain droplets, with large inertia, are unable to follow the rapid change of velocity field in a turbulent environment. A lack of consideration for this inertial effect leads to an artificial broadening of the Doppler spectrum from the conventional simulator. Based on the physics-based simulation, we propose a new approach to generate the radar Doppler spectra. This simulator provides a valuable tool to decode cloud microphysical and dynamical properties from radar observation.
Gerd-Jan van Zadelhoff, David P. Donovan, and Ping Wang
Atmos. Meas. Tech., 16, 3631–3651, https://doi.org/10.5194/amt-16-3631-2023, https://doi.org/10.5194/amt-16-3631-2023, 2023
Short summary
Short summary
The Earth Clouds, Aerosols and Radiation (EarthCARE) satellite mission features the UV lidar ATLID. The ATLID FeatureMask algorithm provides a high-resolution detection probability mask which is used to guide smoothing strategies within the ATLID profile retrieval algorithm, one step further in the EarthCARE level-2 processing chain, in which the microphysical retrievals and target classification are performed.
Shannon L. Mason, Robin J. Hogan, Alessio Bozzo, and Nicola L. Pounder
Atmos. Meas. Tech., 16, 3459–3486, https://doi.org/10.5194/amt-16-3459-2023, https://doi.org/10.5194/amt-16-3459-2023, 2023
Short summary
Short summary
We present a method for accurately estimating the contents and properties of clouds, snow, rain, and aerosols through the atmosphere, using the combined measurements of the radar, lidar, and radiometer instruments aboard the upcoming EarthCARE satellite, and evaluate the performance of the retrieval, using test scenes simulated from a numerical forecast model. When EarthCARE is in operation, these quantities and their estimated uncertainties will be distributed in a data product called ACM-CAP.
Artem G. Feofilov, Hélène Chepfer, Vincent Noël, and Frederic Szczap
Atmos. Meas. Tech., 16, 3363–3390, https://doi.org/10.5194/amt-16-3363-2023, https://doi.org/10.5194/amt-16-3363-2023, 2023
Short summary
Short summary
The response of clouds to human-induced climate warming remains the largest source of uncertainty in model predictions of climate. We consider cloud retrievals from spaceborne observations, the existing CALIOP lidar and future ATLID lidar; show how they compare for the same scenes; and discuss the advantage of adding a new lidar for detecting cloud changes in the long run. We show that ATLID's advanced technology should allow for better detecting thinner clouds during daytime than before.
Woosub Roh, Masaki Satoh, Tempei Hashino, Shuhei Matsugishi, Tomoe Nasuno, and Takuji Kubota
Atmos. Meas. Tech., 16, 3331–3344, https://doi.org/10.5194/amt-16-3331-2023, https://doi.org/10.5194/amt-16-3331-2023, 2023
Short summary
Short summary
JAXA EarthCARE synthetic data (JAXA L1 data) were compiled using the global storm-resolving model (GSRM) NICAM (Nonhydrostatic ICosahedral
Atmospheric Model) simulation with 3.5 km horizontal resolution and the Joint-Simulator. JAXA L1 data are intended to support the development of JAXA retrieval algorithms for the EarthCARE sensor before launch of the satellite. The expected orbit of EarthCARE and horizontal sampling of each sensor were used to simulate the signals.
Philipp Gregor, Tobias Zinner, Fabian Jakub, and Bernhard Mayer
Atmos. Meas. Tech., 16, 3257–3271, https://doi.org/10.5194/amt-16-3257-2023, https://doi.org/10.5194/amt-16-3257-2023, 2023
Short summary
Short summary
This work introduces MACIN, a model for short-term forecasting of direct irradiance for solar energy applications. MACIN exploits cloud images of multiple cameras to predict irradiance. The model is applied to artificial images of clouds from a weather model. The artificial cloud data allow for a more in-depth evaluation and attribution of errors compared with real data. Good performance of derived cloud information and significant forecast improvements over a baseline forecast were found.
Christian Matar, Céline Cornet, Frédéric Parol, Laurent C.-Labonnote, Frédérique Auriol, and Marc Nicolas
Atmos. Meas. Tech., 16, 3221–3243, https://doi.org/10.5194/amt-16-3221-2023, https://doi.org/10.5194/amt-16-3221-2023, 2023
Short summary
Short summary
The optimal estimation formalism is applied to OSIRIS airborne high-resolution multi-angular measurements to retrieve COT and Reff. The corresponding uncertainties related to measurement errors, which are up to 6 and 12 %, the non-retrieved parameters, which are less than 0.5 %, and the cloud model assumptions show that the heterogeneous vertical profiles and the 3D radiative transfer effects lead to average uncertainties of 5 and 4 % for COT and 13 and 9 % for Reff.
Yuichiro Hagihara, Yuichi Ohno, Hiroaki Horie, Woosub Roh, Masaki Satoh, and Takuji Kubota
Atmos. Meas. Tech., 16, 3211–3219, https://doi.org/10.5194/amt-16-3211-2023, https://doi.org/10.5194/amt-16-3211-2023, 2023
Short summary
Short summary
The CPR on the EarthCARE satellite is the first satellite-borne Doppler radar. We evaluated the effectiveness of horizontal integration and the unfolding method for the reduction of the Doppler error (the standard deviation of the random error) in the CPR_ECO product. The error was higher in the tropics than in the other latitudes due to frequent rain echo occurrence and limitation of its unfolding correction. If we use low-mode operation (high PRF), the errors become small enough.
Valery Shcherbakov, Frédéric Szczap, Guillaume Mioche, and Céline Cornet
Atmos. Meas. Tech. Discuss., https://doi.org/10.5194/amt-2023-109, https://doi.org/10.5194/amt-2023-109, 2023
Revised manuscript accepted for AMT
Short summary
Short summary
We performed Monte Carlo simulations of single-wavelength lidar signals from multi-layered clouds with special attention focused on multiple-scattering (MS) effect in regions of the cloud-free molecular atmosphere. The MS effect on lidar signals is always decreasing with the increasing distance from the cloud far edge. The decreasing is the direct consequence of the fact that the forward peak of particles phase functions is much larger than the receiver field of view.
Kamil Mroz, Bernat Puidgomènech Treserras, Alessandro Battaglia, Pavlos Kollias, Aleksandra Tatarevic, and Frederic Tridon
Atmos. Meas. Tech., 16, 2865–2888, https://doi.org/10.5194/amt-16-2865-2023, https://doi.org/10.5194/amt-16-2865-2023, 2023
Short summary
Short summary
We present the theoretical basis of the algorithm that estimates the amount of water and size of particles in clouds and precipitation. The algorithm uses data collected by the Cloud Profiling Radar that was developed for the upcoming Earth Clouds, Aerosols and Radiation Explorer (EarthCARE) satellite mission. After the satellite launch, the vertical distribution of cloud and precipitation properties will be delivered as the C-CLD product.
Anja Hünerbein, Sebastian Bley, Stefan Horn, Hartwig Deneke, and Andi Walther
Atmos. Meas. Tech., 16, 2821–2836, https://doi.org/10.5194/amt-16-2821-2023, https://doi.org/10.5194/amt-16-2821-2023, 2023
Short summary
Short summary
The Multi-Spectral Imager (MSI) on board the EarthCARE satellite will provide the information needed for describing the cloud and aerosol properties in the cross-track direction, complementing the measurements from the Cloud Profiling Radar, Atmospheric Lidar and Broad-Band Radiometer. The accurate discrimination between clear and cloudy pixels is an essential first step. Therefore, the cloud mask algorithm provides a cloud flag, cloud phase and cloud type product for the MSI observations.
Zhipeng Qu, Howard W. Barker, Jason N. S. Cole, and Mark W. Shephard
Atmos. Meas. Tech., 16, 2319–2331, https://doi.org/10.5194/amt-16-2319-2023, https://doi.org/10.5194/amt-16-2319-2023, 2023
Short summary
Short summary
This paper describes EarthCARE’s L2 product ACM-3D. It includes the scene construction algorithm (SCA) used to produce the indexes for reconstructing 3D atmospheric scene based on satellite nadir retrievals. It also provides the information about the buffer zone sizes of 3D assessment domains and the ranking scores for selecting the best 3D assessment domains. These output variables are needed to run 3D radiative transfer models for the radiative closure assessment of EarthCARE’s L2 retrievals.
Steven T. Massie, Heather Cronk, Aronne Merrelli, Sebastian Schmidt, and Steffen Mauceri
Atmos. Meas. Tech., 16, 2145–2166, https://doi.org/10.5194/amt-16-2145-2023, https://doi.org/10.5194/amt-16-2145-2023, 2023
Short summary
Short summary
This paper provides insights into the effects of clouds on Orbiting Carbon Observatory (OCO-2) measurements of CO2. Calculations are carried out that indicate the extent to which this satellite experiment underestimates CO2, due to these cloud effects, as a function of the distance between the surface observation footprint and the nearest cloud. The paper discusses how to lessen the influence of these cloud effects.
Armin Blanke, Andrew J. Heymsfield, Manuel Moser, and Silke Trömel
Atmos. Meas. Tech., 16, 2089–2106, https://doi.org/10.5194/amt-16-2089-2023, https://doi.org/10.5194/amt-16-2089-2023, 2023
Short summary
Short summary
We present an evaluation of current retrieval techniques in the ice phase applied to polarimetric radar measurements with collocated in situ observations of aircraft conducted over the Olympic Mountains, Washington State, during winter 2015. Radar estimates of ice properties agreed most with aircraft observations in regions with pronounced radar signatures, but uncertainties were identified that indicate issues of some retrievals, particularly in warmer temperature regimes.
Jesse Loveridge, Aviad Levis, Larry Di Girolamo, Vadim Holodovsky, Linda Forster, Anthony B. Davis, and Yoav Y. Schechner
Atmos. Meas. Tech., 16, 1803–1847, https://doi.org/10.5194/amt-16-1803-2023, https://doi.org/10.5194/amt-16-1803-2023, 2023
Short summary
Short summary
We describe a new method for measuring the 3D spatial variations in water within clouds using the reflected light of the Sun viewed at multiple different angles by satellites. This is a great improvement over older methods, which typically assume that clouds occur in a slab shape. Our study used computer modeling to show that our 3D method will work well in cumulus clouds, where older slab methods do not. Our method will inform us about these clouds and their role in our climate.
Leilei Kou, Zhengjian Lin, Haiyang Gao, Shujun Liao, and Piman Ding
Atmos. Meas. Tech., 16, 1723–1744, https://doi.org/10.5194/amt-16-1723-2023, https://doi.org/10.5194/amt-16-1723-2023, 2023
Short summary
Short summary
Forward modeling of spaceborne millimeter-wave radar composed of eight submodules is presented. We quantify the uncertainties in radar reflectivity that may be caused by the physical model parameters via a sensitivity analysis. The simulations with improved and conventional settings are compared with CloudSat data, and the simulation results are evaluated and analyzed. The results are instructive to the optimization of forward modeling and microphysical parameter retrieval.
Heike Kalesse-Los, Anton Kötsche, Andreas Foth, Johannes Röttenbacher, Teresa Vogl, and Jonas Witthuhn
Atmos. Meas. Tech., 16, 1683–1704, https://doi.org/10.5194/amt-16-1683-2023, https://doi.org/10.5194/amt-16-1683-2023, 2023
Short summary
Short summary
The Virga-Sniffer, a new modular open-source Python package tool to characterize full precipitation evaporation (so-called virga) from ceilometer cloud base height and vertically pointing cloud radar reflectivity time–height fields, is described. Results of its first application to RV Meteor observations during the EUREC4A field experiment in January–February 2020 are shown. About half of all detected clouds with bases below the trade inversion height were found to produce virga.
Yulan Hong, Stephen W. Nesbitt, Robert J. Trapp, and Larry Di Girolamo
Atmos. Meas. Tech., 16, 1391–1406, https://doi.org/10.5194/amt-16-1391-2023, https://doi.org/10.5194/amt-16-1391-2023, 2023
Short summary
Short summary
Deep convective updrafts form overshooting tops (OTs) when they extend into the upper troposphere and lower stratosphere. An OT often indicates hazardous weather conditions. The global distribution of OTs is useful for understanding global severe weather conditions. The Moderate Resolution Imaging Spectroradiometer (MODIS) on Aqua and Terra satellites provides 2 decades of records on the Earth–atmosphere system with stable orbits, which are used in this study to derive 20-year OT climatology.
Pragya Vishwakarma, Julien Delanoë, Susana Jorquera, Pauline Martinet, Frederic Burnet, Alistair Bell, and Jean-Charles Dupont
Atmos. Meas. Tech., 16, 1211–1237, https://doi.org/10.5194/amt-16-1211-2023, https://doi.org/10.5194/amt-16-1211-2023, 2023
Short summary
Short summary
Cloud observations are necessary to characterize the cloud properties at local and global scales. The observations must be translated to cloud geophysical parameters. This paper presents the estimation of liquid water content (LWC) using radar and microwave radiometer (MWR) measurements. Liquid water path from MWR scales LWC and retrieves the scaling factor (ln a). The retrievals are compared with in situ observations. A climatology of ln a is built to estimate LWC using only radar information.
Bhupendra A. Raut, Paytsar Muradyan, Rajesh Sankaran, Robert C. Jackson, Seongha Park, Sean A. Shahkarami, Dario Dematties, Yongho Kim, Joseph Swantek, Neal Conrad, Wolfgang Gerlach, Sergey Shemyakin, Pete Beckman, Nicola J. Ferrier, and Scott M. Collis
Atmos. Meas. Tech., 16, 1195–1209, https://doi.org/10.5194/amt-16-1195-2023, https://doi.org/10.5194/amt-16-1195-2023, 2023
Short summary
Short summary
We studied the stability of a blockwise phase correlation (PC) method to estimate cloud motion using a total sky imager (TSI). Shorter frame intervals and larger block sizes improve stability, while image resolution and color channels have minor effects. Raindrop contamination can be identified by the rotational motion of the TSI mirror. The correlations of cloud motion vectors (CMVs) from the PC method with wind data vary from 0.38 to 0.59. Optical flow vectors are more stable than PC vectors.
William K. Jones, Matthew W. Christensen, and Philip Stier
Atmos. Meas. Tech., 16, 1043–1059, https://doi.org/10.5194/amt-16-1043-2023, https://doi.org/10.5194/amt-16-1043-2023, 2023
Short summary
Short summary
Geostationary weather satellites have been used to detect storm clouds since their earliest applications. However, this task remains difficult as imaging satellites cannot observe the strong vertical winds that are characteristic of storm clouds. Here we introduce a new method that allows us to detect the early development of storms and continue to track them throughout their lifetime, allowing us to study how their early behaviour affects subsequent weather.
Andrew M. Sayer, Luca Lelli, Brian Cairns, Bastiaan van Diedenhoven, Amir Ibrahim, Kirk D. Knobelspiesse, Sergey Korkin, and P. Jeremy Werdell
Atmos. Meas. Tech., 16, 969–996, https://doi.org/10.5194/amt-16-969-2023, https://doi.org/10.5194/amt-16-969-2023, 2023
Short summary
Short summary
This paper presents a method to estimate the height of the top of clouds above Earth's surface using satellite measurements. It is based on light absorption by oxygen in Earth's atmosphere, which darkens the signal that a satellite will see at certain wavelengths of light. Clouds "shield" the satellite from some of this darkening, dependent on cloud height (and other factors), because clouds scatter light at these wavelengths. The method will be applied to the future NASA PACE mission.
Veronika Pörtge, Tobias Kölling, Anna Weber, Lea Volkmer, Claudia Emde, Tobias Zinner, Linda Forster, and Bernhard Mayer
Atmos. Meas. Tech., 16, 645–667, https://doi.org/10.5194/amt-16-645-2023, https://doi.org/10.5194/amt-16-645-2023, 2023
Short summary
Short summary
In this work, we analyze polarized cloudbow observations by the airborne camera system specMACS to retrieve the cloud droplet size distribution defined by the effective radius (reff) and the effective variance (veff). Two case studies of trade-wind cumulus clouds observed during the EUREC4A field campaign are presented. The results are combined into maps of reff and veff with a very high spatial resolution (100 m × 100 m) that allow new insights into cloud microphysics.
Minrui Wang, Takashi Y. Nakajima, Woosub Roh, Masaki Satoh, Kentaroh Suzuki, Takuji Kubota, and Mayumi Yoshida
Atmos. Meas. Tech., 16, 603–623, https://doi.org/10.5194/amt-16-603-2023, https://doi.org/10.5194/amt-16-603-2023, 2023
Short summary
Short summary
SMILE (a spectral misalignment in which a shift in the center wavelength appears as a distortion in the spectral image) was detected during our recent work. To evaluate how it affects the cloud retrieval products, we did a simulation of EarthCARE-MSI forward radiation, evaluating the error in simulated scenes from a global cloud system-resolving model and a satellite simulator. Our results indicated that the error from SMILE was generally small and negligible for oceanic scenes.
Ming Li, Husi Letu, Hiroshi Ishimoto, Shulei Li, Lei Liu, Takashi Y. Nakajima, Dabin Ji, Huazhe Shang, and Chong Shi
Atmos. Meas. Tech., 16, 331–353, https://doi.org/10.5194/amt-16-331-2023, https://doi.org/10.5194/amt-16-331-2023, 2023
Short summary
Short summary
Influenced by the representativeness of ice crystal scattering models, the existing terahertz ice cloud remote sensing inversion algorithms still have significant uncertainties. We developed an ice cloud remote sensing retrieval algorithm of the ice water path and particle size from aircraft-based terahertz radiation measurements based on the Voronoi model. Validation revealed that the Voronoi model performs better than the sphere and hexagonal column models.
Yoonjin Lee, Christian D. Kummerow, and Milija Zupanski
Atmos. Meas. Tech., 15, 7119–7136, https://doi.org/10.5194/amt-15-7119-2022, https://doi.org/10.5194/amt-15-7119-2022, 2022
Short summary
Short summary
Vertical profiles of latent heating are derived from GOES-16 to be used in convective initialization. They are compared with other latent heating products derived from NEXRAD and GPM satellites, and the results show that their values are very similar to the radar-derived products. Finally, using latent heating derived from GOES-16 for convective initialization shows improvements in precipitation forecasts, which are comparable to the results using latent heating derived from NEXRAD.
Simon Whitburn, Lieven Clarisse, Marc Crapeau, Thomas August, Tim Hultberg, Pierre François Coheur, and Cathy Clerbaux
Atmos. Meas. Tech., 15, 6653–6668, https://doi.org/10.5194/amt-15-6653-2022, https://doi.org/10.5194/amt-15-6653-2022, 2022
Short summary
Short summary
With more than 15 years of measurements, the IASI radiance dataset is becoming a reference climate data record. Its exploitation for satellite applications requires an accurate and unbiased detection of cloud scenes. Here, we present a new cloud detection algorithm for IASI that is both sensitive and consistent over time. It is based on the use of a neural network, relying on IASI radiance information only and taking as a reference the last version of the operational IASI L2 cloud product.
Wenyu Wang, Zhenzhan Wang, Qiurui He, and Lanjie Zhang
Atmos. Meas. Tech., 15, 6489–6506, https://doi.org/10.5194/amt-15-6489-2022, https://doi.org/10.5194/amt-15-6489-2022, 2022
Short summary
Short summary
This paper uses a neural network approach to retrieve the ice water path from FY-3B/MWHS polarimetric measurements, focusing on its unique 150 GHz quasi-polarized channels. The Level 2 product of CloudSat is used as the reference value for the neural network. The results show that the polarization information is helpful for the retrieval in scenes with thicker cloud ice, and the 150 GHz channels give a significant improvement compared to using only 183 GHz channels.
Miriam Latsch, Andreas Richter, Henk Eskes, Maarten Sneep, Ping Wang, Pepijn Veefkind, Ronny Lutz, Diego Loyola, Athina Argyrouli, Pieter Valks, Thomas Wagner, Holger Sihler, Michel van Roozendael, Nicolas Theys, Huan Yu, Richard Siddans, and John P. Burrows
Atmos. Meas. Tech., 15, 6257–6283, https://doi.org/10.5194/amt-15-6257-2022, https://doi.org/10.5194/amt-15-6257-2022, 2022
Short summary
Short summary
The article investigates different S5P TROPOMI cloud retrieval algorithms for tropospheric trace gas retrievals. The cloud products show differences primarily over snow and ice and for scenes under sun glint. Some issues regarding across-track dependence are found for the cloud fractions as well as for the cloud heights.
Han Ding, Haoran Li, and Liping Liu
Atmos. Meas. Tech., 15, 6181–6200, https://doi.org/10.5194/amt-15-6181-2022, https://doi.org/10.5194/amt-15-6181-2022, 2022
Short summary
Short summary
In this study, a framework for processing the Doppler spectra observations of a multi-mode pulse compression Ka–Ku cloud radar system is presented. We first proposed an approach to identify and remove the clutter signals in the Doppler spectrum. Then, we developed a new algorithm to remove the range sidelobe at the modes implementing the pulse compression technique. The radar observations from different modes were then merged using the shift-then-average method.
Andrew T. Prata, Roy G. Grainger, Isabelle A. Taylor, Adam C. Povey, Simon R. Proud, and Caroline A. Poulsen
Atmos. Meas. Tech., 15, 5985–6010, https://doi.org/10.5194/amt-15-5985-2022, https://doi.org/10.5194/amt-15-5985-2022, 2022
Short summary
Short summary
Satellite observations are often used to track ash clouds and estimate their height, particle sizes and mass; however, satellite-based techniques are always associated with some uncertainty. We describe advances in a satellite-based technique that is used to estimate ash cloud properties for the June 2019 Raikoke (Russia) eruption. Our results are significant because ash warning centres increasingly require uncertainty information to correctly interpret,
aggregate and utilise the data.
Adrià Amell, Patrick Eriksson, and Simon Pfreundschuh
Atmos. Meas. Tech., 15, 5701–5717, https://doi.org/10.5194/amt-15-5701-2022, https://doi.org/10.5194/amt-15-5701-2022, 2022
Short summary
Short summary
Geostationary satellites continuously image a given location on Earth, a feature that satellites designed to characterize atmospheric ice lack. However, the relationship between geostationary images and atmospheric ice is complex. Machine learning is used here to leverage such images to characterize atmospheric ice throughout the day in a probabilistic manner. Using structural information from the image improves the characterization, and this approach compares favourably to traditional methods.
Alistair Bell, Pauline Martinet, Olivier Caumont, Frédéric Burnet, Julien Delanoë, Susana Jorquera, Yann Seity, and Vinciane Unger
Atmos. Meas. Tech., 15, 5415–5438, https://doi.org/10.5194/amt-15-5415-2022, https://doi.org/10.5194/amt-15-5415-2022, 2022
Short summary
Short summary
Cloud radars and microwave radiometers offer the potential to improve fog forecasts when assimilated into a high-resolution model. As this process can be complex, a retrieval of model variables is sometimes made as a first step. In this work, results from a 1D-Var algorithm for the retrieval of temperature, humidity and cloud liquid water content are presented. The algorithm is applied first to a synthetic dataset and then to a dataset of real measurements from a recent field campaign.
Willi Schimmel, Heike Kalesse-Los, Maximilian Maahn, Teresa Vogl, Andreas Foth, Pablo Saavedra Garfias, and Patric Seifert
Atmos. Meas. Tech., 15, 5343–5366, https://doi.org/10.5194/amt-15-5343-2022, https://doi.org/10.5194/amt-15-5343-2022, 2022
Short summary
Short summary
This study introduces the novel Doppler radar spectra-based machine learning approach VOODOO (reVealing supercOOled liquiD beyOnd lidar attenuatiOn). VOODOO is a powerful probability-based extension to the existing Cloudnet hydrometeor target classification, enabling the detection of liquid-bearing cloud layers beyond complete lidar attenuation via user-defined p* threshold. VOODOO performs best for (multi-layer) stratiform and deep mixed-phase clouds with liquid water path > 100 g m−2.
Vikas Nataraja, Sebastian Schmidt, Hong Chen, Takanobu Yamaguchi, Jan Kazil, Graham Feingold, Kevin Wolf, and Hironobu Iwabuchi
Atmos. Meas. Tech., 15, 5181–5205, https://doi.org/10.5194/amt-15-5181-2022, https://doi.org/10.5194/amt-15-5181-2022, 2022
Short summary
Short summary
A convolutional neural network (CNN) is introduced to retrieve cloud optical thickness (COT) from passive cloud imagery. The CNN, trained on large eddy simulations from the Sulu Sea, learns from spatial information at multiple scales to reduce cloud inhomogeneity effects. By considering the spatial context of a pixel, the CNN outperforms the traditional independent pixel approximation (IPA) across several cloud morphology metrics.
Cited articles
Agrawal, S., Barrington, L., Bromberg, C., Burge, J., Gazen, C., and Hickey,
J.: Machine learning for precipitation nowcasting from radar images, arXiv [preprint], arXiv:1912.12132, 11 December 2019. a
Arjovsky, M., Chintala, S., and Bottou, L.: Wasserstein generative adversarial networks, in: International conference on machine learning, PMLR, 70, 214–223, available at: https://proceedings.mlr.press/v70/arjovsky17a.html (last access: 22 March 2020), 2017. a
Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C.: Image Inpainting,
in: Proceedings of the 27th annual conference on Computer graphics and
interactive techniques, SIGGRAPH '00, Addison-Wesley Publishing Co., USA, 417–424, https://doi.org/10.1145/344779.344972, 2000. a
Bertalmio, M., Bertozzi, A. L., and Sapiro, G.: Navier-stokes, fluid
dynamics, and image and video inpainting, in: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, 8–14 December 2001, IEEE CVPR, 1, https://doi.org/10.1109/CVPR.2001.990497, 2001. a
Bugeau, A., Bertalmío, M., Caselles, V., and Sapiro, G.: A Comprehensive
Framework for Image Inpainting, IEEE T. Image Process., 19,
2634–2645, https://doi.org/10.1109/TIP.2010.2049240, 2010. a
Criminisi, A., Perez, P., and Toyama, K.: Region filling and object
removal by exemplar-based image inpainting, IEEE T. Image Process., 13, 1200–1212, https://doi.org/10.1109/TIP.2004.833105, 2004. a
Efros, A. A. and Leung, T. K.: Texture Synthesis by Non-parametric Sampling,
IEEE I. Conf. Comp. Vis., 2, 1033–1038, https://doi.org/10.1109/ICCV.1999.790383, 1999. a, b
Elharrouss, O., Almaadeed, N., Al-Maadeed, S., and Akbari, Y.: Image
Inpainting: A Review, Neural Process. Lett., 51, 2007–2028,
https://doi.org/10.1007/s11063-019-10163-0, 2020. a
Feng, Z., Leung, L. R., Houze Jr., R. A., Hagos, S., Hardin, J., Yang, Q., Han, B., and Fan, J.: Structure and evolution of mesoscale convective systems: Sensitivity to cloud microphysics in convection-permitting simulations over the United States, J. Adv. Model. Earth Sy., 10, 1470–1494, https://doi.org/10.1029/2018MS001305, 2018. a
Geiss, A. and Hardin, J. C.: avgeiss/radar_inpainting: AMT Supplementary Code, Zenodo [code], https://doi.org/10.5281/zenodo.5643624, 2021a. a
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D.,
Ozair, S., Courville, A., and Bengio, Y.: Generative Adversarial Networks,
arXiv, arXiv:1406.2661, 10 June 2014. a, b, c
Guillemot, C. and Le Meur, O.: Image Inpainting : Overview and Recent
Advances, IEEE Signal Proc. Mag., 31, 127–144,
https://doi.org/10.1109/MSP.2013.2273004, 2014. a
Hardin, J., Hunzinger, A., Schuman, E., Matthews, A., Bharadwaj, N., Varble, A., Johnson, K., and Giangrande, S.: Ka ARM Zenith Radar (KAZRCFRGEQC), Atmospheric Radiation Measurement (ARM) User Facility, ARM [dataset], https://doi.org/10.5439/1615726, 2019a. a, b, c
Hardin, J., Hunzinger, A., Schuman, E., Matthews, A., Bharadwaj, N., Varble, A., Johnson, K., and Giangrande, S: C-Band Scanning ARM Precipitation Radar (CSAPR2CFRPPIQC), Atmospheric Radiation Measurement (ARM) User Facility, ARM [dataset], https://doi.org/10.5439/1615604, 2019b. a
Hardin, J., Hunzinger, A., Schuman, E., Matthews, A., Bharadwaj, N., Varble,
A., Johnson, K., and Giangrande, S.: CACTI Radar b1 Processing: Corrections, Calibrations, and Processing Report, U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research, Technical Report, DOE/SC-ARM-TR-244, 1–55, https://arm.gov/publications/brochures/doe-sc-arm-tr-244.pdf, last access: 19 May 2020. a, b
Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K. Q.: Densely Connected Convolutional Networks, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017, IEEE CVPR, 2261–2269, https://doi.org/10.1109/CVPR.2017.243, 2017. a, b, c
Hubbert, J. C., Dixon, M., Ellis, S. M., and Meymaris, G.: Weather Radar Ground Clutter. Part I: Identification, Modeling, and Simulation, J. Atmos. Ocean. Techn., 26, 1165–1180, https://doi.org/10.1175/2009JTECHA1159.1, 2009a. a
Hubbert, J. C., Dixon, M., and Ellis, S. M.: Weather Radar Ground Clutter. Part II: Real-Time Identification and Filtering, J. Atmos. Ocean. Techn., 26, 1181–1197, https://doi.org/10.1175/2009JTECHA1160.1, 2009b. a
Isola, P., Zhu, J., Zhou, T., and Efros, A. A.: Image-to-Image
Translation with Conditional Adversarial Networks, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017, IEEE CVPR, 5967–5976, https://doi.org/10.1109/CVPR.2017.632, 2017. a, b, c, d
Isom, B., Palmer, R., Secrest, G., Rhoton, R., Saxion, D., Allmon, T., Reed,
J., Crum, T., and Vogt, R.: Detailed observations of wind turbine clutter
with scanning weather radars, J. Atmos. Ocean. Techn., 26, 894–910, https://doi.org/10.1175/2008JTECHA1136.1, 2009. a
Jain, V. and Seung, H.: Natural Image Denoising with Convolutional Networks,
in: Advances in Neural Information Processing Systems 21–Proceedings of the 2008 Conference, NIPS'08, Curran Associates Inc., Red Hook, NY, USA, 769–776, https://dl.acm.org/doi/10.5555/2981780.2981876 (last access: 22 March 2020), 2008. a
Jam, J., Kendrick, C., Walker, K., Drouard, V., Hsu, J. G.-S., and Yap, M. H.: A comprehensive review of past and present image inpainting methods, Computer Vision and Image Understanding, 203, 103147, https://doi.org/10.1016/j.cviu.2020.103147, 2021. a, b
Johnson, K., Fairless, T., and Giangrande, S.: Ka-Band ARM Zenith Radar
Corrections (KAZRCOR, KAZRCFRCOR) Value-Added Products, Technical Report, U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research, 18 pp., available at:
https://www.arm.gov/publications/tech_reports/doe-sc-arm-tr-203.pdf (last access: 22 March 2021), 2020. a
Lang, T. J., Nesbitt, S. W., and Carey, L. D.: On the Correction of Partial
Beam Blockage in Polarimetric Radar Data, J. Atmos. Ocean. Techn., 26, 943–957, https://doi.org/10.1175/2008JTECHA1133.1, 2009. a
Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A.,
Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., and Shi, W.: Photo-Realistic Single Image Super-Resolution Using a Generative
Adversarial Network, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, IEEE CVPR, Honolulu, HI, USA, 21–26 July 2017, 105–114, https://doi.org/10.1109/CVPR.2017.19, 2017. a
Liu, S., DiMego, G., Guan, S., Kumar, V. K., Keyser, D., Xu, Q., Nai, K.,
Zhang, P., Liu, L., Zhang, J., Howard, K., and Ator, J.: WSR-88D Radar Data
Processing at NCEP, Weather Forecast., 31, 2047–2055,
https://doi.org/10.1175/WAF-D-16-0003.1, 2016. a
Manabe, T. and Ihara, T.: A feasibility study of rain radar for the tropical rainfall measuring mission, 5. Effects of surface clutter on rain
measurements from satellite, J. Radio Res. Lab., 35, 163–181, http://www.nict.go.jp/publication/journal/35/145/Journal_Vol35_No145_pp163-181.pdf (last access: 22 March 2021), 1988. a
Moszkowicz, S., Ciach, G. J., and Krajewski, W. F.: Statistical Detection of
Anomalous Propagation in Radar Reflectivity Patterns, J. Atmos. Ocean. Techn., 11, 1026–1034,
https://doi.org/10.1175/1520-0426(1994)011<1026:SDOAPI>2.0.CO;2, 1994. a
Odena, A., Dumoulin, V., and Olah, C.: Deconvolution and Checkerboard
Artifacts, Distill, https://doi.org/10.23915/distill.00003, 2016. a
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A. A.: Context Encoders: Feature Learning by Inpainting, in: 2016 IEEE Conference on
Computer Vision and Pattern Recognition, IEEE CVPR, Las Vegas, NV, USA, 27–30 June 2016, 2536–2544, https://doi.org/10.1109/CVPR.2016.278, 2016. a
Prudden, R., Adams, S., Kangin, D., Robinson, N., Ravuri, S., Mohamed, S., and Arribas, A.: A review of radar-based nowcasting of precipitation and
applicable machine learning techniques, arXiv [preprint], arXiv:2005.04988, 11 May 2020. a
Ronneberger, O., Fischer, P., and Brox, T.: U-Net: Convolutional Networks for
Biomedical Image Segmentation, in: Medical Image Computing and
Computer-Assisted Intervention, MICCAI, 9351, 234–241,
https://doi.org/10.1007/978-3-319-24574-4_28, 2015. a, b
Shih, T. K., Liang-Chen Lu, Ying-Hong Wang, and Rong-Chi Chang:
Multi-resolution image inpainting, in: 2003 International Conference on
Multimedia and Expo, ICME'03, Proceedings, Baltimore, MD, USA, 6–9 July 2003, 485, https://doi.org/10.1109/ICME.2003.1220960, 2003. a
Tagawa, T. and Okamoto, K.: Calculations of surface clutter interference
with precipitation measurement from space by 35.5 GHz radar for Global
Precipitation Measurement Mission, in: 2003 IEEE International
Geoscience and Remote Sensing Symposium, IGARSS, Proceedings, Toulouse, France, Int. Geosci. Remote. Se., 21–25 July 2003, 5, 3172–3174, https://doi.org/10.1109/IGARSS.2003.1294719, 2003. a, b
Telea, A.: An Image Inpainting Technique Based on the Fast Marching Method,
Journal of Graphics Tools, 9, 23–24, https://doi.org/10.1080/10867651.2004.10487596, 2004. a
Varble, A., Nesbitt, S., Salio, P., Zipser, E., van den Heever, S., MdFarquhar, G., Kollias, P., Kreidenweis, S., DeMott, P., Jensen, M., Houze, Jr, R., Rasmussen, K., Leung, R., Romps, D., Gochis, D., Avila, E., Williams, C. R., and Borque, P.: Cloud, Aerosol, and Complex Terrain Interactions (CACTI), Science Plan, DOE Technical Report, DOE/SC-ARM-17-004, https://www.arm.gov/publications/programdocs/doe-sc-arm-17-004.pdf (last access: 15 May 2020), 2018. a
Veillette, M. S., Hassey, E. P., Mattioli, C. J., Iskenderian, H., and Lamey,
P. M.: Creating Synthetic Radar Imagery Using Convolutional Neural Networks, J. Atmos. Ocean. Techn., 35, 2323–2338, https://doi.org/10.1175/JTECH-D-18-0010.1, 2018. a, b
Westrick, K. J., Mass, C. F., and Colle, B. A.: The Limitations of the WSR-88D Radar Network for Quantitative Precipitation Measurement over the Coastal Western United States, B. Am. Meteorol. Soc., 80, 2289–2298, https://doi.org/10.1175/1520-0477(1999)080<2289:TLOTWR>2.0.CO;2, 1999. a
Widener, K., Bharadwaj, N., and Johnson, K.: Ka-Band ARM Zenith Radar (KAZR)
Instrument Handbook, DOE Office of Science Atmospheric Radiation Measurement (ARM) Program, United States, Technical Report, DOE/SC-ARM/TR-106, https://doi.org/10.2172/1035855, 2012. a, b, c
Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., and Li, H.:
High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis,
in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017, IEEE CVPR, 4076–4084, https://doi.org/10.1109/CVPR.2017.434, 2017. a
Young, C. B., Nelson, B. R., Bradley, A. A., Smith, J. A., Peters-Lidard,
C. D., Kruger, A., and Baeck, M. L.: An evaluation of NEXRAD precipitation
estimates in complex terrain, J. Geophys. Res.-Atmos., 104, 19691–19703, https://doi.org/10.1029/1999JD900123, 1999. a, b
Zhang, J., Howard, K., Langston, C., Vasiloff, S., Kaney, B., Arthur, A.,
Cooten, S. V., Kelleher, K., Kitzmiller, D., Ding, F., Seo, D.-J., Wells, E., and Dempsey, C.: National Mosaic and Multi-Sensor QPE (NMQ) System:
Description, Results, and Future Plans, B. Am. Meteorol. Soc., 92, 1321–1338, https://doi.org/10.1175/2011BAMS-D-11-00047.1, 2011.
a
Zhang, P., Zrnic, D., and Ryzhkov, A.: Partial Beam Blockage Correction Using
Polarimetric Radar Measurements, J. Atmos. Ocean. Techn., 30, 861–872, https://doi.org/10.1175/JTECH-D-12-00075.1, 2013. a
Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., and Liang, J.: UNet++: A Nested
U-Net Architecture for Medical Image Segmentation, in: Deep Learning in
Medical Image Analysis and Multimodal Learning for Clinical Decision Support, DLMIA, 11045, 3–1, https://doi.org/10.1007/978-3-030-00889-5_1, 2018. a, b
Short summary
Radars can suffer from missing or poor-quality data regions for several reasons: beam blockage, instrument failure, and near-ground blind zones, etc. Here, we demonstrate how deep convolutional neural networks can be used for filling in radar-missing data regions and that they can significantly outperform conventional approaches in terms of realism and accuracy.
Radars can suffer from missing or poor-quality data regions for several reasons: beam blockage,...
