Articles | Volume 16, issue 18
https://doi.org/10.5194/amt-16-4165-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-16-4165-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
19 Sep 2023
Research article |
| 19 Sep 2023
| 19 Sep 2023
Retrieval of surface solar irradiance from satellite imagery using machine learning: pitfalls and perspectives
Hadrien Verbois
CORRESPONDING AUTHOR
Mines Paris, Université PSL, Centre Observation Impacts Energie (O.I.E.), 06904 Sophia Antipolis, France
Yves-Marie Saint-Drenan
Mines Paris, Université PSL, Centre Observation Impacts Energie (O.I.E.), 06904 Sophia Antipolis, France
Vadim Becquet
Mines Paris, Université PSL, Centre Observation Impacts Energie (O.I.E.), 06904 Sophia Antipolis, France
Benoit Gschwind
Mines Paris, Université PSL, Centre Observation Impacts Energie (O.I.E.), 06904 Sophia Antipolis, France
Philippe Blanc
Mines Paris, Université PSL, Centre Observation Impacts Energie (O.I.E.), 06904 Sophia Antipolis, France
Related authors
No articles found.
Job I. Wiltink, Hartwig Deneke, Yves-Marie Saint-Drenan, Chiel C. van Heerwaarden, and Jan Fokke Meirink
Atmos. Meas. Tech., 17, 6003–6024, https://doi.org/10.5194/amt-17-6003-2024, https://doi.org/10.5194/amt-17-6003-2024, 2024
Short summary
Short summary
Meteosat Spinning Enhanced Visible and Infrared Imager (SEVIRI) global horizontal irradiance (GHI) retrievals are validated at standard and increased spatial resolution against a network of 99 pyranometers. GHI accuracy is strongly dependent on the cloud regime. Days with variable cloud conditions show significant accuracy improvements when retrieved at higher resolution. We highlight the benefits of dense network observations and a cloud-regime-resolved approach in validating GHI retrievals.
Benoît Tournadre, Benoît Gschwind, Yves-Marie Saint-Drenan, Xuemei Chen, Rodrigo Amaro E Silva, and Philippe Blanc
Atmos. Meas. Tech., 15, 3683–3704, https://doi.org/10.5194/amt-15-3683-2022, https://doi.org/10.5194/amt-15-3683-2022, 2022
Short summary
Short summary
Solar radiation received by the Earth's surface is valuable information for various fields like the photovoltaic industry or climate research. Pictures taken from satellites can be used to estimate the solar radiation from cloud reflectivity. Two issues for a good estimation are different instrumentations and orbits. We modify a widely used method that is today only used on geostationary satellites, so it can be applied on instruments on different orbits and with different sensitivities.
Maxence Descheemaecker, Matthieu Plu, Virginie Marécal, Marine Claeyman, Francis Olivier, Youva Aoun, Philippe Blanc, Lucien Wald, Jonathan Guth, Bojan Sič, Jérôme Vidot, Andrea Piacentini, and Béatrice Josse
Atmos. Meas. Tech., 12, 1251–1275, https://doi.org/10.5194/amt-12-1251-2019, https://doi.org/10.5194/amt-12-1251-2019, 2019
Short summary
Short summary
The future Flexible Combined Imager (FCI) on board MeteoSat Third Generation is expected to improve the detection and the quantification of aerosols. The study assesses the potential of FCI/VIS04 channel for monitoring air pollution in Europe. An observing system simulation experiment in MOCAGE is developed, and they show a large positive impact of the assimilation over a 4-month period and particularly during a severe pollution episode. The added value of geostationary data is also assessed.
Mélodie Trolliet, Jakub P. Walawender, Bernard Bourlès, Alexandre Boilley, Jörg Trentmann, Philippe Blanc, Mireille Lefèvre, and Lucien Wald
Ocean Sci., 14, 1021–1056, https://doi.org/10.5194/os-14-1021-2018, https://doi.org/10.5194/os-14-1021-2018, 2018
Marie Opálková, Martin Navrátil, Vladimír Špunda, Philippe Blanc, and Lucien Wald
Earth Syst. Sci. Data, 10, 837–846, https://doi.org/10.5194/essd-10-837-2018, https://doi.org/10.5194/essd-10-837-2018, 2018
Short summary
Short summary
Files with irradiances of a few spectral regions of incident solar radiation and some meteorological variables including concentrations of some air pollutants measured for 2.5 years at 3 stations in Ostrava (CZ) were prepared. Special attention was given to the data quality and the process of quality check was described. This database offers an ensemble of data with high temporal resolution and creates a source on radiation in relation with environment and vegetation in polluted areas of cities.
Pascal Kuhn, Stefan Wilbert, Christoph Prahl, Dominik Garsche, David Schüler, Thomas Haase, Lourdes Ramirez, Luis Zarzalejo, Angela Meyer, Philippe Blanc, and Robert Pitz-Paal
Adv. Sci. Res., 15, 11–14, https://doi.org/10.5194/asr-15-11-2018, https://doi.org/10.5194/asr-15-11-2018, 2018
Short summary
Short summary
Downward-facing shadow cameras might play a major role in future energy meteorology. Shadow cameras image shadows directly on the ground from an elevated position. They are used to validate other systems (e.g. all-sky imager based nowcasting systems, cloud speed sensors or satellite forecasts) and can potentially provide short term forecasts for solar power plants. Such forecasts are needed for electricity grids with high penetrations of renewable energy and solar power plants.
Marc Bengulescu, Philippe Blanc, and Lucien Wald
Nonlin. Processes Geophys., 25, 19–37, https://doi.org/10.5194/npg-25-19-2018, https://doi.org/10.5194/npg-25-19-2018, 2018
Short summary
Short summary
We employ the Hilbert–Huang transform to study the temporal variability in time series of daily means of the surface solar irradiance (SSI) at different locations around the world. The data have a significant spectral peak corresponding to the yearly variability cycle and feature quasi-stochastic high-frequency "weather noise", irrespective of the geographical location or of the local climate. Our findings can improve models for estimating SSI from satellite images or forecasts of the SSI.
Philippe Blanc, Benoit Gschwind, Lionel Ménard, and Lucien Wald
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2017-141, https://doi.org/10.5194/essd-2017-141, 2018
Revised manuscript not accepted
Short summary
Short summary
The construction of worldwide maps of surface bidirectional reflectance distribution function (BRDF) parameters is presented. The original data stems from the NASA which is making available maps of BRDF parameters from the Moderate Resolution Imaging Spectroradiometer instrument. The original data has been averaged for each month for the period 2004–2011 and a spatial completion of data was performed. The dataset in NetCDF is referenced by doi:10.23646/85d2cd5f-ccaa-482e-a4c9-b6e0c59d966c.
William Wandji Nyamsi, Phillipe Blanc, John A. Augustine, Antti Arola, and Lucien Wald
Biogeosciences Discuss., https://doi.org/10.5194/bg-2017-512, https://doi.org/10.5194/bg-2017-512, 2018
Manuscript not accepted for further review
Short summary
Short summary
This paper proposes a new, fast and accurate method for estimating photosynthetically active radiation at ground level in cloud-free conditions at any place and time. The method performs very well with the Copernicus Atmosphere Monitoring Service products as inputs describing the state of the atmosphere. An accuracy that is close to the uncertainty of the measurements themselves is reached. We believe that our research will be widely used in the near future.
William Wandji Nyamsi, Mikko R. A. Pitkänen, Youva Aoun, Philippe Blanc, Anu Heikkilä, Kaisa Lakkala, Germar Bernhard, Tapani Koskela, Anders V. Lindfors, Antti Arola, and Lucien Wald
Atmos. Meas. Tech., 10, 4965–4978, https://doi.org/10.5194/amt-10-4965-2017, https://doi.org/10.5194/amt-10-4965-2017, 2017
Short summary
Short summary
This paper proposes a new, fast and accurate method for estimating UV fluxes at ground level in cloud-free conditions at any place and time. The method performs very well with the Copernicus Atmosphere Monitoring Service products as inputs describing the state of the atmosphere. An accuracy that is close to the uncertainty of the measurements themselves is reached. We believe that our research will be widely used in the near future.
Marc Bengulescu, Philippe Blanc, Alexandre Boilley, and Lucien Wald
Adv. Sci. Res., 14, 35–48, https://doi.org/10.5194/asr-14-35-2017, https://doi.org/10.5194/asr-14-35-2017, 2017
Short summary
Short summary
This study investigates the characteristic time-scales of variability found in long-term time-series of daily means of surface solar irradiance (SSI). Estimates of SSI from satellite-derived HelioClim-3 and radiation products from ERA-Interim and MERRA-2 re-analyses are compared to WRDC measurements. It is found that HelioClim-3 renders a more accurate picture of the variability found in ground measurements, not only globally, but also with respect to individual characteristic time-scales.
Claire Thomas, Laurent Saboret, Etienne Wey, Philippe Blanc, and Lucien Wald
Adv. Sci. Res., 13, 129–136, https://doi.org/10.5194/asr-13-129-2016, https://doi.org/10.5194/asr-13-129-2016, 2016
Short summary
Short summary
HelioClim-3 (version 4) is a satellite-derived solar surface irradiance database available at d-1 until 2015. To fulfill the requirements of numerous users, a new service based on the principle of persistence has been developed; it provides solar data in real time and forecasts until the end of the current day. The service exhibits good performances for 15 min and 1 h ahead forecasts, and degrades as the temporal horizon increases. Several customers have so far purchased this service.
Marc Bengulescu, Philippe Blanc, and Lucien Wald
Adv. Sci. Res., 13, 121–127, https://doi.org/10.5194/asr-13-121-2016, https://doi.org/10.5194/asr-13-121-2016, 2016
Short summary
Short summary
The continuous wavelet (CWT) and the Hilbert–Huang transforms (HHT) are compared for the analysis of the temporal variability on ten years of daily means of the surface solar irradiance. In both cases, the variability exhibits a plateau between scales of two days and three months that has decreasing power with increasing scale, a spectral peak corresponding to the annual cycle, and a low power regime in-between. The HHT is shown to be suitable for inspecting the variability of the measurements.
Claire Thomas, Etienne Wey, Philippe Blanc, and Lucien Wald
Adv. Sci. Res., 13, 81–86, https://doi.org/10.5194/asr-13-81-2016, https://doi.org/10.5194/asr-13-81-2016, 2016
Short summary
Short summary
Several satellite-derived solar surface irradiance databases provide long-term and homogeneously distributed information on the solar potential at ground level. This paper presents the validation results of three of these databases: HelioClim-3 (versions 4 and 5) and the CAMS radiation service, versus the measurements of 42 stations in Brazil. Despite a slight overestimation of the CAMS radiation service, the three databases are suitable for studies of the solar resources in Brazil.
Mohamed Korany, Mohamed Boraiy, Yehia Eissa, Youva Aoun, Magdy M. Abdel Wahab, Stéphane C. Alfaro, Philippe Blanc, Mossad El-Metwally, Hosni Ghedira, Katja Hungershoefer, and Lucien Wald
Earth Syst. Sci. Data, 8, 105–113, https://doi.org/10.5194/essd-8-105-2016, https://doi.org/10.5194/essd-8-105-2016, 2016
Short summary
Short summary
A database of global and diffuse components of the surface solar hourly irradiation measured from 2004 to 2010 at eight Egyptian meteorological stations is presented. At three sites, the direct component is also available. In addition, a series of meteorological variables is provided at the same hourly resolution. The measurements and quality checks applied to the data are detailed. Finally, 13500 to 29000 measurements of global and diffuse hourly irradiation are available at each site.
P. Blanc and L. Wald
Adv. Sci. Res., 13, 1–6, https://doi.org/10.5194/asr-13-1-2016, https://doi.org/10.5194/asr-13-1-2016, 2016
Short summary
Short summary
Time series of hourly measurements or modelled values of surface solar irradiation are increasingly available. Currently, no solar zenith and azimuth angles are associated to each measurement whereas such angles are necessary for handling the measured or modelled irradiations. A method is proposed to assess such angles with a great accuracy. It makes use of two modelled time-series that can be computed using the web site www.soda-pro.com for any site in the world.
Y. Eissa, P. Blanc, L. Wald, and H. Ghedira
Atmos. Meas. Tech., 8, 5099–5112, https://doi.org/10.5194/amt-8-5099-2015, https://doi.org/10.5194/amt-8-5099-2015, 2015
Short summary
Short summary
This study investigates whether the spectral aerosol optical properties of the AERONET stations are sufficient for an accurate modelling of the monochromatic beam and circumsolar irradiances under cloud-free conditions in a desert environment. By comparing the modelled irradiances against reference ground measurements, the monochromatic beam and circumsolar irradiances may very well be modelled using a set of inputs extracted from the AERONET data.
W. Wandji Nyamsi, A. Arola, P. Blanc, A. V. Lindfors, V. Cesnulyte, M. R. A. Pitkänen, and L. Wald
Atmos. Chem. Phys., 15, 7449–7456, https://doi.org/10.5194/acp-15-7449-2015, https://doi.org/10.5194/acp-15-7449-2015, 2015
Short summary
Short summary
A novel model of the absorption of radiation by ozone in the UV bands [283, 307]nm and [307, 328]nm yields improvements in the modeling of the transmissivity in these bands. This model is faster than detailed spectral calculations and is as accurate with maximum errors of respectively 0.0006 and 0.0143. How to practically implement this new parameterization in a radiative transfer model is discussed for the case of libRadtran.
W. Wandji Nyamsi, B. Espinar, P. Blanc, and L. Wald
Adv. Sci. Res., 12, 5–10, https://doi.org/10.5194/asr-12-5-2015, https://doi.org/10.5194/asr-12-5-2015, 2015
Short summary
Short summary
We propose an innovative method to estimate the Photosynthetically Active Radiation (PAR) under clear sky conditions derived from the fast approach of Kato et al. (1999). It provides very good results better than the two state-of-the-art empirical methods computing the daily mean of PAR from the daily mean of total irradiance. In addition, this technique may be extended to be able to accurately estimate other spectral quantities taking into account absorption of plants photosynthetic pigments.
P. Blanc, C. Coulaud, and L. Wald
Adv. Sci. Res., 12, 1–4, https://doi.org/10.5194/asr-12-1-2015, https://doi.org/10.5194/asr-12-1-2015, 2015
Short summary
Short summary
New Caledonia experiences a decrease in surface solar irradiation since 2004, of order of 4% of the mean yearly irradiation, and amounts to 9 W m 2. The preeminent roles of the changes in cloud cover and to a lesser extent, those in aerosol optical depth on the decrease in yearly irradiation are evidenced. The study highlights the role of data sets offering a worldwide coverage in understanding changes in solar radiation and planning large solar energy plants.
J. Badosa, J. Wood, P. Blanc, C. N. Long, L. Vuilleumier, D. Demengel, and M. Haeffelin
Atmos. Meas. Tech., 7, 4267–4283, https://doi.org/10.5194/amt-7-4267-2014, https://doi.org/10.5194/amt-7-4267-2014, 2014
A. Oumbe, Z. Qu, P. Blanc, M. Lefèvre, L. Wald, and S. Cros
Geosci. Model Dev., 7, 1661–1669, https://doi.org/10.5194/gmd-7-1661-2014, https://doi.org/10.5194/gmd-7-1661-2014, 2014
M. Lefèvre, A. Oumbe, P. Blanc, B. Espinar, B. Gschwind, Z. Qu, L. Wald, M. Schroedter-Homscheidt, C. Hoyer-Klick, A. Arola, A. Benedetti, J. W. Kaiser, and J.-J. Morcrette
Atmos. Meas. Tech., 6, 2403–2418, https://doi.org/10.5194/amt-6-2403-2013, https://doi.org/10.5194/amt-6-2403-2013, 2013
Related subject area
Subject: Clouds | Technique: Remote Sensing | Topic: Data Processing and Information Retrieval
The Ice Cloud Imager: retrieval of frozen water column properties
Supercooled liquid water cloud classification using lidar backscatter peak properties
Marine cloud base height retrieval from MODIS cloud properties using machine learning
How well can brightness temperature differences of spaceborne imagers help to detect cloud phase? A sensitivity analysis regarding cloud phase and related cloud properties
ampycloud: an open-source algorithm to determine cloud base heights and sky coverage fractions from ceilometer data
Simulation and detection efficiency analysis for measurements of polar mesospheric clouds using a spaceborne wide-field-of-view ultraviolet imager
The Chalmers Cloud Ice Climatology: retrieval implementation and validation
The algorithm of microphysical-parameter profiles of aerosol and small cloud droplets based on the dual-wavelength lidar data
Bayesian cloud-top phase determination for Meteosat Second Generation
Lidar–radar synergistic method to retrieve ice, supercooled water and mixed-phase cloud properties
Deriving cloud droplet number concentration from surface-based remote sensors with an emphasis on lidar measurements
A random forest algorithm for the prediction of cloud liquid water content from combined CloudSat–CALIPSO observations
Using machine learning algorithm to retrieve cloud fraction based on FY-4A AGRI observations
Identification of ice-over-water multilayer clouds using multispectral satellite data in an artificial neural network
A new approach to crystal habit retrieval from far-infrared spectral radiance measurements
Severe hail detection with C-band dual-polarisation radars using convolutional neural networks
Multiple-scattering effects on single-wavelength lidar sounding of multi-layered clouds
Contrail altitude estimation using GOES-16 ABI data and deep learning
Retrieval of cloud fraction and optical thickness from multi-angle polarization observations
PEAKO and peakTree: Tools for detecting and interpreting peaks in cloud radar Doppler spectra – capabilities and limitations
An advanced spatial co-registration of cloud properties for the atmospheric Sentinel missions: Application to TROPOMI
A cloud-by-cloud approach for studying aerosol–cloud interaction in satellite observations
Infrared Radiometric Image Classification and Segmentation of Cloud Structure Using Deep-learning Framework for Ground-based Infrared Thermal Camera Observations
Geometrical and optical properties of cirrus clouds in Barcelona, Spain: analysis with the two-way transmittance method of 4 years of lidar measurements
Determination of the vertical distribution of in-cloud particle shape using SLDR-mode 35 GHz scanning cloud radar
Artificial intelligence (AI)-derived 3D cloud tomography from geostationary 2D satellite data
The EarthCARE mission: science data processing chain overview
3-D Cloud Masking Across a Broad Swath using Multi-angle Polarimetry and Deep Learning
Cloud optical and physical properties retrieval from EarthCARE multi-spectral imager: the M-COP products
Cloud top heights and aerosol columnar properties from combined EarthCARE lidar and imager observations: the AM-CTH and AM-ACD products
Raman lidar-derived optical and microphysical properties of ice crystals within thin Arctic clouds during PARCS campaign
Evaluation of four ground-based retrievals of cloud droplet number concentration in marine stratocumulus with aircraft in situ measurements
Deep convective cloud system size and structure across the global tropics and subtropics
A neural-network-based method for generating synthetic 1.6 µm near-infrared satellite images
Numerical model generation of test frames for pre-launch studies of EarthCARE's retrieval algorithms and data management system
Segmentation of polarimetric radar imagery using statistical texture
Retrieving 3D distributions of atmospheric particles using Atmospheric Tomography with 3D Radiative Transfer – Part 2: Local optimization
Particle inertial effects on radar Doppler spectra simulation
Detection of aerosol and cloud features for the EarthCARE atmospheric lidar (ATLID): the ATLID FeatureMask (A-FM) product
A unified synergistic retrieval of clouds, aerosols, and precipitation from EarthCARE: the ACM-CAP product
Incorporating EarthCARE observations into a multi-lidar cloud climate record: the ATLID (Atmospheric Lidar) cloud climate product
Introduction to EarthCARE synthetic data using a global storm-resolving simulation
Validation of a camera-based intra-hour irradiance nowcasting model using synthetic cloud data
Liquid cloud optical property retrieval and associated uncertainties using multi-angular and bispectral measurements of the airborne radiometer OSIRIS
Global evaluation of Doppler velocity errors of EarthCARE cloud-profiling radar using a global storm-resolving simulation
Cloud and precipitation microphysical retrievals from the EarthCARE Cloud Profiling Radar: the C-CLD product
Cloud mask algorithm from the EarthCARE Multi-Spectral Imager: the M-CM products
Across-track extension of retrieved cloud and aerosol properties for the EarthCARE mission: the ACMB-3D product
Insights into 3D cloud radiative transfer effects for the Orbiting Carbon Observatory
Evaluation of polarimetric ice microphysical retrievals with OLYMPEX campaign data
Eleanor May, Bengt Rydberg, Inderpreet Kaur, Vinia Mattioli, Hanna Hallborn, and Patrick Eriksson
Atmos. Meas. Tech., 17, 5957–5987, https://doi.org/10.5194/amt-17-5957-2024, https://doi.org/10.5194/amt-17-5957-2024, 2024
Short summary
Short summary
The upcoming Ice Cloud Imager (ICI) mission is set to improve measurements of atmospheric ice through passive microwave and sub-millimetre wave observations. In this study, we perform detailed simulations of ICI observations. Machine learning is used to characterise the atmospheric ice present for a given simulated observation. This study acts as a final pre-launch assessment of ICI's capability to measure atmospheric ice, providing valuable information to climate and weather applications.
Luke Edgar Whitehead, Adrian James McDonald, and Adrien Guyot
Atmos. Meas. Tech., 17, 5765–5784, https://doi.org/10.5194/amt-17-5765-2024, https://doi.org/10.5194/amt-17-5765-2024, 2024
Short summary
Short summary
Supercooled liquid water cloud is important to represent in weather and climate models, particularly in the Southern Hemisphere. Previous work has developed a new machine learning method for measuring supercooled liquid water in Antarctic clouds using simple lidar observations. We evaluate this technique using a lidar dataset from Christchurch, New Zealand, and develop an updated algorithm for accurate supercooled liquid water detection at mid-latitudes.
Julien Lenhardt, Johannes Quaas, and Dino Sejdinovic
Atmos. Meas. Tech., 17, 5655–5677, https://doi.org/10.5194/amt-17-5655-2024, https://doi.org/10.5194/amt-17-5655-2024, 2024
Short summary
Short summary
Clouds play a key role in the regulation of the Earth's climate. Aspects like the height of their base are of essential interest to quantify their radiative effects but remain difficult to derive from satellite data. In this study, we combine observations from the surface and satellite retrievals of cloud properties to build a robust and accurate method to retrieve the cloud base height, based on a computer vision model and ordinal regression.
Johanna Mayer, Bernhard Mayer, Luca Bugliaro, Ralf Meerkötter, and Christiane Voigt
Atmos. Meas. Tech., 17, 5161–5185, https://doi.org/10.5194/amt-17-5161-2024, https://doi.org/10.5194/amt-17-5161-2024, 2024
Short summary
Short summary
This study uses radiative transfer calculations to characterize the relation of two satellite channel combinations (namely infrared window brightness temperature differences – BTDs – of SEVIRI) to the thermodynamic cloud phase. A sensitivity analysis reveals the complex interplay of cloud parameters and their contribution to the observed phase dependence of BTDs. This knowledge helps to design optimal cloud-phase retrievals and to understand their potential and limitations.
Frédéric P. A. Vogt, Loris Foresti, Daniel Regenass, Sophie Réthoré, Néstor Tarin Burriel, Mervyn Bibby, Przemysław Juda, Simone Balmelli, Tobias Hanselmann, Pieter du Preez, and Dirk Furrer
Atmos. Meas. Tech., 17, 4891–4914, https://doi.org/10.5194/amt-17-4891-2024, https://doi.org/10.5194/amt-17-4891-2024, 2024
Short summary
Short summary
ampycloud is a new algorithm developed at MeteoSwiss to characterize the height and sky coverage fraction of cloud layers above aerodromes via ceilometer data. This algorithm was devised as part of a larger effort to fully automate the creation of meteorological aerodrome reports (METARs) at Swiss civil airports. The ampycloud algorithm is implemented as a Python package that is made publicly available to the community under the 3-Clause BSD license.
Ke Ren, Haiyang Gao, Shuqi Niu, Shaoyang Sun, Leilei Kou, Yanqing Xie, Liguo Zhang, and Lingbing Bu
Atmos. Meas. Tech., 17, 4825–4842, https://doi.org/10.5194/amt-17-4825-2024, https://doi.org/10.5194/amt-17-4825-2024, 2024
Short summary
Short summary
Ultraviolet imaging technology has significantly advanced the research and development of polar mesospheric clouds (PMCs). In this study, we proposed the wide-field-of-view ultraviolet imager (WFUI) and built a forward model to evaluate the detection capability and efficiency. The results demonstrate that the WFUI performs well in PMC detection and has high detection efficiency. The relationship between ice water content and detection efficiency follows an exponential function distribution.
Adrià Amell, Simon Pfreundschuh, and Patrick Eriksson
Atmos. Meas. Tech., 17, 4337–4368, https://doi.org/10.5194/amt-17-4337-2024, https://doi.org/10.5194/amt-17-4337-2024, 2024
Short summary
Short summary
The representation of clouds in numerical weather and climate models remains a major challenge that is difficult to address because of the limitations of currently available data records of cloud properties. In this work, we address this issue by using machine learning to extract novel information on ice clouds from a long record of satellite observations. Through extensive validation, we show that this novel approach provides surprisingly accurate estimates of clouds and their properties.
Huige Di, Xinhong Wang, Ning Chen, Jing Guo, Wenhui Xin, Shichun Li, Yan Guo, Qing Yan, Yufeng Wang, and Dengxin Hua
Atmos. Meas. Tech., 17, 4183–4196, https://doi.org/10.5194/amt-17-4183-2024, https://doi.org/10.5194/amt-17-4183-2024, 2024
Short summary
Short summary
This study proposes an inversion method for atmospheric-aerosol or cloud microphysical parameters based on dual-wavelength lidar data. It is suitable for the inversion of uniformly mixed and single-property aerosol layers or small cloud droplets. For aerosol particles, the inversion range that this algorithm can achieve is 0.3–1.7 μm. For cloud droplets, it is 1.0–10 μm. This algorithm can quickly obtain the microphysical parameters of atmospheric particles and has better robustness.
Johanna Mayer, Luca Bugliaro, Bernhard Mayer, Dennis Piontek, and Christiane Voigt
Atmos. Meas. Tech., 17, 4015–4039, https://doi.org/10.5194/amt-17-4015-2024, https://doi.org/10.5194/amt-17-4015-2024, 2024
Short summary
Short summary
ProPS (PRObabilistic cloud top Phase retrieval for SEVIRI) is a method to detect clouds and their thermodynamic phase with a geostationary satellite, distinguishing between clear sky and ice, mixed-phase, supercooled and warm liquid clouds. It uses a Bayesian approach based on the lidar–radar product DARDAR. The method allows studying cloud phases, especially mixed-phase and supercooled clouds, rarely observed from geostationary satellites. This can be used for comparison with climate models.
Clémantyne Aubry, Julien Delanoë, Silke Groß, Florian Ewald, Frédéric Tridon, Olivier Jourdan, and Guillaume Mioche
Atmos. Meas. Tech., 17, 3863–3881, https://doi.org/10.5194/amt-17-3863-2024, https://doi.org/10.5194/amt-17-3863-2024, 2024
Short summary
Short summary
Radar–lidar synergy is used to retrieve ice, supercooled water and mixed-phase cloud properties, making the most of the radar sensitivity to ice crystals and the lidar sensitivity to supercooled droplets. A first analysis of the output of the algorithm run on the satellite data is compared with in situ data during an airborne Arctic field campaign, giving a mean percent error of 49 % for liquid water content and 75 % for ice water content.
Gerald G. Mace
Atmos. Meas. Tech., 17, 3679–3695, https://doi.org/10.5194/amt-17-3679-2024, https://doi.org/10.5194/amt-17-3679-2024, 2024
Short summary
Short summary
The number of cloud droplets per unit volume, Nd, in a cloud is important for understanding aerosol–cloud interaction. In this study, we develop techniques to derive cloud droplet number concentration from lidar measurements combined with other remote sensing measurements such as cloud radar and microwave radiometers. We show that deriving Nd is very uncertain, although a synergistic algorithm seems to produce useful characterizations of Nd and effective particle size.
Richard M. Schulte, Matthew D. Lebsock, John M. Haynes, and Yongxiang Hu
Atmos. Meas. Tech., 17, 3583–3596, https://doi.org/10.5194/amt-17-3583-2024, https://doi.org/10.5194/amt-17-3583-2024, 2024
Short summary
Short summary
This paper describes a method to improve the detection of liquid clouds that are easily missed by the CloudSat satellite radar. To address this, we use machine learning techniques to estimate cloud properties (optical depth and droplet size) based on other satellite measurements. The results are compared with data from the MODIS instrument on the Aqua satellite, showing good correlations.
Jinyi Xia and Li Guan
EGUsphere, https://doi.org/10.5194/egusphere-2024-977, https://doi.org/10.5194/egusphere-2024-977, 2024
Short summary
Short summary
This study presents a method for estimating cloud cover from FY4A AGRI observations using LSTM neural networks. The results demonstrate excellent performance in distinguishing clear sky scenes and reducing errors in cloud cover estimation. It shows significant improvements compared to existing methods.
Sunny Sun-Mack, Patrick Minnis, Yan Chen, Gang Hong, and William L. Smith Jr.
Atmos. Meas. Tech., 17, 3323–3346, https://doi.org/10.5194/amt-17-3323-2024, https://doi.org/10.5194/amt-17-3323-2024, 2024
Short summary
Short summary
Multilayer clouds (MCs) affect the radiation budget differently than single-layer clouds (SCs) and need to be identified in satellite images. A neural network was trained to identify MCs by matching imagery with lidar/radar data. This method correctly identifies ~87 % SCs and MCs with a net accuracy gain of 7.5 % over snow-free surfaces. It is more accurate than most available methods and constitutes a first step in providing a reasonable 3-D characterization of the cloudy atmosphere.
Gianluca Di Natale, Marco Ridolfi, and Luca Palchetti
Atmos. Meas. Tech., 17, 3171–3186, https://doi.org/10.5194/amt-17-3171-2024, https://doi.org/10.5194/amt-17-3171-2024, 2024
Short summary
Short summary
This work aims to define a new approach to retrieve the distribution of the main ice crystal shapes occurring inside ice and cirrus clouds from infrared spectral measurements. The capability of retrieving these shapes of the ice crystals from satellites will allow us to extend the currently available climatologies to be used as physical constraints in general circulation models. This could could allow us to improve their accuracy and prediction performance.
Vincent Forcadell, Clotilde Augros, Olivier Caumont, Kévin Dedieu, Maxandre Ouradou, Cloe David, Jordi Figueras i Ventura, Olivier Laurantin, and Hassan Al-Sakka
EGUsphere, https://doi.org/10.5194/egusphere-2024-1336, https://doi.org/10.5194/egusphere-2024-1336, 2024
Short summary
Short summary
This study demonstrates the potential for enhancing severe hail detection through the application of convolutional neural networks (CNNs) to dual-polarization radar data. It is shown that current methods can be calibrated to significantly enhance their performance for severe hail detection. This study establishes the foundation for the solution of a more complex problem: the estimation of the maximum size of hailstones on the ground using deep learning applied to radar data.
Valery Shcherbakov, Frédéric Szczap, Guillaume Mioche, and Céline Cornet
Atmos. Meas. Tech., 17, 3011–3028, https://doi.org/10.5194/amt-17-3011-2024, https://doi.org/10.5194/amt-17-3011-2024, 2024
Short summary
Short summary
We performed Monte Carlo simulations of single-wavelength lidar signals from multi-layered clouds with special attention focused on the multiple-scattering (MS) effect in regions of the cloud-free molecular atmosphere. The MS effect on lidar signals always decreases with the increasing distance from the cloud far edge. The decrease is the direct consequence of the fact that the forward peak of particle phase functions is much larger than the receiver field of view.
Vincent R. Meijer, Sebastian D. Eastham, Ian A. Waitz, and Steven R.H. Barrett
EGUsphere, https://doi.org/10.5194/egusphere-2024-961, https://doi.org/10.5194/egusphere-2024-961, 2024
Short summary
Short summary
Aviation's climate impact is partly due to contrails: the clouds that form behind aircraft and which can linger for hours under certain atmospheric conditions. Accurately forecasting these conditions could allow aircraft to avoid forming these contrails and thus reduce their environmental footprint. Our research uses deep learning to identify three-dimensional contrail locations in two-dimensional satellite imagery, which can be used to assess and improve these forecasts.
Claudia Emde, Veronika Pörtge, Mihail Manev, and Bernhard Mayer
EGUsphere, https://doi.org/10.5194/egusphere-2024-1180, https://doi.org/10.5194/egusphere-2024-1180, 2024
Short summary
Short summary
We introduce an innovative method to retrieve cloud fraction and optical thickness based on polarimetry, well-suited for satellite observations providing multi-angle polarization measurements. The cloud fraction and the cloud optical thickness can be derived from measurements at two viewing angles: one within the cloudbow and a second in the sun-glint region or at a scattering angle of approximately 90°.
Teresa Vogl, Martin Radenz, Fabiola Ramelli, Rosa Gierens, and Heike Kalesse-Los
EGUsphere, https://doi.org/10.5194/egusphere-2024-837, https://doi.org/10.5194/egusphere-2024-837, 2024
Short summary
Short summary
In this study, we present a toolkit of two Python algorithms to extract information about the cloud and precipitation particles present in clouds from data measured by ground-based radar instruments. The data consist of Doppler spectra, in which several peaks are formed by hydrometeor populations with different fall velocities. The detection of the specific peaks makes it possible to assign them to certain particle types, such as small cloud droplets or fast-falling ice particles like graupel.
Athina Argyrouli, Diego Loyola, Fabian Romahn, Ronny Lutz, Víctor Molina García, Pascal Hedelt, Klaus-Peter Heue, and Richard Siddans
Atmos. Meas. Tech. Discuss., https://doi.org/10.5194/amt-2024-28, https://doi.org/10.5194/amt-2024-28, 2024
Revised manuscript accepted for AMT
Short summary
Short summary
This manuscript describes a new treatment of the spatial mis-registration of cloud properties for Sentinel-5 Precursor, when the footprints of different spectral bands are not perfectly aligned. The methodology exploits synergies between spectrometers and imagers, like TROPOMI and VIIRS. The largest improvements have been identified for heterogeneous scenes at cloud edges. This approach is generic and can also be applied to future Sentinel-4 and Sentinel-5 instruments.
Fani Alexandri, Felix Müller, Goutam Choudhury, Peggy Achtert, Torsten Seelig, and Matthias Tesche
Atmos. Meas. Tech., 17, 1739–1757, https://doi.org/10.5194/amt-17-1739-2024, https://doi.org/10.5194/amt-17-1739-2024, 2024
Short summary
Short summary
We present a novel method for studying aerosol–cloud interactions. It combines cloud-relevant aerosol concentrations from polar-orbiting lidar observations with the development of individual clouds from geostationary observations. Application to 1 year of data gives first results on the impact of aerosols on the concentration and size of cloud droplets and on cloud phase in the regime of heterogeneous ice formation. The method could enable the systematic investigation of warm and cold clouds.
Kélian Sommer, Wassim Kabalan, and Romain Brunet
EGUsphere, https://doi.org/10.5194/egusphere-2024-101, https://doi.org/10.5194/egusphere-2024-101, 2024
Short summary
Short summary
Our research introduces a novel deep-learning approach for classifying and segmenting ground-based infrared thermal images, a crucial step in cloud monitoring. Tests on self-captured data showcase its excellent accuracy in distinguishing image types and in structure segmentation. With potential applications in astronomical observations, our work pioneers a robust solution for ground-based sky quality assessment, promising advancements in the photometric observations experiments.
Cristina Gil-Díaz, Michäel Sicard, Adolfo Comerón, Daniel Camilo Fortunato dos Santos Oliveira, Constantino Muñoz-Porcar, Alejandro Rodríguez-Gómez, Jasper R. Lewis, Ellsworth J. Welton, and Simone Lolli
Atmos. Meas. Tech., 17, 1197–1216, https://doi.org/10.5194/amt-17-1197-2024, https://doi.org/10.5194/amt-17-1197-2024, 2024
Short summary
Short summary
In this paper, a statistical study of cirrus geometrical and optical properties based on 4 years of continuous ground-based lidar measurements with the Barcelona (Spain) Micro Pulse Lidar (MPL) is analysed. The cloud optical depth, effective column lidar ratio and linear cloud depolarisation ratio have been calculated by a new approach to the two-way transmittance method, which is valid for both ground-based and spaceborne lidar systems. Their associated errors are also provided.
Audrey Teisseire, Patric Seifert, Alexander Myagkov, Johannes Bühl, and Martin Radenz
Atmos. Meas. Tech., 17, 999–1016, https://doi.org/10.5194/amt-17-999-2024, https://doi.org/10.5194/amt-17-999-2024, 2024
Short summary
Short summary
The vertical distribution of particle shape (VDPS) method, introduced in this study, aids in characterizing the density-weighted shape of cloud particles from scanning slanted linear depolarization ratio (SLDR)-mode cloud radar observations. The VDPS approach represents a new, versatile way to study microphysical processes by combining a spheroidal scattering model with real measurements of SLDR.
Sarah Brüning, Stefan Niebler, and Holger Tost
Atmos. Meas. Tech., 17, 961–978, https://doi.org/10.5194/amt-17-961-2024, https://doi.org/10.5194/amt-17-961-2024, 2024
Short summary
Short summary
We apply the Res-UNet to derive a comprehensive 3D cloud tomography from 2D satellite data over heterogeneous landscapes. We combine observational data from passive and active remote sensing sensors by an automated matching algorithm. These data are fed into a neural network to predict cloud reflectivities on the whole satellite domain between 2.4 and 24 km height. With an average RMSE of 2.99 dBZ, we contribute to closing data gaps in the representation of clouds in observational data.
Michael Eisinger, Fabien Marnas, Kotska Wallace, Takuji Kubota, Nobuhiro Tomiyama, Yuichi Ohno, Toshiyuki Tanaka, Eichi Tomita, Tobias Wehr, and Dirk Bernaerts
Atmos. Meas. Tech., 17, 839–862, https://doi.org/10.5194/amt-17-839-2024, https://doi.org/10.5194/amt-17-839-2024, 2024
Short summary
Short summary
The Earth Cloud Aerosol and Radiation Explorer (EarthCARE) is an ESA–JAXA satellite mission to be launched in 2024. We presented an overview of the EarthCARE processors' development, with processors developed by teams in Europe, Japan, and Canada. EarthCARE will allow scientists to evaluate the representation of cloud, aerosol, precipitation, and radiative flux in weather forecast and climate models, with the objective to better understand cloud processes and improve weather and climate models.
Sean R. Foley, Kirk D. Knobelspiesse, Andrew M. Sayer, Meng Gao, James Hays, and Judy Hoffman
EGUsphere, https://doi.org/10.5194/egusphere-2023-2392, https://doi.org/10.5194/egusphere-2023-2392, 2024
Short summary
Short summary
Measuring the shape of clouds helps scientists understand how the Earth will continue to respond to climate change. Satellites measure clouds in different ways. One way is to take pictures of clouds from multiple angles, and to use the differences between the pictures to measure cloud structure. However, doing this accurately can be challenging. We propose a way to use machine learning to recover the shape of clouds from multi-angle satellite data.
Anja Hünerbein, Sebastian Bley, Hartwig Deneke, Jan Fokke Meirink, Gerd-Jan van Zadelhoff, and Andi Walther
Atmos. Meas. Tech., 17, 261–276, https://doi.org/10.5194/amt-17-261-2024, https://doi.org/10.5194/amt-17-261-2024, 2024
Short summary
Short summary
The ESA cloud, aerosol and radiation mission EarthCARE will provide active profiling and passive imaging measurements from a single satellite platform. The passive multi-spectral imager (MSI) will add information in the across-track direction. We present the cloud optical and physical properties algorithm, which combines the visible to infrared MSI channels to determine the cloud top pressure, optical thickness, particle size and water path.
Moritz Haarig, Anja Hünerbein, Ulla Wandinger, Nicole Docter, Sebastian Bley, David Donovan, and Gerd-Jan van Zadelhoff
Atmos. Meas. Tech., 16, 5953–5975, https://doi.org/10.5194/amt-16-5953-2023, https://doi.org/10.5194/amt-16-5953-2023, 2023
Short summary
Short summary
The atmospheric lidar (ATLID) and Multi-Spectral Imager (MSI) will be carried by the EarthCARE satellite. The synergistic ATLID–MSI Column Products (AM-COL) algorithm described in the paper combines the strengths of ATLID in vertically resolved profiles of aerosol and clouds (e.g., cloud top height) with the strengths of MSI in observing the complete scene beside the satellite track and in extending the lidar information to the swath. The algorithm is validated against simulated test scenes.
Patrick Chazette and Jean-Christophe Raut
Atmos. Meas. Tech., 16, 5847–5861, https://doi.org/10.5194/amt-16-5847-2023, https://doi.org/10.5194/amt-16-5847-2023, 2023
Short summary
Short summary
The vertical profiles of the effective radii of ice crystals and ice water content in Arctic semi-transparent stratiform clouds were assessed using quantitative ground-based lidar measurements. The field campaign was part of the Pollution in the ARCtic System (PARCS) project which took place from 13 to 26 May 2016 in Hammerfest (70° 39′ 48″ N, 23° 41′ 00″ E). We show that under certain cloud conditions, lidar measurement combined with a dedicated algorithmic approach is an efficient tool.
Damao Zhang, Andrew M. Vogelmann, Fan Yang, Edward Luke, Pavlos Kollias, Zhien Wang, Peng Wu, William I. Gustafson Jr., Fan Mei, Susanne Glienke, Jason Tomlinson, and Neel Desai
Atmos. Meas. Tech., 16, 5827–5846, https://doi.org/10.5194/amt-16-5827-2023, https://doi.org/10.5194/amt-16-5827-2023, 2023
Short summary
Short summary
Cloud droplet number concentration can be retrieved from remote sensing measurements. Aircraft measurements are used to validate four ground-based retrievals of cloud droplet number concentration. We demonstrate that retrieved cloud droplet number concentrations align well with aircraft measurements for overcast clouds, but they may substantially differ for broken clouds. The ensemble of various retrievals can help quantify retrieval uncertainties and identify reliable retrieval scenarios.
Eric M. Wilcox, Tianle Yuan, and Hua Song
Atmos. Meas. Tech., 16, 5387–5401, https://doi.org/10.5194/amt-16-5387-2023, https://doi.org/10.5194/amt-16-5387-2023, 2023
Short summary
Short summary
A new database is constructed from over 20 years of satellite records that comprises millions of deep convective clouds and spans the global tropics and subtropics. The database is a collection of clouds ranging from isolated cells to giant cloud systems. The cloud database provides a means of empirically studying the factors that determine the spatial structure and coverage of convective cloud systems, which are strongly related to the overall radiative forcing by cloud systems.
Florian Baur, Leonhard Scheck, Christina Stumpf, Christina Köpken-Watts, and Roland Potthast
Atmos. Meas. Tech., 16, 5305–5326, https://doi.org/10.5194/amt-16-5305-2023, https://doi.org/10.5194/amt-16-5305-2023, 2023
Short summary
Short summary
Near-infrared satellite images have information on clouds that is complementary to what is available from the visible and infrared parts of the spectrum. Using this information for data assimilation and model evaluation requires a fast, accurate forward operator to compute synthetic images from numerical weather prediction model output. We discuss a novel, neural-network-based approach for the 1.6 µm near-infrared channel that is suitable for this purpose and also works for other solar channels.
Zhipeng Qu, David P. Donovan, Howard W. Barker, Jason N. S. Cole, Mark W. Shephard, and Vincent Huijnen
Atmos. Meas. Tech., 16, 4927–4946, https://doi.org/10.5194/amt-16-4927-2023, https://doi.org/10.5194/amt-16-4927-2023, 2023
Short summary
Short summary
The EarthCARE satellite mission Level 2 algorithm development requires realistic 3D cloud and aerosol scenes along the satellite orbits. One of the best ways to produce these scenes is to use a high-resolution numerical weather prediction model to simulate atmospheric conditions at 250 m horizontal resolution. This paper describes the production and validation of three EarthCARE test scenes.
Adrien Guyot, Jordan P. Brook, Alain Protat, Kathryn Turner, Joshua Soderholm, Nicholas F. McCarthy, and Hamish McGowan
Atmos. Meas. Tech., 16, 4571–4588, https://doi.org/10.5194/amt-16-4571-2023, https://doi.org/10.5194/amt-16-4571-2023, 2023
Short summary
Short summary
We propose a new method that should facilitate the use of weather radars to study wildfires. It is important to be able to identify the particles emitted by wildfires on radar, but it is difficult because there are many other echoes on radar like clear air, the ground, sea clutter, and precipitation. We came up with a two-step process to classify these echoes. Our method is accurate and can be used by fire departments in emergencies or by scientists for research.
Jesse Loveridge, Aviad Levis, Larry Di Girolamo, Vadim Holodovsky, Linda Forster, Anthony B. Davis, and Yoav Y. Schechner
Atmos. Meas. Tech., 16, 3931–3957, https://doi.org/10.5194/amt-16-3931-2023, https://doi.org/10.5194/amt-16-3931-2023, 2023
Short summary
Short summary
We test a new method for measuring the 3D spatial variations of water within clouds, using measurements of reflections of the Sun's light observed at multiple angles by satellites. This is a great improvement on older methods, which typically assume that clouds occur in a slab shape. Our study used computer modeling to show that our 3D method will work well in cumulus clouds, where older slab methods do not. Our method will inform us about these clouds and their role in our climate.
Zeen Zhu, Pavlos Kollias, and Fan Yang
Atmos. Meas. Tech., 16, 3727–3737, https://doi.org/10.5194/amt-16-3727-2023, https://doi.org/10.5194/amt-16-3727-2023, 2023
Short summary
Short summary
We show that large rain droplets, with large inertia, are unable to follow the rapid change of velocity field in a turbulent environment. A lack of consideration for this inertial effect leads to an artificial broadening of the Doppler spectrum from the conventional simulator. Based on the physics-based simulation, we propose a new approach to generate the radar Doppler spectra. This simulator provides a valuable tool to decode cloud microphysical and dynamical properties from radar observation.
Gerd-Jan van Zadelhoff, David P. Donovan, and Ping Wang
Atmos. Meas. Tech., 16, 3631–3651, https://doi.org/10.5194/amt-16-3631-2023, https://doi.org/10.5194/amt-16-3631-2023, 2023
Short summary
Short summary
The Earth Clouds, Aerosols and Radiation (EarthCARE) satellite mission features the UV lidar ATLID. The ATLID FeatureMask algorithm provides a high-resolution detection probability mask which is used to guide smoothing strategies within the ATLID profile retrieval algorithm, one step further in the EarthCARE level-2 processing chain, in which the microphysical retrievals and target classification are performed.
Shannon L. Mason, Robin J. Hogan, Alessio Bozzo, and Nicola L. Pounder
Atmos. Meas. Tech., 16, 3459–3486, https://doi.org/10.5194/amt-16-3459-2023, https://doi.org/10.5194/amt-16-3459-2023, 2023
Short summary
Short summary
We present a method for accurately estimating the contents and properties of clouds, snow, rain, and aerosols through the atmosphere, using the combined measurements of the radar, lidar, and radiometer instruments aboard the upcoming EarthCARE satellite, and evaluate the performance of the retrieval, using test scenes simulated from a numerical forecast model. When EarthCARE is in operation, these quantities and their estimated uncertainties will be distributed in a data product called ACM-CAP.
Artem G. Feofilov, Hélène Chepfer, Vincent Noël, and Frederic Szczap
Atmos. Meas. Tech., 16, 3363–3390, https://doi.org/10.5194/amt-16-3363-2023, https://doi.org/10.5194/amt-16-3363-2023, 2023
Short summary
Short summary
The response of clouds to human-induced climate warming remains the largest source of uncertainty in model predictions of climate. We consider cloud retrievals from spaceborne observations, the existing CALIOP lidar and future ATLID lidar; show how they compare for the same scenes; and discuss the advantage of adding a new lidar for detecting cloud changes in the long run. We show that ATLID's advanced technology should allow for better detecting thinner clouds during daytime than before.
Woosub Roh, Masaki Satoh, Tempei Hashino, Shuhei Matsugishi, Tomoe Nasuno, and Takuji Kubota
Atmos. Meas. Tech., 16, 3331–3344, https://doi.org/10.5194/amt-16-3331-2023, https://doi.org/10.5194/amt-16-3331-2023, 2023
Short summary
Short summary
JAXA EarthCARE synthetic data (JAXA L1 data) were compiled using the global storm-resolving model (GSRM) NICAM (Nonhydrostatic ICosahedral
Atmospheric Model) simulation with 3.5 km horizontal resolution and the Joint-Simulator. JAXA L1 data are intended to support the development of JAXA retrieval algorithms for the EarthCARE sensor before launch of the satellite. The expected orbit of EarthCARE and horizontal sampling of each sensor were used to simulate the signals.
Philipp Gregor, Tobias Zinner, Fabian Jakub, and Bernhard Mayer
Atmos. Meas. Tech., 16, 3257–3271, https://doi.org/10.5194/amt-16-3257-2023, https://doi.org/10.5194/amt-16-3257-2023, 2023
Short summary
Short summary
This work introduces MACIN, a model for short-term forecasting of direct irradiance for solar energy applications. MACIN exploits cloud images of multiple cameras to predict irradiance. The model is applied to artificial images of clouds from a weather model. The artificial cloud data allow for a more in-depth evaluation and attribution of errors compared with real data. Good performance of derived cloud information and significant forecast improvements over a baseline forecast were found.
Christian Matar, Céline Cornet, Frédéric Parol, Laurent C.-Labonnote, Frédérique Auriol, and Marc Nicolas
Atmos. Meas. Tech., 16, 3221–3243, https://doi.org/10.5194/amt-16-3221-2023, https://doi.org/10.5194/amt-16-3221-2023, 2023
Short summary
Short summary
The optimal estimation formalism is applied to OSIRIS airborne high-resolution multi-angular measurements to retrieve COT and Reff. The corresponding uncertainties related to measurement errors, which are up to 6 and 12 %, the non-retrieved parameters, which are less than 0.5 %, and the cloud model assumptions show that the heterogeneous vertical profiles and the 3D radiative transfer effects lead to average uncertainties of 5 and 4 % for COT and 13 and 9 % for Reff.
Yuichiro Hagihara, Yuichi Ohno, Hiroaki Horie, Woosub Roh, Masaki Satoh, and Takuji Kubota
Atmos. Meas. Tech., 16, 3211–3219, https://doi.org/10.5194/amt-16-3211-2023, https://doi.org/10.5194/amt-16-3211-2023, 2023
Short summary
Short summary
The CPR on the EarthCARE satellite is the first satellite-borne Doppler radar. We evaluated the effectiveness of horizontal integration and the unfolding method for the reduction of the Doppler error (the standard deviation of the random error) in the CPR_ECO product. The error was higher in the tropics than in the other latitudes due to frequent rain echo occurrence and limitation of its unfolding correction. If we use low-mode operation (high PRF), the errors become small enough.
Kamil Mroz, Bernat Puidgomènech Treserras, Alessandro Battaglia, Pavlos Kollias, Aleksandra Tatarevic, and Frederic Tridon
Atmos. Meas. Tech., 16, 2865–2888, https://doi.org/10.5194/amt-16-2865-2023, https://doi.org/10.5194/amt-16-2865-2023, 2023
Short summary
Short summary
We present the theoretical basis of the algorithm that estimates the amount of water and size of particles in clouds and precipitation. The algorithm uses data collected by the Cloud Profiling Radar that was developed for the upcoming Earth Clouds, Aerosols and Radiation Explorer (EarthCARE) satellite mission. After the satellite launch, the vertical distribution of cloud and precipitation properties will be delivered as the C-CLD product.
Anja Hünerbein, Sebastian Bley, Stefan Horn, Hartwig Deneke, and Andi Walther
Atmos. Meas. Tech., 16, 2821–2836, https://doi.org/10.5194/amt-16-2821-2023, https://doi.org/10.5194/amt-16-2821-2023, 2023
Short summary
Short summary
The Multi-Spectral Imager (MSI) on board the EarthCARE satellite will provide the information needed for describing the cloud and aerosol properties in the cross-track direction, complementing the measurements from the Cloud Profiling Radar, Atmospheric Lidar and Broad-Band Radiometer. The accurate discrimination between clear and cloudy pixels is an essential first step. Therefore, the cloud mask algorithm provides a cloud flag, cloud phase and cloud type product for the MSI observations.
Zhipeng Qu, Howard W. Barker, Jason N. S. Cole, and Mark W. Shephard
Atmos. Meas. Tech., 16, 2319–2331, https://doi.org/10.5194/amt-16-2319-2023, https://doi.org/10.5194/amt-16-2319-2023, 2023
Short summary
Short summary
This paper describes EarthCARE’s L2 product ACM-3D. It includes the scene construction algorithm (SCA) used to produce the indexes for reconstructing 3D atmospheric scene based on satellite nadir retrievals. It also provides the information about the buffer zone sizes of 3D assessment domains and the ranking scores for selecting the best 3D assessment domains. These output variables are needed to run 3D radiative transfer models for the radiative closure assessment of EarthCARE’s L2 retrievals.
Steven T. Massie, Heather Cronk, Aronne Merrelli, Sebastian Schmidt, and Steffen Mauceri
Atmos. Meas. Tech., 16, 2145–2166, https://doi.org/10.5194/amt-16-2145-2023, https://doi.org/10.5194/amt-16-2145-2023, 2023
Short summary
Short summary
This paper provides insights into the effects of clouds on Orbiting Carbon Observatory (OCO-2) measurements of CO2. Calculations are carried out that indicate the extent to which this satellite experiment underestimates CO2, due to these cloud effects, as a function of the distance between the surface observation footprint and the nearest cloud. The paper discusses how to lessen the influence of these cloud effects.
Armin Blanke, Andrew J. Heymsfield, Manuel Moser, and Silke Trömel
Atmos. Meas. Tech., 16, 2089–2106, https://doi.org/10.5194/amt-16-2089-2023, https://doi.org/10.5194/amt-16-2089-2023, 2023
Short summary
Short summary
We present an evaluation of current retrieval techniques in the ice phase applied to polarimetric radar measurements with collocated in situ observations of aircraft conducted over the Olympic Mountains, Washington State, during winter 2015. Radar estimates of ice properties agreed most with aircraft observations in regions with pronounced radar signatures, but uncertainties were identified that indicate issues of some retrievals, particularly in warmer temperature regimes.
Cited articles
Ball, J. E., Anderson, D. T., and Chan, C. S.: Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community, J. Appl. Remote Sens., 11, 042609, https://doi.org/10.1117/1.jrs.11.042609, 2017. a
Blanc, P. and Wald, L.: The SG2 algorithm for a fast and accurate computation of the position of the Sun for multi-decadal time period, Sol. Energy, 86, 3072–3083, https://doi.org/10.1016/j.solener.2012.07.018, 2012. a, b
Blanc, P., Gschwind, B., Lefèvre, M., and Wald, L.: The HelioClim
project: Surface solar irradiance data for climate applications, Remote
Sens., 3, 343–361, https://doi.org/10.3390/rs3020343, 2011a. a
Blanc, P., Gschwind, B., Lefèvre, M., and Wald, L.: The HelioClim
project: Surface solar irradiance data for climate applications, Remote
Sens., 3, 343–361, https://doi.org/10.3390/rs3020343, 2011b. a
Blanc, P., Gschwind, B., Lefevre, M., and Wald, L.: Twelve monthly maps of
ground Albedo parameters derived from MODIS data sets, International
Geoscience and Remote Sensing Symposium (IGARSS), 13–18 July 2014, Quebec City, QC, Canada, IEEE, 3270–3272, https://doi.org/10.1109/IGARSS.2014.6947177, 2014. a, b
Blanc, P., Remund, J., and Vallance, L.: Short-term solar power forecasting based on satellite images, Elsevier Ltd, https://doi.org/10.1016/B978-0-08-100504-0.00006-8, 2017. a
Boukabara, S.-A., Krasnopolsky, V., Stewart, J. Q., Maddy, E. S., Shahroudi, N., and Hoffman, R. N.: Leveraging Modern Artificial Intelligence for Remote Sensing and NWP: Benefits and Challenges, B. Am. Meteorol. Soc., 100, ES473–ES491, https://doi.org/10.1175/BAMS-D-18-0324.1, 2019. a
Brenowitz, N. D. and Bretherton, C. S.: Prognostic Validation of a Neural Network Unified Physics Parameterization, Geophys. Res. Lett., 45,
6289–6298, https://doi.org/10.1029/2018GL078510, 2018. a
Brunier, L.: Basic measurements of radiation at station Carpentras (2018-10), Centre Radiometrique, PANGAEA [data set], https://doi.org/10.1594/PANGAEA.896713, 2018. a
Cano, D., Monget, J., Albuisson, M., Guillard, H., Regas, N., and Wald, L.: A method for the determination of the global solar radiation from
meteorological satellite data, Sol. Energy, 37, 31–39,
https://doi.org/10.1016/0038-092X(86)90104-0, 1986. a
Copernicus Atmospheric Monitoring Service: CAMS Radiation Service, Copernicus Atmospheric Monitoring Service, http://www.soda-pro.com/web-services/radiation/cams-radiation-service (last access: 12 September 2023), 2020. a
Eissa, Y., Korany, M., Aoun, Y., Boraiy, M., Abdel Wahab, M. M., Alfaro, S. C., Blanc, P., El-Metwally, M., Ghedira, H., Hungershoefer, K., and Wald, L.: Validation of the Surface Downwelling Solar Irradiance Estimates of the
HelioClim-3 Database in Egypt, Remote Sens., 7, 9269–9291,
https://doi.org/10.3390/rs70709269, 2015. a
EUMETSAT: High Rate SEVIRI Level 1.5 Image Data – MSG – 0 degree, EUMETSAT [data set], https://navigator.eumetsat.int/product/EO:EUM:DAT:MSG:HRSEVIRI (last access: 12 September 2023), 2009. a
EUMETSAT: MSG Level 1.5 Image Data Format Description, EUMETSAT, Tech. rep., https://www.eumetsat.int/media/45126 (last access: 5 September 2023), 2017. a
Forstinger, A., Wilbert, S., Jensen, A. R., Kraas, B., Fernández Peruchena, C., Gueymard, C. A., Ronzio, D., Yang, D., Collino, E., Polo Martinez, J., Ruiz-Arias, J. A., Hanrieder, N., Blanc, P., and Saint-Drenan, Y.-M.: Worldwide solar radiation benchmark of modelled surface irradiance, EMS Annual Meeting 2022, Bonn, Germany, 5–9 September 2022, EMS2022-547, https://doi.org/10.5194/ems2022-547, 2023. a, b
Giles, D. M., Sinyuk, A., Sorokin, M. G., Schafer, J. S., Smirnov, A., Slutsker, I., Eck, T. F., Holben, B. N., Lewis, J. R., Campbell, J. R., Welton, E. J., Korkin, S. V., and Lyapustin, A. I.: Advancements in the Aerosol Robotic Network (AERONET) Version 3 database – automated near-real-time quality control algorithm with improved cloud screening for Sun photometer aerosol optical depth (AOD) measurements, Atmos. Meas. Tech., 12, 169–209, https://doi.org/10.5194/amt-12-169-2019, 2019. a
Gschwind, B., Wald, L., Blanc, P., Lefèvre, M., Schroedter-Homscheidt,
M., and Arola, A.: Improving the McClear model estimating the downwelling
solar radiation at ground level in cloud-free conditions – McClear-v3,
Meteorol. Z., 28, 147–163, https://doi.org/10.1127/metz/2019/0946, 2019. a
Hao, D., Asrar, G. R., Zeng, Y., Zhu, Q., Wen, J., Xiao, Q., and Chen, M.:
Estimating hourly land surface downward shortwave and photosynthetically
active radiation from DSCOVR/EPIC observations, Remote Sens. Environ., 232, 111320, https://doi.org/10.1016/j.rse.2019.111320, 2019. a, b
Hao, D., Asrar, G. R., Zeng, Y., Zhu, Q., Wen, J., Xiao, Q., and Chen, M.: DSCOVR/EPIC-derived global hourly and daily downward shortwave and photosynthetically active radiation data at 0.1∘ × 0.1∘ resolution, Earth Syst. Sci. Data, 12, 2209–2221, https://doi.org/10.5194/essd-12-2209-2020, 2020. a
Hastie, T., Tibshirani, R., and Friedman, J.: The Elements of Statistical
LearningData Mining, Inference, and Prediction, Second Edition, Springer
Series in Statistics, Springer New York, New York, NY,
https://doi.org/10.1007/978-0-387-84858-7, 2009. a
Holben, B. N., Eck, T. F., Slutsker, I., Tanré, D., Buis, J. P., Setzer, A., Vermote, E., Reagan, J. A., Kaufman, Y. J., Nakajima, T., Lavenu, F., Jankowiak, I., and Smirnov, A.: AERONET – A federated instrument network and data archive for aerosol characterization, Remote Sens. Environ., 66, 1–16, https://doi.org/10.1016/S0034-4257(98)00031-5, 1998. a
Holmgren, W. F., Hansen, C. W., and Mikofski, M. A.: pvlib python: a python package for modeling solar energy systems, Journal of Open Source Software, 3, 884, https://doi.org/10.21105/joss.00884, 2018 (code available at: https://pvlib-python.readthedocs.io/en/stable/reference/generated/pvlib.iotools.get_cams.html, last access: 7 September 2023). a, b
Huang, G., Li, Z., Li, X., Liang, S., Yang, K., Wang, D., and Zhang, Y.:
Estimating surface solar irradiance from satellites: Past, present, and
future perspectives, Remote Sens. Environ., 233, 111371,
https://doi.org/10.1016/j.rse.2019.111371, 2019. a
Jiang, H., Lu, N., Qin, J., Tang, W., and Yao, L.: A deep learning algorithm to estimate hourly global solar radiation from geostationary satellite data, Renew. Sust. Energ. Rev., 114, 109327, https://doi.org/10.1016/j.rser.2019.109327, 2019. a
Lefèvre, M., Oumbe, A., Blanc, P., Espinar, B., Gschwind, B., Qu, Z., Wald, L., Schroedter-Homscheidt, M., Hoyer-Klick, C., Arola, A., Benedetti, A., Kaiser, J. W., and Morcrette, J.-J.: McClear: a new model estimating downwelling solar radiation at ground level in clear-sky conditions, Atmos. Meas. Tech., 6, 2403–2418, https://doi.org/10.5194/amt-6-2403-2013, 2013. a
Long, C. N. and Dutton, E. G.: BSRN Global Network recommended QC tests, V2.x, https://hdl.handle.net/10013/epic.38770 (last access: 12 September 2023), 2010. a
McGovern, A., Elmore, K. L., Gagne, D. J., Haupt, S. E., Karstens, C. D., Lagerquist, R., Smith, T., and Williams, J. K.: Using artificial intelligence to improve real-time decision-making for high-impact weather, B. Am. Meteorol. Soc., 98, 2073–2090, https://doi.org/10.1175/BAMS-D-16-0123.1, 2017. a
Müller, R. and Pfeifroth, U.: Remote sensing of solar surface radiation – a reflection of concepts, applications and input data based on experience with the effective cloud albedo, Atmos. Meas. Tech., 15, 1537–1561, https://doi.org/10.5194/amt-15-1537-2022, 2022. a
Ohmura, A., Dutton, E. G., Forgan, B., Frohlich, C., Gilgen, H., Hegner, H.,
Heimo, A., Konig-Langlo, G., Mcarthur, B., Miiller, G., Philipona, R.,
Pinker, R., Whitlock, C. H., Dehne, K., and Wild, M.: Baseline Surface Radiation Network (BSRN/WCRP): New Precision Radiometry for Climate Research, B. Am. Meteorol. Soc., 79, 2115–2136, http://www.jstor.org/stable/26214877 (last access: 7 September 2023), 1998. a
Polo, J., Wilbert, S., Ruiz-Arias, J. A., Meyer, R., Gueymard, C., Súri, M., Martín, L., Mieslinger, T., Blanc, P., Grant, I., Boland, J., Ineichen, P., Remund, J., Escobar, R., Troccoli, A., Sengupta, M., Nielsen, K. P., Renne, D., Geuder, N., and Cebecauer, T.: Preliminary survey on site-adaptation techniques for satellite-derived and reanalysis solar radiation datasets, Sol. Energy, 132, 25–37,
https://doi.org/10.1016/j.solener.2016.03.001, 2016. a
Polo, J., Fernández-Peruchena, C., Salamalikis, V., Mazorra-Aguiar, L., Turpin, M., Martín-Pomares, L., Kazantzidis, A., Blanc, P., and Remund,
J.: Benchmarking on improvement and site-adaptation techniques for modeled
solar radiation datasets, Sol. Energy, 201, 469–479,
https://doi.org/10.1016/j.solener.2020.03.040, 2020. a
Qu, Z., Oumbe, A., Blanc, P., Espinar, B., Gesell, G., Gschwind, B., Klüser, L., Lefèvre, M., Saboret, L., Schroedter-Homscheidt, M.,
and Wald, L.: Fast radiative transfer parameterisation for assessing the
surface solar irradiance: The Heliosat-4 method, Meteorol. Z., 26, 33–57, https://doi.org/10.1127/metz/2016/0781, 2017. a, b, c
Racah, E., Beckham, C., Maharaj, T., Kahou, S. E., Prabhat, and Pal, C.: ExtremeWeather: A large-scale climate dataset for semi-supervised detection, localization, and understanding of extreme weather events, Adv. Neur. In., 2017, 3403–3414, 2017. a
Ranalli, J. and Zech, M.: Generalizability of Neural Network-based
Identification of PV in Aerial Images, 50th IEEE PV Specialists Conference,
11–16 June 2023, San Juan, Puerto Rico, IEEE, https://scholarsphere.psu.edu/resources/b8ff0491-2820-4328-a399-c3f80d911cd7 (last access: 12 September 2023), 2023. a
Rasp, S., Pritchard, M. S., and Gentine, P.: Deep learning to represent
subgrid processes in climate models, P. Natl. Acad. Sci. USA, 115, 9684–9689, https://doi.org/10.1073/pnas.1810286115, 2018. a
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J.,
Carvalhais, N., and Prabhat: Deep learning and process understanding for
data-driven Earth system science, Nature, 566, 195–204,
https://doi.org/10.1038/s41586-019-0912-1, 2019. a
Reno, M. J. and Hansen, C. W.: Identification of periods of clear sky
irradiance in time series of GHI measurements, Renew. Energ., 90,
520–531, https://doi.org/10.1016/j.renene.2015.12.031, 2016. a
Rigollier, C. and Wald, L.: Towards operational mapping of solar radiation from Meteosat images, in: Proceedings, EARSeL Symposium 1998 “operational remote sensing for sustainable development”, 11–14 May 1998, Enschede, the Netherlands, edited by: Nieuwenhuis, J. A., Vaughan, R. A., and Molenaar, M., CRC Press, 385–391, ISBN 9058090299, 1998. a
Scheck, L., Frèrebeau, P., Buras-Schnell, R., and Mayer, B.: A fast
radiative transfer method for the simulation of visible satellite imagery,
J. Quant. Spectrosc. Ra., 175, 54–67, https://doi.org/10.1016/j.jqsrt.2016.02.008, 2016.
a
Schroedter-Homscheidt, M., Arola, A., Killius, N., Lefèvre, M., Saboret,
L., Wandji, W., Wald, L., and Wey, E.: The Copernicus atmosphere monitoring
service (CAMS) radiation service in a nutshell, Proc. SolarPACES16, 22nd SolarPACES Conference 2016, 11–14 October 2016, AbuDhabi, United Arab Emirates, Centre pour la communication scientifique directe, 11–14, https://minesparis-psl.hal.science/hal-01386187 (last access: 7 September 2023), 2016. a
Sengupta, M., Xie, Y., Lopez, A., Habte, A., Maclaurin, G., and Shelby, J.:
The National Solar Radiation Data Base (NSRDB), Renew. Sust. Energ. Rev., 89, 51–60, https://doi.org/10.1016/j.rser.2018.03.003, 2018. a
Spearman, C.: The Proof and Measurement of Association between Two Things,
Am. J. Psychol., 100, 441–471, https://doi.org/10.2307/1422689, 1987. a
Tieleman, T. and Hinton, G.: Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude, COURSERA: Neural networks for machine learning, 4, 26–31, 2012. a
Tournadre, B.: Heliosat-V: une méthode polyvalente d'estimation du rayonnement solaire par satellite, Génie des procédés, Université Paris sciences et lettres, Tech. rep., https://pastel.archives-ouvertes.fr/tel-03227271 (last access: 5 September 2023), 2020. a
Verbois, H., Blanc, P., Huva, R., Saint-Drenan, Y.-M. Y. M., Rusydi, A., and
Thiery, A.: Beyond quadratic error: Case-study of a multiple criteria
approach to the performance assessment of numerical forecasts of solar
irradiance in the tropics, Renew. Sust. Energ. Rev., 117,
109471, https://doi.org/10.1016/j.rser.2019.109471, 2020. a
Verbois, H., Saint-Drenan, Y. M., Thiery, A., and Blanc, P.: Statistical learning for NWP post-processing: A benchmark for solar irradiance forecasting, Sol. Energy, 238, 132–149, https://doi.org/10.1016/j.solener.2022.03.017, 2022. a, b
Verbois, H., Saint-Drenan, Y.-M., Libois, Q., Michel, Y., Cassas, M., Dubus, L., and Blanc, P.: Improvement of satellite-derived surface solar irradiance estimations using spatio-temporal extrapolation with statistical learning, Sol. Energy, 258, 175–193, https://doi.org/10.1016/j.solener.2023.04.037, 2023. a, b, c
Wang, R., Camilo, J., Collins, L. M., Bradbury, K., and Malof, J. M.: The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: an empirical study with solar array detection, in: 2017 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), 10–12 October 2017, Washington, DC, USA, IEEE, 1–8, https://doi.org/10.1109/AIPR.2017.8457960, 2017. a
Xie, Y., Sengupta, M., and Dudhia, J.: A Fast All-sky Radiation Model for
Solar applications (FARMS): Algorithm and performance evaluation, Sol.
Energy, 135, 435–445, https://doi.org/10.1016/j.solener.2016.06.003, 2016. a
Yang, X., Bright, J. M., Gueymard, C. A., Acord, B., and Wang, P.: Worldwide validation of an Earth Polychromatic Imaging Camera (EPIC) derived radiation product and comparison with recent reanalyses, Sol. Energy, 243, 421–430,
https://doi.org/10.1016/j.solener.2022.08.013, 2022. a
Short summary
Solar surface irradiance (SSI) estimations inferred from satellite images are essential to gain a comprehensive understanding of the solar resource, which is crucial in many fields. This study examines the recent data-driven methods for inferring SSI from satellite images and explores their strengths and weaknesses. The results suggest that while these methods show great promise, they sometimes dramatically underperform and should probably be used in conjunction with physical approaches.
Solar surface irradiance (SSI) estimations inferred from satellite images are essential to gain...
