Articles | Volume 15, issue 19
https://doi.org/10.5194/amt-15-5793-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-15-5793-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
14 Oct 2022
Research article |
| 14 Oct 2022
| 14 Oct 2022
Neural network processing of holographic images
John S. Schreck
CORRESPONDING AUTHOR
Computational and Information Systems Laboratory, National Center for Atmospheric Research (NCAR), Boulder, CO, USA
Gabrielle Gantos
Computational and Information Systems Laboratory, National Center for Atmospheric Research (NCAR), Boulder, CO, USA
Matthew Hayman
CORRESPONDING AUTHOR
Earth Observing Lab, National Center for Atmospheric Research (NCAR), Boulder, CO, USA
Aaron Bansemer
Mesoscale and Microscale Meteorology Laboratory, National Center for Atmospheric Research (NCAR), Boulder, CO, USA
David John Gagne
Computational and Information Systems Laboratory, National Center for Atmospheric Research (NCAR), Boulder, CO, USA
Related authors
No articles found.
Nina Maherndl, Manuel Moser, Imke Schirmacher, Aaron Bansemer, Johannes Lucke, Christiane Voigt, and Maximilian Maahn
EGUsphere, https://doi.org/10.5194/egusphere-2024-1214, https://doi.org/10.5194/egusphere-2024-1214, 2024
Short summary
Short summary
It is not clear, why ice crystals in clouds occur in clusters. Here, airborne measurements of clouds in mid- and high-latitudes are used to study the spatial variability of ice. Further, we investigate the influence of riming, which occurs when liquid droplets freeze onto ice crystals. We find that riming enhances the occurrence of ice clusters. In the Arctic, riming leads to ice clustering at spatial scales of 3–5 km. This is due to updrafts, not necessary higher amounts of liquid water.
Sue Ellen Haupt, Branko Kosović, Larry K. Berg, Colleen M. Kaul, Matthew Churchfield, Jeffrey Mirocha, Dries Allaerts, Thomas Brummet, Shannon Davis, Amy DeCastro, Susan Dettling, Caroline Draxl, David John Gagne, Patrick Hawbecker, Pankaj Jha, Timothy Juliano, William Lassman, Eliot Quon, Raj K. Rai, Michael Robinson, William Shaw, and Regis Thedin
Wind Energ. Sci., 8, 1251–1275, https://doi.org/10.5194/wes-8-1251-2023, https://doi.org/10.5194/wes-8-1251-2023, 2023
Short summary
Short summary
The Mesoscale to Microscale Coupling team, part of the U.S. Department of Energy Atmosphere to Electrons (A2e) initiative, has studied various important challenges related to coupling mesoscale models to microscale models. Lessons learned and discerned best practices are described in the context of the cases studied for the purpose of enabling further deployment of wind energy. It also points to code, assessment tools, and data for testing the methods.
Sachin Patade, Deepak Waman, Akash Deshmukh, Ashok Kumar Gupta, Arti Jadav, Vaughan T. J. Phillips, Aaron Bansemer, Jacob Carlin, and Alexander Ryzhkov
Atmos. Chem. Phys., 22, 12055–12075, https://doi.org/10.5194/acp-22-12055-2022, https://doi.org/10.5194/acp-22-12055-2022, 2022
Short summary
Short summary
This modeling study focuses on the role of multiple groups of primary biological aerosol particles as ice nuclei on cloud properties and precipitation. This was done by implementing a more realistic scheme for biological ice nucleating particles in the aerosol–cloud model. Results show that biological ice nucleating particles have a limited role in altering the ice phase and precipitation in deep convective clouds.
Willem J. Marais and Matthew Hayman
Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, https://doi.org/10.5194/amt-15-5159-2022, 2022
Short summary
Short summary
For atmospheric science and weather prediction, it is important to make water vapor measurements in real time. A low-cost lidar instrument has been developed by Montana State University and the National Center for Atmospheric Research. We developed an advanced signal-processing method to extend the scientific capability of the lidar instrument. With the new method we show that the maximum altitude at which the MPD can make water vapor measurements can be extended up to 8 km.
Scott M. Spuler, Matthew Hayman, Robert A. Stillwell, Joshua Carnes, Todd Bernatsky, and Kevin S. Repasky
Atmos. Meas. Tech., 14, 4593–4616, https://doi.org/10.5194/amt-14-4593-2021, https://doi.org/10.5194/amt-14-4593-2021, 2021
Short summary
Short summary
Continuous water vapor and temperature profiles are critically needed for improved understanding of the lower atmosphere and potential advances in weather forecasting skill. To address this observation need, an active remote sensing technology based on a diode-laser-based lidar architecture is being developed. We discuss the details of the lidar architecture and analyze how it addresses a national-scale profiling network's need to provide continuous thermodynamic observations.
Sebastian J. O'Shea, Jonathan Crosier, James Dorsey, Waldemar Schledewitz, Ian Crawford, Stephan Borrmann, Richard Cotton, and Aaron Bansemer
Atmos. Meas. Tech., 12, 3067–3079, https://doi.org/10.5194/amt-12-3067-2019, https://doi.org/10.5194/amt-12-3067-2019, 2019
Short summary
Short summary
Optical array probe measurements of clouds are widely used to inform and validate numerical weather and climate models. In this paper, we discuss artefacts which may bias data from these instruments. Using laboratory and synthetic datasets, we demonstrate how greyscale analysis can be used to filter data, constraining the sample volume and improving data quality particularly at small sizes where their measurements are considered unreliable.
S. M. Spuler, K. S. Repasky, B. Morley, D. Moen, M. Hayman, and A. R. Nehrir
Atmos. Meas. Tech., 8, 1073–1087, https://doi.org/10.5194/amt-8-1073-2015, https://doi.org/10.5194/amt-8-1073-2015, 2015
Short summary
Short summary
A water vapor lidar has been designed and tested which has the potential to enable a national-scale network. The system is low-maintenance, low-cost, eye-safe, and provides continuous profiles of water vapor with complete coverage, including periods of daytime bright clouds, from 300m above ground level to 4km with 150m nominal vertical resolution and 1 min temporal resolution. The sensor may be useful in improving our understanding of the distribution of atmospheric water vapor.
T. Eidhammer, H. Morrison, A. Bansemer, A. Gettelman, and A. J. Heymsfield
Atmos. Chem. Phys., 14, 10103–10118, https://doi.org/10.5194/acp-14-10103-2014, https://doi.org/10.5194/acp-14-10103-2014, 2014
J. L. Stith, L. M. Avallone, A. Bansemer, B. Basarab, S. W. Dorsi, B. Fuchs, R. P. Lawson, D. C. Rogers, S. Rutledge, and D. W. Toohey
Atmos. Chem. Phys., 14, 1973–1985, https://doi.org/10.5194/acp-14-1973-2014, https://doi.org/10.5194/acp-14-1973-2014, 2014
Related subject area
Subject: Clouds | Technique: In Situ Measurement | Topic: Data Processing and Information Retrieval
Innovative cloud quantification: deep learning classification and finite-sector clustering for ground-based all-sky imaging
Revealing halos concealed by cirrus clouds
Quantifying riming from airborne data during the HALO-(AC)3 campaign
Estimation of 24 h continuous cloud cover using a ground-based imager with a convolutional neural network
The Transition from Supercooled Liquid Water to Ice Crystals in Mixed-phase Clouds based on Airborne In-situ Observations
Ice crystal images from optical array probes: classification with convolutional neural networks
Detection and analysis of cloud boundary in Xi'an, China, employing 35 GHz cloud radar aided by 1064 nm lidar
The University of Washington Ice–Liquid Discriminator (UWILD) improves single-particle phase classifications of hydrometeors within Southern Ocean clouds using machine learning
Twenty-four-hour cloud cover calculation using a ground-based imager with machine learning
Application of cloud particle sensor sondes for estimating the number concentration of cloud water droplets and liquid water content: case studies in the Arctic region
Clouds over Hyytiälä, Finland: an algorithm to classify clouds based on solar radiation and cloud base height measurements
A convolutional neural network for classifying cloud particles recorded by imaging probes
Spatiotemporal variability of solar radiation introduced by clouds over Arctic sea ice
Analysis algorithm for sky type and ice halo recognition in all-sky images
Study of the diffraction pattern of cloud particles and the respective responses of optical array probes
A method for computing the three-dimensional radial distribution function of cloud particles from holographic images
A new method for calculating number concentrations of cloud condensation nuclei based on measurements of a three-wavelength humidified nephelometer system
Cloud radiative effect, cloud fraction and cloud type at two stations in Switzerland using hemispherical sky cameras
Evaluation of radar reflectivity factor simulations of ice crystal populations from in situ observations for the retrieval of condensed water content in tropical mesoscale convective systems
Cloud detection in all-sky images via multi-scale neighborhood features and multiple supervised learning techniques
From pixels to patches: a cloud classification method based on a bag of micro-structures
Evaluation of cloud base height measurements from Ceilometer CL31 and MODIS satellite over Ahmedabad, India
Software to analyze the relationship between aerosol, clouds, and precipitation: SAMAC
Block-based cloud classification with statistical features and distribution of local texture features
Assessment of the performance of the inter-arrival time algorithm to identify ice shattering artifacts in cloud particle probe measurements
Assessment of cloud supersaturation by size-resolved aerosol particle and cloud condensation nuclei (CCN) measurements
Inversion of droplet aerosol analyzer data for long-term aerosol–cloud interaction measurements
Response of the Nevzorov hot wire probe in clouds dominated by droplet conditions in the drizzle size range
Jingxuan Luo, Yubing Pan, Debin Su, Jinhua Zhong, Lingxiao Wu, Wei Zhao, Xiaoru Hu, Zhengchao Qi, Daren Lu, and Yinan Wang
Atmos. Meas. Tech., 17, 3765–3781, https://doi.org/10.5194/amt-17-3765-2024, https://doi.org/10.5194/amt-17-3765-2024, 2024
Short summary
Short summary
Accurate cloud quantification is critical for climate research. We developed a novel computer vision framework using deep neural networks and clustering algorithms for cloud classification and segmentation from ground-based all-sky images. After a full year of observational training, our model achieves over 95 % accuracy on four cloud types. The framework enhances quantitative analysis to support climate research by providing reliable cloud data.
Yuji Ayatsuka
Atmos. Meas. Tech., 17, 3739–3750, https://doi.org/10.5194/amt-17-3739-2024, https://doi.org/10.5194/amt-17-3739-2024, 2024
Short summary
Short summary
Many types of halos appear in the sky. Each type of halo reflects the state of the atmosphere; therefore observing them from the ground greatly helps in understanding the state of the atmosphere. However, halos are easily obscured by the contrast of the cloud itself, making it difficult to observe them. This study describes the construction of a sky-color model for halos and a new effective algorithm to reveal halos in images.
Nina Maherndl, Manuel Moser, Johannes Lucke, Mario Mech, Nils Risse, Imke Schirmacher, and Maximilian Maahn
Atmos. Meas. Tech., 17, 1475–1495, https://doi.org/10.5194/amt-17-1475-2024, https://doi.org/10.5194/amt-17-1475-2024, 2024
Short summary
Short summary
In some clouds, liquid water droplets can freeze onto ice crystals (riming). Riming leads to the formation of snowflakes. We show two ways to quantify riming using aircraft data collected in the Arctic. One aircraft had a cloud radar, while the other aircraft was measuring directly in cloud. The first method compares radar and direct observations. The second looks at snowflake shape. Both methods agree, except when there were gaps in the cloud. This improves our ability to understand riming.
Bu-Yo Kim, Joo Wan Cha, and Yong Hee Lee
Atmos. Meas. Tech., 16, 5403–5413, https://doi.org/10.5194/amt-16-5403-2023, https://doi.org/10.5194/amt-16-5403-2023, 2023
Short summary
Short summary
A camera-based imager and convolutional neural network (CNN) were used to estimate ground cloud cover. Image data from 2019 were used for training and validation, and those from 2020 were used for testing. The CNN model exhibited high performance, with an accuracy of 0.92, RMSE of 1.40 tenths, and 93% agreement with observed cloud cover within ±2 tenths' difference. It also outperformed satellites and ceilometers and proved to be the most suitable for ground-based cloud cover estimation.
Flor Vanessa Maciel and Minghui Diao
Atmos. Meas. Tech. Discuss., https://doi.org/10.5194/amt-2022-256, https://doi.org/10.5194/amt-2022-256, 2022
Revised manuscript accepted for AMT
Short summary
Short summary
The transition from supercooled liquid water to ice crystals in mixed-phase clouds is investigated using aircraft-based in-situ observations over the Southern Ocean. A novel method was developed to distinguish four transition phases for mixed-phase cloud evolution. Relationships between cloud macrophysical and microphysical properties are quantified. Effects of aerosols, thermodynamic and dynamical conditions on ice nucleation and phase partitioning are investigated.
Louis Jaffeux, Alfons Schwarzenböck, Pierre Coutris, and Christophe Duroure
Atmos. Meas. Tech., 15, 5141–5157, https://doi.org/10.5194/amt-15-5141-2022, https://doi.org/10.5194/amt-15-5141-2022, 2022
Short summary
Short summary
Optical array probes are instruments used aboard research aircraft to capture 2D images of ice or water particles in clouds. This study presents a new tool using innovative machine learning, called convolutional neural networks, designed to identify the shape of imaged ice particles for two of these imagers, namely 2DS and PIP. Such a tool will be a very strong asset for understanding cloud microphysics. Beyond traditional evaluation metrics, human inspections were performed of unknown data.
Yun Yuan, Huige Di, Yuanyuan Liu, Tao Yang, Qimeng Li, Qing Yan, Wenhui Xin, Shichun Li, and Dengxin Hua
Atmos. Meas. Tech., 15, 4989–5006, https://doi.org/10.5194/amt-15-4989-2022, https://doi.org/10.5194/amt-15-4989-2022, 2022
Short summary
Short summary
We put forward a new algorithm for joint observation of the cloud boundary by lidar and Ka-band millimetre-wave cloud radar. Cloud cover and boundary distribution characteristics are analysed from December 2020 to November 2021 in Xi'an. More than 34 % of clouds appear as a single layer every month. The maximum and minimum normalized cloud cover occurs in summer and winter, respectively. The study can provide more information on aerosol–cloud interactions and forecasting numerical models.
Rachel Atlas, Johannes Mohrmann, Joseph Finlon, Jeremy Lu, Ian Hsiao, Robert Wood, and Minghui Diao
Atmos. Meas. Tech., 14, 7079–7101, https://doi.org/10.5194/amt-14-7079-2021, https://doi.org/10.5194/amt-14-7079-2021, 2021
Short summary
Short summary
Many clouds with temperatures between 0 °C and −40 °C contain both liquid and ice particles, and the ratio of liquid to ice particles influences how the clouds interact with radiation and moderate Earth's climate. We use a machine learning method called random forest to classify images of individual cloud particles as either liquid or ice. We apply our algorithm to images captured by aircraft within clouds overlying the Southern Ocean, and we find that it outperforms two existing algorithms.
Bu-Yo Kim, Joo Wan Cha, and Ki-Ho Chang
Atmos. Meas. Tech., 14, 6695–6710, https://doi.org/10.5194/amt-14-6695-2021, https://doi.org/10.5194/amt-14-6695-2021, 2021
Short summary
Short summary
This study investigates a method for 24 h cloud cover calculation using a camera-based imager and supervised machine learning methods. The cloud cover is calculated by learning the statistical characteristics of the ratio, difference, and luminance using RGB channels of the image with a machine learning model. The proposed approach is suitable for nowcasting because it has higher learning and prediction speed than the method in which the many pixels of a 2D image are learned.
Jun Inoue, Yutaka Tobo, Kazutoshi Sato, Fumikazu Taketani, and Marion Maturilli
Atmos. Meas. Tech., 14, 4971–4987, https://doi.org/10.5194/amt-14-4971-2021, https://doi.org/10.5194/amt-14-4971-2021, 2021
Short summary
Short summary
A cloud particle sensor (CPS) sonde is an observing system to obtain the signals of the phase, size, and the number of cloud particles. Based on the field experiments in the Arctic regions and numerical experiments, we proposed a method to correct the CPS sonde data and found that the CPS sonde system can appropriately observe the liquid cloud if our correction method is applied.
Ilona Ylivinkka, Santeri Kaupinmäki, Meri Virman, Maija Peltola, Ditte Taipale, Tuukka Petäjä, Veli-Matti Kerminen, Markku Kulmala, and Ekaterina Ezhova
Atmos. Meas. Tech., 13, 5595–5619, https://doi.org/10.5194/amt-13-5595-2020, https://doi.org/10.5194/amt-13-5595-2020, 2020
Short summary
Short summary
In this study, we developed a new algorithm for cloud classification using solar radiation and cloud base height measurements. Our objective was to develop a simple and inexpensive but effective algorithm for the needs of studies related to ecosystem and atmosphere interactions. In the present study, we used the algorithm for obtaining cloud statistics at a measurement station in southern Finland, and we discuss the advantages and shortcomings of the algorithm.
Georgios Touloupas, Annika Lauber, Jan Henneberger, Alexander Beck, and Aurélien Lucchi
Atmos. Meas. Tech., 13, 2219–2239, https://doi.org/10.5194/amt-13-2219-2020, https://doi.org/10.5194/amt-13-2219-2020, 2020
Short summary
Short summary
Images of cloud particles give important information for improving our understanding of microphysical cloud processes. For phase-resolved measurements, a large number of water droplets and ice crystals need to be classified by an automated approach. In this study, a convolutional neural network was designed, which exceeds the classification ability of traditional methods and therefore shortens the analysis procedure of cloud particle images.
Carola Barrientos Velasco, Hartwig Deneke, Hannes Griesche, Patric Seifert, Ronny Engelmann, and Andreas Macke
Atmos. Meas. Tech., 13, 1757–1775, https://doi.org/10.5194/amt-13-1757-2020, https://doi.org/10.5194/amt-13-1757-2020, 2020
Short summary
Short summary
In the changing Arctic, quantifying the resulting variability of incoming solar radiation is important to better elucidate the net radiative effect of clouds. As part of a multidisciplinary expedition in the central Arctic held in early summer 2017, a novel network of pyranometers was deployed over an ice floe to investigate the spatiotemporal variability of solar radiation under different sky conditions. This study presents the collected data and an analysis of the spatiotemporal variability.
Sylke Boyd, Stephen Sorenson, Shelby Richard, Michelle King, and Morton Greenslit
Atmos. Meas. Tech., 12, 4241–4259, https://doi.org/10.5194/amt-12-4241-2019, https://doi.org/10.5194/amt-12-4241-2019, 2019
Short summary
Short summary
How cirroform clouds affect the radiation balance of the atmosphere depends on their properties, including ice particle types such as crystals, pellets, and fragments. Ice halos form if ice particles in these clouds are in a smooth hexagonal crystalline form. This paper introduces a method to search long-term records of sky images for ice halos, as gathered by total sky imagers (TSIs). Such an analysis will allow one to explore geographical and seasonal variations in cirrus cloud particle types.
Thibault Vaillant de Guélis, Alfons Schwarzenböck, Valery Shcherbakov, Christophe Gourbeyre, Bastien Laurent, Régis Dupuy, Pierre Coutris, and Christophe Duroure
Atmos. Meas. Tech., 12, 2513–2529, https://doi.org/10.5194/amt-12-2513-2019, https://doi.org/10.5194/amt-12-2513-2019, 2019
Michael L. Larsen and Raymond A. Shaw
Atmos. Meas. Tech., 11, 4261–4272, https://doi.org/10.5194/amt-11-4261-2018, https://doi.org/10.5194/amt-11-4261-2018, 2018
Short summary
Short summary
A statistical tool frequently utilized to measure scale-dependent departures from perfect randomness is the radial distribution function. This tool has many strengths, but it is not easy to calculate for particle detections within a three-dimensional sample volume. In this manuscript, we introduce and test a new method to estimate the three-dimensional radial distribution function in realistic measurement volumes.
Jiangchuan Tao, Chunsheng Zhao, Ye Kuang, Gang Zhao, Chuanyang Shen, Yingli Yu, Yuxuan Bian, and Wanyun Xu
Atmos. Meas. Tech., 11, 895–906, https://doi.org/10.5194/amt-11-895-2018, https://doi.org/10.5194/amt-11-895-2018, 2018
Short summary
Short summary
Existing chamber technologies for direct measurements of number concentration of cloud condensation nuclei (NCCN) are sophisticated and expensive. In this paper, a new method is proposed to calculate NCCN based only on measurements of a humidified nephelometer system which have accounted for influences of both aerosol size and aerosol hygroscopicity on NCCN calculation. This new method makes NCCN measurements more convenient and is capable of obtaining NCCN at lower supersaturations.
Christine Aebi, Julian Gröbner, Niklaus Kämpfer, and Laurent Vuilleumier
Atmos. Meas. Tech., 10, 4587–4600, https://doi.org/10.5194/amt-10-4587-2017, https://doi.org/10.5194/amt-10-4587-2017, 2017
Short summary
Short summary
The current study analyses the cloud radiative effect during the daytime depending on cloud fraction and cloud type at two stations in Switzerland over a time period of 3–5 years. Information about fractional cloud coverage and cloud type is retrieved from images taken by visible all-sky cameras. Cloud cover, cloud type and other atmospheric parameters have an influence on the magnitude of the longwave cloud effect as well as on the shortwave.
Emmanuel Fontaine, Delphine Leroy, Alfons Schwarzenboeck, Julien Delanoë, Alain Protat, Fabien Dezitter, Alice Grandin, John Walter Strapp, and Lyle Edward Lilie
Atmos. Meas. Tech., 10, 2239–2252, https://doi.org/10.5194/amt-10-2239-2017, https://doi.org/10.5194/amt-10-2239-2017, 2017
Short summary
Short summary
In this study we evaluate a method to estimate cloud water content (CWC) knowing cloud reflectivity. Ice hydrometeors are replace by ice oblate spheroids to simulate their reflectivity. There is no assumption on the relation between mass and their size. Then, a broad range of CWCs are compared with direct measurements of CWC. The accuracy of the method is ~ ±32 %. This study is performed in areas of convective clouds where reflectivity and CWC are especially high, what makes it unique.
Hsu-Yung Cheng and Chih-Lung Lin
Atmos. Meas. Tech., 10, 199–208, https://doi.org/10.5194/amt-10-199-2017, https://doi.org/10.5194/amt-10-199-2017, 2017
Short summary
Short summary
A cloud detection method for all-sky images is proposed. Obtaining improved cloud detection results is helpful for cloud classification, tracking and solar irradiance prediction. The features are extracted from local image patches with different sizes to include local structure and multi-resolution information. The cloud models are learned through the training process. We have shown that taking advantages of multiple classifiers and various patch sizes is able to increase the detection accuracy.
Qingyong Li, Zhen Zhang, Weitao Lu, Jun Yang, Ying Ma, and Wen Yao
Atmos. Meas. Tech., 9, 753–764, https://doi.org/10.5194/amt-9-753-2016, https://doi.org/10.5194/amt-9-753-2016, 2016
Short summary
Short summary
This paper proposes a new cloud classification method, named bag of micro-structures (BoMS), for whole-sky imagers. BoMS treats an all-sky image as a collection of micro-structures mapped from image patches, rather than a collection of pixels. BoMS identifies five different sky conditions: cirriform, cumuliform, stratiform, clear sky, and mixed cloudiness (often appearing in all-sky images but seldom addressed in the literature). The performance of BoMS overperforms those of traditional methods.
Som Sharma, Rajesh Vaishnav, Munn V. Shukla, Prashant Kumar, Prateek Kumar, Pradeep K. Thapliyal, Shyam Lal, and Yashwant B. Acharya
Atmos. Meas. Tech., 9, 711–719, https://doi.org/10.5194/amt-9-711-2016, https://doi.org/10.5194/amt-9-711-2016, 2016
Short summary
Short summary
Cloud base height observations from Ceilometer CL31 were extensively studied during May 2013 to January 2015 over Ahmedabad (23.03°N, 72.54°E), India. Results indicate that the ceilometer is an excellent instrument to precisely detect low- and mid-level clouds, and that the MODIS satellite provides accurate retrieval of high-level clouds over this region.
S. Gagné, L. P. MacDonald, W. R. Leaitch, and J. R. Pierce
Atmos. Meas. Tech., 9, 619–630, https://doi.org/10.5194/amt-9-619-2016, https://doi.org/10.5194/amt-9-619-2016, 2016
Short summary
Short summary
Measurements of clouds with an aircraft are essential to understand how clouds form and how they affect the Earth's climate. These measurements are used in climate models to help predict how our climate might develop in the next century. Aircraft measurements are, however, difficult for modellers to interpret because the way they were acquired and analyzed varies from one team of scientists to the next. We present a software platform for scientists to share and compare their analysis tools.
H.-Y. Cheng and C.-C. Yu
Atmos. Meas. Tech., 8, 1173–1182, https://doi.org/10.5194/amt-8-1173-2015, https://doi.org/10.5194/amt-8-1173-2015, 2015
Short summary
Short summary
This work performs cloud classification on all-sky images. To deal with mixed cloud types, we propose performing block-based classification. The proposed method combines local texture features with classical statistical texture features. The experimental results have shown that applying the combined feature results in higher classification accuracy. It is also validated that using block-based classification outperforms classification on the entire images.
A. Korolev and P. R. Field
Atmos. Meas. Tech., 8, 761–777, https://doi.org/10.5194/amt-8-761-2015, https://doi.org/10.5194/amt-8-761-2015, 2015
M. L. Krüger, S. Mertes, T. Klimach, Y. F. Cheng, H. Su, J. Schneider, M. O. Andreae, U. Pöschl, and D. Rose
Atmos. Meas. Tech., 7, 2615–2629, https://doi.org/10.5194/amt-7-2615-2014, https://doi.org/10.5194/amt-7-2615-2014, 2014
M. I. A. Berghof, G. P. Frank, S. Sjogren, and B. G. Martinsson
Atmos. Meas. Tech., 7, 877–886, https://doi.org/10.5194/amt-7-877-2014, https://doi.org/10.5194/amt-7-877-2014, 2014
A. Schwarzenboeck, G. Mioche, A. Armetta, A. Herber, and J.-F. Gayet
Atmos. Meas. Tech., 2, 779–788, https://doi.org/10.5194/amt-2-779-2009, https://doi.org/10.5194/amt-2-779-2009, 2009
Cited articles
Agrawal, S., Barrington, L., Bromberg, C., Burge, J., Gazen, C., and Hickey, J.: Machine learning for precipitation nowcasting from radar images, arXiv [preprint], https://doi.org/10.48550/arXiv.1912.12132, 11 December 2019. a
Albrecht, B., Ghate, V., Mohrmann, J., Wood, R., Zuidema, P., Bretherton, C., Schwartz, C., Eloranta, E., Glienke, S., Donaher, S., Sarkar, M., McGibbon, J., Nugent, A. D., Shaw, R. A., Fugal, J., Minnis, P., Paliknoda, R., Lussier, L., Jensen, J., Vivekanandan, J., Ellis, S., Tsai, P., Rilling, R., Haggerty, J., Campos, T., Stell, M., Reeves, M., Beaton, S., Allison, J., Stossmeister, G., Hall, S., and Schmidt, S.: Cloud System Evolution in the Trades (CSET): Following the evolution of boundary layer cloud systems with the NSF–NCAR GV, B. Am. Meteorol. Soc., 100, 93–121, 2019. a
Berman, M., Triki, A. R., and Blaschko, M. B.: The lovász-softmax loss: A
tractable surrogate for the optimization of the intersection-over-union
measure in neural networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 18–22 June 2018, Salt Lake City, Utah, USA, 4413–4421, https://doi.org/10.1109/CVPR.2018.00464, 2018. a
Bernauer, F., Hürkamp, K., Rühm, W., and Tschiersch, J.: Snow event
classification with a 2D video disdrometer – A decision tree approach,
Atmos. Res., 172, 186–195, 2016. a
Chaurasia, A. and Culurciello, E.: Linknet: Exploiting encoder representations for efficient semantic segmentation, Proceedings of the IEEE Visual Communications and Image Processing (VCIP), 10–13 December 2017, St. Petersburg, FL, USA, IEEE, 1–4, https://doi.org/10.1109/VCIP.2017.8305148, 2017. a
Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H.: Rethinking atrous convolution for semantic image segmentation, arXiv [preprint], https://doi.org/10.48550/arXiv.1706.05587, 17 June 2017. a, b
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H.:
Encoder-decoder with atrous separable convolution for semantic image
segmentation, Proceedings of the European conference on computer vision
(ECCV), 8–14 September 2018, Munich, Germany, 833–851, https://doi.org/10.1007/978-3-030-01234-2_49, 2018. a, b
Chen, Y., Li, J., Xiao, H., Jin, X., Yan, S., and Feng, J.: Dual path networks, Proceedings of the 31st International Conference on Neural Information Processing Systems, 4–9 December 2017, Long Beach, CA, USA, Adv. Neur. In., 30, 4470–4478, https://dl.acm.org/doi/10.5555/3294996.3295200 (last access: 11 October 2022), 2017. a
Chollet, F.: Xception: Deep learning with depthwise separable convolutions, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21–26 July 2017, Honolulu, Hawaii, USA, 1800–1807, https://doi.org/10.1109/CVPR.2017.195, 2017. a
Computational and Information Systems Laboratory (CISL): Cheyenne: HPE/SGI
ICE XA System (NCAR Community Computing), Tech. rep., National Center for
Atmospheric Research, https://doi.org/10.5065/D6RX99HX, 2020. a
Desai, N., Liu, Y., Glienke, S., Shaw, R. A., Lu, C., Wang, J., and Gao, S.:
Vertical Variation of Turbulent Entrainment Mixing Processes in Marine
Stratocumulus Clouds Using High-Resolution Digital Holography, J.
Geophys. Res.-Atmos., 126, e2020JD033527, https://doi.org/10.1029/2020JD033527, 2021. a
Fugal, J. P., Shaw, R. A., Saw, E. W., and Sergeyev, A. V.: Airborne digital
holographic system for cloud particle measurements, Appl. Optics, 43,
5987–5995, 2004. a
Fugal, J. P., Schulz, T. J., and Shaw, R. A.: Practical methods for automated
reconstruction and characterization of particles in digital in-line
holograms, Meas. Sci. Technol., 20, 075501, https://doi.org/10.1088/0957-0233/20/7/075501, 2009. a, b, c
Glienke, S., Kostinski, A., Fugal, J., Shaw, R., Borrmann, S., and Stith, J.: Cloud droplets to drizzle: Contribution of transition drops to microphysical
and optical properties of marine stratocumulus clouds, Geophys. Res.
Lett., 44, 8002–8010, 2017. a
Glienke, S., Kostinski, A. B., Shaw, R. A., Larsen, M. L., Fugal, J. P., Schlenczek, O., and Borrmann, S.: Holographic observations of centimeter-scale nonuniformities within marine stratocumulus clouds, J. Atmos. Sci., 77, 499–512, 2020. a
Grazioli, J., Tuia, D., Monhart, S., Schneebeli, M., Raupach, T., and Berne, A.: Hydrometeor classification from two-dimensional video disdrometer data, Atmos. Meas. Tech., 7, 2869–2882, https://doi.org/10.5194/amt-7-2869-2014, 2014. a
He, K., Zhang, X., Ren, S., and Sun, J.: Deep residual learning for image
recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27 June–1 July 2016, Las Vegas, Nevada, USA, 770–778, https://doi.org/10.1109/CVPR.2016.90, 2016a. a
He, K., Zhang, X., Ren, S., and Sun, J.: Deep Residual Learning for Image
Recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern
Recognition (CVPR), 27 June–1 July 2016, Las Vegas, Nevada, USA, 770–778, https://doi.org/10.1109/CVPR.2016.90, 2016b. a
He, K., Gkioxari, G., Dollár, P., and Girshick, R.: Mask r-cnn,
Proceedings of the IEEE International Conference on Computer Vision (ICCV), 22–29 October 2017, Venice, Italy, 2961–2969, https://doi.org/10.1109/ICCV.2017.322, 2017. a
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T.,
Andreetto, M., and Adam, H.: Mobilenets: Efficient convolutional neural
networks for mobile vision applications, arXiv [preprint], https://doi.org/10.48550/arXiv.1704.04861, 17 April 2017. a
Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K. Q.: Densely
connected convolutional networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21–26 June 2017, Honolulu, Hawaii, USA, 4700–4708, https://doi.org/10.1109/CVPR.2017.243, 2017. a
Li, H., Xiong, P., An, J., and Wang, L.: Pyramid attention network for semantic segmentation, arXiv [preprint], https://doi.org/10.48550/arXiv.1805.10180, 25 May 2018. a, b, c
Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S.: Feature Pyramid Networks for Object Detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21–26 July 2017, Honolulu, Hawaii, USA, 936–944, https://doi.org/10.1109/CVPR.2017.106, 2017a. a
Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P.: Focal loss for dense object detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 22–29 October 2017, Venice, Italy, 2999–3007, https://doi.org/10.1109/ICCV.2017.324, 2017b. a
Ravuri, S., Lenc, K., Willson, M., Kangin, D., Lam, R., Mirowski, P., Fitzsimons, M., Athanassiadou, M., Kashem, S., Madge, S., and Prudden, R.: Skillful Precipitation Nowcasting using Deep Generative Models of Radar, Nature, 597, 672–677, https://doi.org/10.1038/s41586-021-03854-z, 2021. a
Redmon, J., Divvala, S., Girshick, R., and Farhadi, A.: You only look once:
Unified, real-time object detection, Proceedings of the IEEE conference
on computer vision and pattern recognition, 26 June–1 July 2016, Las Vegas, Nevada, USA, 779–788, https://doi.org/10.1109/CVPR.2016.91, 2016. a
Ren, S., He, K., Girshick, R., and Sun, J.: Faster r-cnn: Towards real-time
object detection with region proposal networks, Adv. Neur. In., 28, 91–99, 2015. a
Ronneberger, O., Fischer, P., and Brox, T.: U-net: Convolutional networks for biomedical image segmentation, International Conference on Medical image
computing and computer-assisted intervention, 5–9 October 2015, Munich, Germany, Springer, 234–241, https://doi.org/10.1007/978-3-319-24574-4_28, 2015. a, b, c
Rumelhart, D. E., Hinton, G. E., and Williams, R. J.: Learning representations by back-propagating errors, Nature, 323, 533–536, 1986. a
Salehi, S. S. M., Erdogmus, D., and Gholipour, A.: Tversky loss function for image segmentation using 3D fully convolutional deep networks, International workshop on machine learning in medical imaging, 10 September 2017, Quebec City, Quebec, Canada, Springer, 379–387, https://doi.org/10.1007/978-3-319-67389-9_44, 2017. a
Schreck, J. S. and Gagne, D. J.: Earth Computing Hyperparameter Optimization, GitHub [code], https://github.com/NCAR/echo-opt (last access: 11 October 2022), 2021. a
Schreck, J. S., Gantos, G., Hayman, M., Bensemer, A., and Gagne, D. J.: Data sets used in “Neural network processing of holographic images”, Zenodo [data set], https://doi.org/10.5281/zenodo.6347222, 2022a. a, b
Schreck, J. S., Hayman, M., Gantos, G., Bansemer, A., and Gagne, D. J.: NCAR/holodec-ml: v0.1 (v0.1), Zenodo [code], https://doi.org/10.5281/zenodo.7186527, 2022b. a
Sha, Y., Gagne II, D. J., West, G., and Stull, R.: Deep-learning-based gridded downscaling of surface meteorological variables in complex terrain. Part I: Daily maximum and minimum 2-m temperature, J. Appl. Meteorol.
Clim., 59, 2057–2073, 2020. a
Shao, S., Mallery, K., Kumar, S. S., and Hong, J.: Machine learning holography for 3D particle field imaging, Opt. Express, 28, 2987–2999,
https://doi.org/10.1364/OE.379480, 2020. a, b, c, d
Shaw, R.: Holographic Detector for Clouds (HOLODEC) particle-by-particle data, Version 1.0. UCAR/NCAR – Earth Observing Laboratory,
https://doi.org/10.26023/EVRR-1K5Q-350V, 2021. a
Shelhamer, E., Long, J., and Darrell, T.: Fully Convolutional Networks for Semantic Segmentation, IEEE T. Pattern Anal., 39, 640–651, https://doi.org/10.1109/TPAMI.2016.2572683, 2017. a
Shimobaba, T., Takahashi, T., Yamamoto, Y., Endo, Y., Shiraki, A., Nishitsuji, T., Hoshikawa, N., Kakue, T., and Ito, T.: Digital holographic particle volume reconstruction using a deep neural network, Appl. Optics, 58,
1900–1906, https://doi.org/10.1364/AO.58.001900, 2019. a, b
Simonyan, K. and Zisserman, A.: Very deep convolutional networks for large-scale image recognition, arXiv [preprint], https://doi.org/10.48550/arXiv.1409.1556, 4 September 2014. a
Spuler, S. M. and Fugal, J.: Design of an in-line, digital holographic imaging system for airborne measurement of clouds, Appl. Optics, 50, 1405–1412, 2011. a
Tan, M. and Le, Q.: Efficientnet: Rethinking model scaling for convolutional
neural networks, International conference on machine learning, 9–15 June 2019, Long Beach, CA, USA, PMLR,
6105–6114, http://proceedings.mlr.press/v97/tan19a.html (last access: 11 October 2022), 2019. a
Touloupas, G., Lauber, A., Henneberger, J., Beck, A., and Lucchi, A.: A convolutional neural network for classifying cloud particles recorded by imaging probes, Atmos. Meas. Tech., 13, 2219–2239, https://doi.org/10.5194/amt-13-2219-2020, 2020. a, b
Wilks, D. S.: Statistical Methods in the Atmospheric Sciences, 3rd edn.,
Academic Press, ISBN 0123850223, 2011. a
Xie, W., Liu, D., Yang, M., Chen, S., Wang, B., Wang, Z., Xia, Y., Liu, Y., Wang, Y., and Zhang, C.: SegCloud: a novel cloud image segmentation model using a deep convolutional neural network for ground-based all-sky-view camera observation, Atmos. Meas. Tech., 13, 1953–1961, https://doi.org/10.5194/amt-13-1953-2020, 2020. a
Yan, W., Zhang, Y., Abbeel, P., and Srinivas, A.: VideoGPT: Video Generation using VQ-VAE and Transformers, arXiv [preprint], https://doi.org/10.48550/arXiv.2104.10157, 20 April 2021. a
Yuan, K., Meng, G., Cheng, D., Bai, J., Xiang, S., and Pan, C.: Efficient cloud detection in remote sensing images using edge-aware segmentation network and easy-to-hard training strategy, Proceedings of the IEEE International Conference on Image Processing (ICIP), 17–20 September 2017, Beijing, China, IEEE, 61–65, https://doi.org/10.1109/ICIP.2017.8296243, 2017. a
Zhang, J., Liu, P., Zhang, F., and Song, Q.: CloudNet: Ground-based cloud classification with deep convolutional neural network, Geophys. Res. Lett., 45, 8665–8672, 2018. a
Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J.: Pyramid scene parsing
network, Proceedings of the IEEE conference on computer vision and
pattern recognition, 21–26 June 2017, Honolulu, Hawaii, USA, 6230–6239, https://doi.org/10.1109/CVPR.2017.660, 2017.
a, b
Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., and Liang, J.: Unet++: A nested u-net architecture for medical image segmentation, Deep learning in medical image analysis and multimodal learning for clinical decision support, Springer, 3–11, https://doi.org/10.1007/978-3-030-00889-5_1, 2018. a, b
Short summary
We show promising results for a new machine-learning based paradigm for processing field-acquired cloud droplet holograms. The approach is fast, scalable, and leverages GPUs and other heterogeneous computing platforms. It combines applications of transfer and active learning by using synthetic data for training and a small set of hand-labeled data for refinement and validation. Artificial noise applied during synthetic training enables optimized models for real-world situations.
We show promising results for a new machine-learning based paradigm for processing...
