Articles | Volume 15, issue 3
https://doi.org/10.5194/amt-15-797-2022
https://doi.org/10.5194/amt-15-797-2022
Research article
 | 
14 Feb 2022
Research article |  | 14 Feb 2022

Applying self-supervised learning for semantic cloud segmentation of all-sky images

Yann Fabel, Bijan Nouri, Stefan Wilbert, Niklas Blum, Rudolph Triebel, Marcel Hasenbalg, Pascal Kuhn, Luis F. Zarzalejo, and Robert Pitz-Paal

Related authors

Cloud height measurement by a network of all-sky imagers
Niklas Benedikt Blum, Bijan Nouri, Stefan Wilbert, Thomas Schmidt, Ontje Lünsdorf, Jonas Stührenberg, Detlev Heinemann, Andreas Kazantzidis, and Robert Pitz-Paal
Atmos. Meas. Tech., 14, 5199–5224, https://doi.org/10.5194/amt-14-5199-2021,https://doi.org/10.5194/amt-14-5199-2021, 2021
Short summary
Applications of a shadow camera system for energy meteorology
Pascal Kuhn, Stefan Wilbert, Christoph Prahl, Dominik Garsche, David Schüler, Thomas Haase, Lourdes Ramirez, Luis Zarzalejo, Angela Meyer, Philippe Blanc, and Robert Pitz-Paal
Adv. Sci. Res., 15, 11–14, https://doi.org/10.5194/asr-15-11-2018,https://doi.org/10.5194/asr-15-11-2018, 2018
Short summary
Calibration methods for rotating shadowband irradiometers and optimizing the calibration duration
Wilko Jessen, Stefan Wilbert, Bijan Nouri, Norbert Geuder, and Holger Fritz
Atmos. Meas. Tech., 9, 1601–1612, https://doi.org/10.5194/amt-9-1601-2016,https://doi.org/10.5194/amt-9-1601-2016, 2016
Short summary
Atmospheric extinction in solar tower plants: absorption and broadband correction for MOR measurements
N. Hanrieder, S. Wilbert, R. Pitz-Paal, C. Emde, J. Gasteiger, B. Mayer, and J. Polo
Atmos. Meas. Tech., 8, 3467–3480, https://doi.org/10.5194/amt-8-3467-2015,https://doi.org/10.5194/amt-8-3467-2015, 2015
Determination of circumsolar radiation from Meteosat Second Generation
B. Reinhardt, R. Buras, L. Bugliaro, S. Wilbert, and B. Mayer
Atmos. Meas. Tech., 7, 823–838, https://doi.org/10.5194/amt-7-823-2014,https://doi.org/10.5194/amt-7-823-2014, 2014

Related subject area

Subject: Clouds | Technique: Remote Sensing | Topic: Data Processing and Information Retrieval
High-spatial-resolution retrieval of cloud droplet size distribution from polarized observations of the cloudbow
Veronika Pörtge, Tobias Kölling, Anna Weber, Lea Volkmer, Claudia Emde, Tobias Zinner, Linda Forster, and Bernhard Mayer
Atmos. Meas. Tech., 16, 645–667, https://doi.org/10.5194/amt-16-645-2023,https://doi.org/10.5194/amt-16-645-2023, 2023
Short summary
Evaluation of the spectral misalignment on the Earth Clouds, Aerosols and Radiation Explorer/multi-spectral imager cloud product
Minrui Wang, Takashi Y. Nakajima, Woosub Roh, Masaki Satoh, Kentaroh Suzuki, Takuji Kubota, and Mayumi Yoshida
Atmos. Meas. Tech., 16, 603–623, https://doi.org/10.5194/amt-16-603-2023,https://doi.org/10.5194/amt-16-603-2023, 2023
Short summary
Retrieval of terahertz ice cloud properties from airborne measurements based on the irregularly shaped Voronoi ice scattering models
Ming Li, Husi Letu, Hiroshi Ishimoto, Shulei Li, Lei Liu, Takashi Y. Nakajima, Dabin Ji, Huazhe Shang, and Chong Shi
Atmos. Meas. Tech., 16, 331–353, https://doi.org/10.5194/amt-16-331-2023,https://doi.org/10.5194/amt-16-331-2023, 2023
Short summary
Latent heating profiles from GOES-16 and its impacts on precipitation forecasts
Yoonjin Lee, Christian D. Kummerow, and Milija Zupanski
Atmos. Meas. Tech., 15, 7119–7136, https://doi.org/10.5194/amt-15-7119-2022,https://doi.org/10.5194/amt-15-7119-2022, 2022
Short summary
A CO2-independent cloud mask from Infrared Atmospheric Sounding Interferometer (IASI) radiances for climate applications
Simon Whitburn, Lieven Clarisse, Marc Crapeau, Thomas August, Tim Hultberg, Pierre François Coheur, and Cathy Clerbaux
Atmos. Meas. Tech., 15, 6653–6668, https://doi.org/10.5194/amt-15-6653-2022,https://doi.org/10.5194/amt-15-6653-2022, 2022
Short summary

Cited articles

Aitken, A., Ledig, C., Theis, L., Caballero, J., Wang, Z., and Shi, W.: Checkerboard artifact free sub-pixel convolution: A note on sub-pixel convolution, resize convolution and convolution resize, arXiv [preprint], arXiv:1707.02937, 2017. a
Blanc, P., Massip, P., Kazantzidis, A., Tzoumanikas, P., Kuhn, P., Wilbert, S., Schüler, D., and Prahl, C.: Short-term forecasting of high resolution local DNI maps with multiple fish-eye cameras in stereoscopic mode, AIP Conference Proceedings, 1850, 140004, https://doi.org/10.1063/1.4984512, 2017. a
Calbó, J., Long, C. N., González, J.-A., Augustine, J., and McComiskey, A.: The thin border between cloud and aerosol: Sensitivity of several ground based observation techniques, Atmos. Res., 196, 248–260, https://doi.org/10.1016/j.atmosres.2017.06.010, 2017. a
Caron, M., Bojanowski, P., Joulin, A., and Douze, M.: Deep clustering for unsupervised learning of visual features, in: Proceedings of the European Conference on Computer Vision (ECCV), pp. 132–149, https://doi.org/10.1007/978-3-030-01264-9_9, 2018. a, b, c, d
Chauvin, R., Nou, J., Thil, S., Traore, A., and Grieu, S.: Cloud detection methodology based on a sky-imaging system, Energy Proced., 69, 1970–1980, https://doi.org/10.1016/j.egypro.2015.03.198, 2015. a
Download
Short summary
This work presents a new approach to exploit unlabeled image data from ground-based sky observations to train neural networks. We show that our model can detect cloud classes within images more accurately than models trained with conventional methods using small, labeled datasets only. Novel machine learning techniques as applied in this work enable training with much larger datasets, leading to improved accuracy in cloud detection and less need for manual image labeling.