Articles | Volume 7, issue 12
Research article
11 Dec 2014
Research article |  | 11 Dec 2014

Regression models tolerant to massively missing data: a case study in solar-radiation nowcasting

I. Žliobaitė, J. Hollmén, and H. Junninen

Related authors

Bisulfate – cluster based atmospheric pressure chemical ionization mass spectrometer for high-sensitivity (< 100 ppqV) detection of atmospheric dimethyl amine: proof-of-concept and first ambient data from boreal forest
M. Sipilä, N. Sarnela, T. Jokinen, H. Junninen, J. Hakala, M. P. Rissanen, A. Praplan, M. Simon, A. Kürten, F. Bianchi, J. Dommen, J. Curtius, T. Petäjä, and D. R. Worsnop
Atmos. Meas. Tech., 8, 4001–4011,,, 2015
Short summary
Thermodynamics of the formation of sulfuric acid dimers in the binary (H2SO4–H2O) and ternary (H2SO4–H2O–NH3) system
A. Kürten, S. Münch, L. Rondo, F. Bianchi, J. Duplissy, T. Jokinen, H. Junninen, N. Sarnela, S. Schobesberger, M. Simon, M. Sipilä, J. Almeida, A. Amorim, J. Dommen, N. M. Donahue, E. M. Dunne, R. C. Flagan, A. Franchin, J. Kirkby, A. Kupc, V. Makhmutov, T. Petäjä, A. P. Praplan, F. Riccobono, G. Steiner, A. Tomé, G. Tsagkogeorgas, P. E. Wagner, D. Wimmer, U. Baltensperger, M. Kulmala, D. R. Worsnop, and J. Curtius
Atmos. Chem. Phys., 15, 10701–10721,,, 2015
Short summary
The charging of neutral dimethylamine and dimethylamine–sulfuric acid clusters using protonated acetone
K. Ruusuvuori, P. Hietala, O. Kupiainen-Määttä, T. Jokinen, H. Junninen, M. Sipilä, T. Kurtén, and H. Vehkamäki
Atmos. Meas. Tech., 8, 2577–2588,,, 2015
Short summary
Elemental composition and clustering behaviour of α-pinene oxidation products for different oxidation conditions
A. P. Praplan, S. Schobesberger, F. Bianchi, M. P. Rissanen, M. Ehn, T. Jokinen, H. Junninen, A. Adamov, A. Amorim, J. Dommen, J. Duplissy, J. Hakala, A. Hansel, M. Heinritzi, J. Kangasluoma, J. Kirkby, M. Krapf, A. Kürten, K. Lehtipalo, F. Riccobono, L. Rondo, N. Sarnela, M. Simon, A. Tomé, J. Tröstl, P. M. Winkler, C. Williamson, P. Ye, J. Curtius, U. Baltensperger, N. M. Donahue, M. Kulmala, and D. R. Worsnop
Atmos. Chem. Phys., 15, 4145–4159,,, 2015
Short summary
Major contribution of neutral clusters to new particle formation at the interface between the boundary layer and the free troposphere
C. Rose, K. Sellegri, E. Asmi, M. Hervo, E. Freney, A. Colomb, H. Junninen, J. Duplissy, M. Sipilä, J. Kontkanen, K. Lehtipalo, and M. Kulmala
Atmos. Chem. Phys., 15, 3413–3428,,, 2015

Related subject area

Subject: Others (Wind, Precipitation, Temperature, etc.) | Technique: Remote Sensing | Topic: Data Processing and Information Retrieval
Analysis of 2D airglow imager data with respect to dynamics using machine learning
René Sedlak, Andreas Welscher, Patrick Hannawald, Sabine Wüst, Rainer Lienhart, and Michael Bittner
Atmos. Meas. Tech., 16, 3141–3153,,, 2023
Short summary
Estimation of extreme precipitation events in Estonia and Italy using dual-polarization weather radar quantitative precipitation estimations
Roberto Cremonini, Tanel Voormansik, Piia Post, and Dmitri Moisseev
Atmos. Meas. Tech., 16, 2943–2956,,, 2023
Short summary
Detection and localization of F-layer ionospheric irregularities with the back-propagation method along the radio occultation ray path
Vinícius Ludwig-Barbosa, Joel Rasch, Thomas Sievert, Anders Carlström, Mats I. Pettersson, Viet Thuy Vu, and Jacob Christensen
Atmos. Meas. Tech., 16, 1849–1864,,, 2023
Short summary
Observations of anomalous propagation over waters near Sweden
Lars Norin
Atmos. Meas. Tech., 16, 1789–1801,,, 2023
Short summary
Validation of Aeolus wind profiles using ground-based lidar and radiosonde observations at Réunion island and the Observatoire de Haute-Provence
Mathieu Ratynski, Sergey Khaykin, Alain Hauchecorne, Robin Wing, Jean-Pierre Cammas, Yann Hello, and Philippe Keckhut
Atmos. Meas. Tech., 16, 997–1016,,, 2023
Short summary

Cited articles

Aggarwal, Ch. (Ed.): Data Streams – Models and Algorithms, Springer, 2007.
Allison, P.: Missing Data, Sage Publications, 2001.
Babcock, B., Babu, S., Datar, M., Motwani, R., and Widom, J.: Models and Issues in Data Stream Systems, in: Proc. of the 21st ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS, 1–16, 2002.
Bacher, P., Madsen, H., and Nielsen, H. A.: Online short-term solar power forecasting, Sol. Energy, 83, 1772–1783, 2009.
Bhardwaj, S., Sharma, V., Srivastava, S., Sastry, O., Bandyopadhyay, B., Chandel, S., and Gupta, J.: Estimation of solar radiation using a combination of Hidden Markov model and generalized Fuzzy model, Sol. Energy, 93, 43–54, 2013.
Short summary
We present a case study in solar/radiation nowcasting using environmental sensor measurements as inputs. While some sensor readings may oftentimes be missing, predictions need to be output continuously in near real time. We are after linear regression models that would be robust to missing data, i.e., that would perform well with or without data gaps. We recommend using regularized a PCA regression with our established guidelines for building robust regression models.