Articles | Volume 7, issue 12
Atmos. Meas. Tech., 7, 4387–4399, 2014
https://doi.org/10.5194/amt-7-4387-2014
Atmos. Meas. Tech., 7, 4387–4399, 2014
https://doi.org/10.5194/amt-7-4387-2014

Research article 11 Dec 2014

Research article | 11 Dec 2014

Regression models tolerant to massively missing data: a case study in solar-radiation nowcasting

I. Žliobaitė et al.

Related authors

Bisulfate – cluster based atmospheric pressure chemical ionization mass spectrometer for high-sensitivity (< 100 ppqV) detection of atmospheric dimethyl amine: proof-of-concept and first ambient data from boreal forest
M. Sipilä, N. Sarnela, T. Jokinen, H. Junninen, J. Hakala, M. P. Rissanen, A. Praplan, M. Simon, A. Kürten, F. Bianchi, J. Dommen, J. Curtius, T. Petäjä, and D. R. Worsnop
Atmos. Meas. Tech., 8, 4001–4011, https://doi.org/10.5194/amt-8-4001-2015,https://doi.org/10.5194/amt-8-4001-2015, 2015
Short summary
Thermodynamics of the formation of sulfuric acid dimers in the binary (H2SO4–H2O) and ternary (H2SO4–H2O–NH3) system
A. Kürten, S. Münch, L. Rondo, F. Bianchi, J. Duplissy, T. Jokinen, H. Junninen, N. Sarnela, S. Schobesberger, M. Simon, M. Sipilä, J. Almeida, A. Amorim, J. Dommen, N. M. Donahue, E. M. Dunne, R. C. Flagan, A. Franchin, J. Kirkby, A. Kupc, V. Makhmutov, T. Petäjä, A. P. Praplan, F. Riccobono, G. Steiner, A. Tomé, G. Tsagkogeorgas, P. E. Wagner, D. Wimmer, U. Baltensperger, M. Kulmala, D. R. Worsnop, and J. Curtius
Atmos. Chem. Phys., 15, 10701–10721, https://doi.org/10.5194/acp-15-10701-2015,https://doi.org/10.5194/acp-15-10701-2015, 2015
Short summary
The charging of neutral dimethylamine and dimethylamine–sulfuric acid clusters using protonated acetone
K. Ruusuvuori, P. Hietala, O. Kupiainen-Määttä, T. Jokinen, H. Junninen, M. Sipilä, T. Kurtén, and H. Vehkamäki
Atmos. Meas. Tech., 8, 2577–2588, https://doi.org/10.5194/amt-8-2577-2015,https://doi.org/10.5194/amt-8-2577-2015, 2015
Short summary
Elemental composition and clustering behaviour of α-pinene oxidation products for different oxidation conditions
A. P. Praplan, S. Schobesberger, F. Bianchi, M. P. Rissanen, M. Ehn, T. Jokinen, H. Junninen, A. Adamov, A. Amorim, J. Dommen, J. Duplissy, J. Hakala, A. Hansel, M. Heinritzi, J. Kangasluoma, J. Kirkby, M. Krapf, A. Kürten, K. Lehtipalo, F. Riccobono, L. Rondo, N. Sarnela, M. Simon, A. Tomé, J. Tröstl, P. M. Winkler, C. Williamson, P. Ye, J. Curtius, U. Baltensperger, N. M. Donahue, M. Kulmala, and D. R. Worsnop
Atmos. Chem. Phys., 15, 4145–4159, https://doi.org/10.5194/acp-15-4145-2015,https://doi.org/10.5194/acp-15-4145-2015, 2015
Short summary
Major contribution of neutral clusters to new particle formation at the interface between the boundary layer and the free troposphere
C. Rose, K. Sellegri, E. Asmi, M. Hervo, E. Freney, A. Colomb, H. Junninen, J. Duplissy, M. Sipilä, J. Kontkanen, K. Lehtipalo, and M. Kulmala
Atmos. Chem. Phys., 15, 3413–3428, https://doi.org/10.5194/acp-15-3413-2015,https://doi.org/10.5194/acp-15-3413-2015, 2015

Related subject area

Subject: Others (Wind, Precipitation, Temperature, etc.) | Technique: Remote Sensing | Topic: Data Processing and Information Retrieval
Cloud-probability-based estimation of black-sky surface albedo from AVHRR data
Terhikki Manninen, Emmihenna Jääskeläinen, Niilo Siljamo, Aku Riihelä, and Karl-Göran Karlsson
Atmos. Meas. Tech., 15, 879–893, https://doi.org/10.5194/amt-15-879-2022,https://doi.org/10.5194/amt-15-879-2022, 2022
Short summary
A high-resolution monitoring approach of canopy urban heat island using a random forest model and multi-platform observations
Shihan Chen, Yuanjian Yang, Fei Deng, Yanhao Zhang, Duanyang Liu, Chao Liu, and Zhiqiu Gao
Atmos. Meas. Tech., 15, 735–756, https://doi.org/10.5194/amt-15-735-2022,https://doi.org/10.5194/amt-15-735-2022, 2022
Short summary
Differential absorption lidar measurements of water vapor by the High Altitude Lidar Observatory (HALO): retrieval framework and first results
Brian J. Carroll, Amin R. Nehrir, Susan A. Kooi, James E. Collins, Rory A. Barton-Grimley, Anthony Notari, David B. Harper, and Joseph Lee
Atmos. Meas. Tech., 15, 605–626, https://doi.org/10.5194/amt-15-605-2022,https://doi.org/10.5194/amt-15-605-2022, 2022
Short summary
Improving thermodynamic profile retrievals from microwave radiometers by including radio acoustic sounding system (RASS) observations
Irina V. Djalalova, David D. Turner, Laura Bianco, James M. Wilczak, James Duncan, Bianca Adler, and Daniel Gottas
Atmos. Meas. Tech., 15, 521–537, https://doi.org/10.5194/amt-15-521-2022,https://doi.org/10.5194/amt-15-521-2022, 2022
Short summary
Calibration of radar differential reflectivity using quasi-vertical profiles
Daniel Sanchez-Rivas and Miguel A. Rico-Ramirez
Atmos. Meas. Tech., 15, 503–520, https://doi.org/10.5194/amt-15-503-2022,https://doi.org/10.5194/amt-15-503-2022, 2022
Short summary

Cited articles

Aggarwal, Ch. (Ed.): Data Streams – Models and Algorithms, Springer, 2007.
Allison, P.: Missing Data, Sage Publications, 2001.
Babcock, B., Babu, S., Datar, M., Motwani, R., and Widom, J.: Models and Issues in Data Stream Systems, in: Proc. of the 21st ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS, 1–16, 2002.
Bacher, P., Madsen, H., and Nielsen, H. A.: Online short-term solar power forecasting, Sol. Energy, 83, 1772–1783, 2009.
Bhardwaj, S., Sharma, V., Srivastava, S., Sastry, O., Bandyopadhyay, B., Chandel, S., and Gupta, J.: Estimation of solar radiation using a combination of Hidden Markov model and generalized Fuzzy model, Sol. Energy, 93, 43–54, 2013.
Download
Short summary
We present a case study in solar/radiation nowcasting using environmental sensor measurements as inputs. While some sensor readings may oftentimes be missing, predictions need to be output continuously in near real time. We are after linear regression models that would be robust to missing data, i.e., that would perform well with or without data gaps. We recommend using regularized a PCA regression with our established guidelines for building robust regression models.