Articles | Volume 16, issue 5
https://doi.org/10.5194/amt-16-1195-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-16-1195-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
08 Mar 2023
Research article |
| 08 Mar 2023
| 08 Mar 2023
Optimizing cloud motion estimation on the edge with phase correlation and optical flow
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Paytsar Muradyan
Argonne National Laboratory, Lemont, Illinois, USA
Rajesh Sankaran
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Robert C. Jackson
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Seongha Park
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Sean A. Shahkarami
Argonne National Laboratory, Lemont, Illinois, USA
Consortium for Advanced Science and Engineering, University of Chicago, Chicago, Illinois, USA
Dario Dematties
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Yongho Kim
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Joseph Swantek
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Neal Conrad
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Wolfgang Gerlach
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Sergey Shemyakin
Argonne National Laboratory, Lemont, Illinois, USA
Consortium for Advanced Science and Engineering, University of Chicago, Chicago, Illinois, USA
Pete Beckman
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Nicola J. Ferrier
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Scott M. Collis
Northwestern-Argonne Institute of Science and Engineering, Northwestern University, Evanston, Illinois, USA
Argonne National Laboratory, Lemont, Illinois, USA
Related authors
Bhupendra Raut, Aditi Deshpande, Devyani Kamble, Sandip Ingle, Parmeshwar Naik, Shwetal Walde, P. Pradeep Kumar, and Purnendranath Sen
EGUsphere, https://doi.org/10.5194/egusphere-2025-4585, https://doi.org/10.5194/egusphere-2025-4585, 2025
This preprint is open for discussion and under review for Weather and Climate Dynamics (WCD).
Short summary
Short summary
We demonstrated unsupervised clustering methodology and post-clustering analysis framework by analysing daily Indian summer monsoon rainfall to uncover recurring weather patterns and their transitions. We show breaks are prolonged, rain-bearing systems are transient, and decomposed the frequency and intensity effects in long term rainfall changes.
Bhupendra Raut, Aditi Deshpande, Devyani Kamble, Sandip Ingle, Parmeshwar Naik, Shwetal Walde, P. Pradeep Kumar, and Purnendranath Sen
EGUsphere, https://doi.org/10.5194/egusphere-2025-4585, https://doi.org/10.5194/egusphere-2025-4585, 2025
This preprint is open for discussion and under review for Weather and Climate Dynamics (WCD).
Short summary
Short summary
We demonstrated unsupervised clustering methodology and post-clustering analysis framework by analysing daily Indian summer monsoon rainfall to uncover recurring weather patterns and their transitions. We show breaks are prolonged, rain-bearing systems are transient, and decomposed the frequency and intensity effects in long term rainfall changes.
G. Alexander Sokolowsky, Sean W. Freeman, William K. Jones, Julia Kukulies, Fabian Senf, Peter J. Marinescu, Max Heikenfeld, Kelcy N. Brunner, Eric C. Bruning, Scott M. Collis, Robert C. Jackson, Gabrielle R. Leung, Nils Pfeifer, Bhupendra A. Raut, Stephen M. Saleeby, Philip Stier, and Susan C. van den Heever
Geosci. Model Dev., 17, 5309–5330, https://doi.org/10.5194/gmd-17-5309-2024, https://doi.org/10.5194/gmd-17-5309-2024, 2024
Short summary
Short summary
Building on previous analysis tools developed for atmospheric science, the original release of the Tracking and Object-Based Analysis (tobac) Python package, v1.2, was open-source, modular, and insensitive to the type of gridded input data. Here, we present the latest version of tobac, v1.5, which substantially improves scientific capabilities and computational efficiency from the previous version. These enhancements permit new uses for tobac in atmospheric science and potentially other fields.
Christopher R. Williams, Joshua Barrio, Paul E. Johnston, Paytsar Muradyan, and Scott E. Giangrande
Atmos. Meas. Tech., 16, 2381–2398, https://doi.org/10.5194/amt-16-2381-2023, https://doi.org/10.5194/amt-16-2381-2023, 2023
Short summary
Short summary
This study uses surface disdrometer observations to calibrate 8 years of 915 MHz radar wind profiler deployed in the central United States in northern Oklahoma. This study had two key findings. First, the radar wind profiler sensitivity decreased approximately 3 to 4 dB/year as the hardware aged. Second, this drift was slow enough that calibration can be performed using 3-month intervals. Calibrated radar wind profiler observations and Python processing code are available on public repositories.
William J. Shaw, Larry K. Berg, Mithu Debnath, Georgios Deskos, Caroline Draxl, Virendra P. Ghate, Charlotte B. Hasager, Rao Kotamarthi, Jeffrey D. Mirocha, Paytsar Muradyan, William J. Pringle, David D. Turner, and James M. Wilczak
Wind Energ. Sci., 7, 2307–2334, https://doi.org/10.5194/wes-7-2307-2022, https://doi.org/10.5194/wes-7-2307-2022, 2022
Short summary
Short summary
This paper provides a review of prominent scientific challenges to characterizing the offshore wind resource using as examples phenomena that occur in the rapidly developing wind energy areas off the United States. The paper also describes the current state of modeling and observations in the marine atmospheric boundary layer and provides specific recommendations for filling key current knowledge gaps.
Israel Silber, Robert C. Jackson, Ann M. Fridlind, Andrew S. Ackerman, Scott Collis, Johannes Verlinde, and Jiachen Ding
Geosci. Model Dev., 15, 901–927, https://doi.org/10.5194/gmd-15-901-2022, https://doi.org/10.5194/gmd-15-901-2022, 2022
Short summary
Short summary
The Earth Model Column Collaboratory (EMC2) is an open-source ground-based (and air- or space-borne) lidar and radar simulator and subcolumn generator designed for large-scale models, in particular climate models, applicable also for high-resolution models. EMC2 emulates measurements while remaining faithful to large-scale models' physical assumptions implemented in their cloud or radiation schemes. We demonstrate the use of EMC2 to compare AWARE measurements with the NASA GISS ModelE3 and LES.
Robert Jackson, Scott Collis, Valentin Louf, Alain Protat, Die Wang, Scott Giangrande, Elizabeth J. Thompson, Brenda Dolan, and Scott W. Powell
Atmos. Meas. Tech., 14, 53–69, https://doi.org/10.5194/amt-14-53-2021, https://doi.org/10.5194/amt-14-53-2021, 2021
Short summary
Short summary
About 4 years of 2D video disdrometer data in Darwin are used to develop and validate rainfall retrievals for tropical convection in C- and X-band radars in Darwin. Using blended techniques previously used for Colorado and Manus and Gan islands, with modified coefficients in each estimator, provided the most optimal results. Using multiple radar observables to develop a rainfall retrieval provided a greater advantage than using a single observable, including using specific attenuation.
Cited articles
Apke, J. M., Noh, Y.-J., and Bedka, K.: Comparison of Optical Flow Derivation Techniques for Retrieving Tropospheric Winds from Satellite Image Sequences, J. Atmos. Ocean. Tech., 39, 2005–2021, https://doi.org/10.1175/JTECH-D-22-0057.1, 2022. a
Beckman, P., Sankaran, R., Catlett, C., Ferrier, N., Jacob, R., and Papka, M.: Waggle: An open sensor platform for edge computing, in: 2016 IEEE SENSORS, Orlando, FL, USA, 30 October–3 November 2016, IEEE, 1–3, https://doi.org/10.1109/ICSENS.2016.7808975, 2016. a
Chalasinska-Macukow, K., Turon, F., Yzuel, M., and Campos, J.: Contrast performance of pure phase correlation, J. Optics, 24, 71, https://doi.org/10.1088/0150-536X/24/2/004, 1993.
a
Dematties, D., Raut, B. A., Park, S., Jackson, R. C., Shahkarami, S., Kim, Y., Sankarana, R., Beckmana, P., Collis, S. M., and Ferrier, N.: Let's Unleash the Network Judgement: A Self-supervised Approach for Cloud Image Analysis, Artificial Intelligence for the Earth Systems, in press, 2023. a
Denman, S., Fookes, C., and Sridharan, S.: Improved simultaneous computation of motion detection and optical flow for object tracking, in: 2009 Digital Image Computing: Techniques and Applications, Melbourne, VIC, Australia,
1–3 December 2009, IEEE, 175–182, https://doi.org/10.1109/DICTA.2009.35, 2009. a
Dev, S., Lee, Y. H., and Winkler, S.: Color-based segmentation of sky/cloud images from ground-based cameras, IEEE J. Sel. Top. Appl., 10, 231–242, 2016. a
Dissawa, D., Godaliyadda, G., Ekanayake, M., Ekanayake, J. B., and Agalgaonkar, A. P.: Cross-correlation based cloud motion estimation for short-term solar irradiation predictions, in: 2017 IEEE International Conference on Industrial and Information Systems (ICIIS), Peradeniya, Sri Lanka, 15–16 December 2017, IEEE, 1–6, https://doi.org/10.1109/ICIINFS.2017.8300338, 2017. a, b
Dissawa, L. H., Godaliyadda, R. I., Ekanayake, P. B., Agalgaonkar, A. P., Robinson, D., Ekanayake, J. B., and Perera, S.: Sky Image-Based Localized, Short-Term Solar Irradiance Forecasting for Multiple PV Sites via Cloud Motion Tracking, Int. J. Photoenergy, 2021, 9973010, https://doi.org/10.1155/2021/9973010, 2021. a
El Jaouhari, Z., Zaz, Y., and Masmoudi, L.: Cloud tracking from whole-sky ground-based images, in: 2015 3rd International Renewable and Sustainable Energy Conference (IRSEC), Marrakech, Morocco, 10–13 December 2015, IEEE, 1–5, https://doi.org/10.1109/IRSEC.2015.7455105, 2015. a
Farnebäck, G.: (2003). Two-Frame Motion Estimation Based on Polynomial Expansion, in: Image Analysis. SCIA 2003. Lecture Notes in Computer Science, edited by: Bigun, J. and Gustavsson, T., Springer, Berlin, Heidelberg, 2749, 363–370, https://doi.org/10.1007/3-540-45103-X_50, 2003. a
Flynn, D. and Morris, V.: Total Sky Imager (TSISKYIMAGE), Atmospheric Radiation Measurement (ARM) user facility [data set], https://doi.org/10.5439/1025309, 2023. a
Gacal, G. F. B., Antioquia, C., and Lagrosas, N.: Trends of night-time hourly cloud-cover values over Manila Observatory: ground-based remote-sensing observations using a digital camera for 13 months, Int. J. Remote. Sens., 39, 7628–7642, 2018. a
Heinle, A., Macke, A., and Srivastav, A.: Automatic cloud classification of whole sky images, Atmos. Meas. Tech., 3, 557–567, https://doi.org/10.5194/amt-3-557-2010, 2010. a
Huang, H., Yoo, S., Yu, D., Huang, D., and Qin, H.: Cloud motion detection for short term solar power prediction, in: 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm), Vancouver, BC, Canada, 21–24 October 2013, IEEE, Vancouver, BC, Canada, 21–24 October 2013, https://doi.org/10.1109/SmartGridComm.2013.6688040, 2011. a
Jiang, J., Lv, Q., and Gao, X.: The ultra-short-term forecasting of global horizonal irradiance based on total sky images, Remote Sensing, 12, 3671, https://doi.org/10.3390/rs12213671, 2020. a, b
Mondragón, R., Alonso-Montesinos, J., Riveros-Rosas, D., and Bonifaz, R.: Determination of cloud motion applying the Lucas-Kanade method to sky cam imagery, Remote Sensing, 12, 2643, https://doi.org/10.3390/rs12162643, 2020. a
Morris, V.: Total Sky Imager (TSI): fractional sky coverage, ARM [data set], https://doi.org/10.5439/1025308, 2000. a
Morris, V.: Total Sky Imager (TSI) Handbook, Atmospheric Radiation Measurement Rep. DOE/SC-ARM/TR-017, OSTI.GOV, https://doi.org/10.2172/1020716, 2005. a
Morris, V., Zhang, D., and Ermold, B.: ceil, ARM [data set], https://doi.org/10.5439/1181954, 1996. a, b
Morris, V. R.: Ceilometer Instrument Handbook, Technical Report, DOE/SC-ARM-TR-020, OSTI.GOV, https://doi.org/10.2172/1036530, 2016. a
Muradyan, P. and Coulter, R.: 915-MHz Radar Wind Profiler/RASS (RWP915): wind consensus data, ARM [data set], https://doi.org/10.5439/1025135, 1998. a, b
Muradyan, P. and Coulter, R.: Radar Wind Profiler (RWP) and Radio Acoustic Sounding System (RASS) Instrument Handbook, Technical Report, DOE/SC-ARM/TR-044, OSTI.GOV, https://doi.org/10.2172/1020560, 2020. a, b
Park, S., Kim, Y., Ferrier, N. J., Collis, S. M., Sankaran, R., and Beckman, P. H.: Prediction of Solar Irradiance and Photovoltaic Solar Energy Product Based on Cloud Coverage Estimation Using Machine Learning Methods, Atmosphere, 12, 395, https://doi.org/10.3390/atmos12030395, 2021. a, b
Picel, M., Collis, S., Raut, B., Carani, S., Jackson, R., van Lier-Walqui, M., and Fridlind, A.: 3.4 TINT:TINT Is Not TITAN. Easy-to-Use Tracking Code Based on TITAN–Details and Uses, in: 8th Symposium on Advances in Modeling and Analysis Using Python, Vol. 98 of AMS Annual Meeting, Austin, TX, 7–11 January 2018, American Meteorological Society,
https://ams.confex.com/ams/98Annual/webprogram/Paper335460.html, last access: 8 January 2018. a
Radovan, A., Šunde, V., Kučak, D., and Ban, Ž.: Solar Irradiance Forecast Based on Cloud Movement Prediction, Energies, 14, 3775, https://doi.org/10.3390/en14133775, 2021.
a, b
Raut, B. A., Karekar, R. N., and Puranik, D. M.: Wavelet-based technique to extract convective clouds from infrared satellite images, IEEE Geosci. Remote S., 5, 328–330, 2008. a
Raut, B. A., Jackson, R., Picel, M., Collis, S. M., Bergemann, M., and Jakob, C.: An Adaptive Tracking Algorithm for Convection in Simulated and Remote Sensing Data, J. Appl. Meteorol. Clim., 60, 513–526, https://doi.org/10.1175/jamc-d-20-0119.1, 2021. a, b
Sage UI: https://portal.sagecontinuum.org/, last access: 25 February 2023.
Shahkarami, S., dariodematties, and Raut, B.: RBhupi/plugin-cmv-fftpc: check previouse release for fftpc, Version v1.23.02, Zenodo [code], https://doi.org/10.5281/zenodo.7676068, 2023. a
Steiner, M., Houze Jr., R. A., and Yuter, S. E.: Climatological characterization of three-dimensional storm structure from operational radar and rain gauge data, J. Appl. Meteorol., 34, 1978–2007, 1995. a
Tong, X., Ye, Z., Xu, Y., Gao, S., Xie, H., Du, Q., Liu, S., Xu, X., Liu, S., Luan, K., and Stilla, U.: Image registration with Fourier-based image correlation: A comprehensive review of developments and applications, IEEE J. Sel. Top. Appl., 12, 4062–4081, 2019. a
Turon, F., Chalasinska-Macukow, K., Campos, J., and Yzuel, M. J.: Pure phase correlation applied to multi-object colour scenes, J. Optics-UK, 28, 112, https://doi.org/10.1088/0150-536X/28/3/004, 1997. a
Wang, Y., Wang, C., Shi, C., and Xiao, B.: A selection criterion for the optimal resolution of ground-based remote sensing cloud images for cloud classification, IEEE T. Geosci. Remote, 57, 1358–1367, 2018. a
Wood-Bradley, P., Zapata, J., and Pye, J.: Cloud tracking with optical flow for short-term solar forecasting, in: Proceedings of the 50th Conference of the Australian Solar Energy Society, Melbourne, Citeseer, 6–7 December 2012. a
Zhen, Z., Xuan, Z., Wang, F., Sun, R., Duić, N., and Jin, T.: Image phase shift invariance based multi-transform-fusion method for cloud motion displacement calculation using sky images, Energ. Convers. Manage., 197, 111853, https://doi.org/10.1016/j.enconman.2019.111853, 2019. a, b, c
Short summary
We studied the stability of a blockwise phase correlation (PC) method to estimate cloud motion using a total sky imager (TSI). Shorter frame intervals and larger block sizes improve stability, while image resolution and color channels have minor effects. Raindrop contamination can be identified by the rotational motion of the TSI mirror. The correlations of cloud motion vectors (CMVs) from the PC method with wind data vary from 0.38 to 0.59. Optical flow vectors are more stable than PC vectors.
We studied the stability of a blockwise phase correlation (PC) method to estimate cloud motion...
