Articles | Volume 19, issue 2
https://doi.org/10.5194/amt-19-405-2026
© Author(s) 2026. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-19-405-2026
© Author(s) 2026. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Signal processing to denoise and retrieve water vapor from multi-pulse-length lidar data
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Robert A. Stillwell
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Adam Karboski
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Scott M. Spuler
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Related authors
Grant J. Kirchhoff, Matthew Hayman, Jeffrey P. Thayer, and Bryce H. Garby
EGUsphere, https://doi.org/10.5194/egusphere-2026-3698, https://doi.org/10.5194/egusphere-2026-3698, 2026
This preprint is open for discussion and under review for Atmospheric Measurement Techniques (AMT).
Short summary
Short summary
Clouds strongly affect weather and climate, but they are hard to measure because their particles are unevenly spaced across very small scales. We used a laser-based instrument to observe clouds in very fine detail and found that standard averaging methods can miss important small-scale structure. Our results show when these averages are reliable, when they can break down, and how future instruments could use signals from individual droplets and ice particles to improve cloud measurements.
Luke Colberg, Kevin S. Repasky, Matthew Hayman, Robert A. Stillwell, and Scott M. Spuler
Atmos. Meas. Tech., 18, 6069–6092, https://doi.org/10.5194/amt-18-6069-2025, https://doi.org/10.5194/amt-18-6069-2025, 2025
Short summary
Short summary
Two methods were developed to measure the mixed layer height, an important variable for weather forecasting and air quality studies. An aerosol-based method and a thermodynamic method were tested using a lidar system that can measure vertical profiles of aerosols, humidity, and temperature. Each method performed best under different conditions. Together, they provide a path toward more reliable mixed layer height monitoring with a single instrument.
Robert A. Stillwell, Adam Karboski, Matthew Hayman, and Scott M. Spuler
Atmos. Meas. Tech., 18, 4119–4130, https://doi.org/10.5194/amt-18-4119-2025, https://doi.org/10.5194/amt-18-4119-2025, 2025
Short summary
Short summary
A method is introduced to expand the observational capability of a diode-laser-based lidar system. This method allows the lidar transmitter to change the laser pulse characteristics from one shot to the next. We use this capability to lower the minimum altitude of observation and to observe clouds with higher range resolution.
John S. Schreck, Gabrielle Gantos, Matthew Hayman, Aaron Bansemer, and David John Gagne
Atmos. Meas. Tech., 15, 5793–5819, https://doi.org/10.5194/amt-15-5793-2022, https://doi.org/10.5194/amt-15-5793-2022, 2022
Short summary
Short summary
We show promising results for a new machine-learning based paradigm for processing field-acquired cloud droplet holograms. The approach is fast, scalable, and leverages GPUs and other heterogeneous computing platforms. It combines applications of transfer and active learning by using synthetic data for training and a small set of hand-labeled data for refinement and validation. Artificial noise applied during synthetic training enables optimized models for real-world situations.
Willem J. Marais and Matthew Hayman
Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, https://doi.org/10.5194/amt-15-5159-2022, 2022
Short summary
Short summary
For atmospheric science and weather prediction, it is important to make water vapor measurements in real time. A low-cost lidar instrument has been developed by Montana State University and the National Center for Atmospheric Research. We developed an advanced signal-processing method to extend the scientific capability of the lidar instrument. With the new method we show that the maximum altitude at which the MPD can make water vapor measurements can be extended up to 8 km.
Grant J. Kirchhoff, Matthew Hayman, Jeffrey P. Thayer, and Bryce H. Garby
EGUsphere, https://doi.org/10.5194/egusphere-2026-3698, https://doi.org/10.5194/egusphere-2026-3698, 2026
This preprint is open for discussion and under review for Atmospheric Measurement Techniques (AMT).
Short summary
Short summary
Clouds strongly affect weather and climate, but they are hard to measure because their particles are unevenly spaced across very small scales. We used a laser-based instrument to observe clouds in very fine detail and found that standard averaging methods can miss important small-scale structure. Our results show when these averages are reliable, when they can break down, and how future instruments could use signals from individual droplets and ice particles to improve cloud measurements.
Luke Colberg, Kevin S. Repasky, Matthew Hayman, Robert A. Stillwell, and Scott M. Spuler
Atmos. Meas. Tech., 18, 6069–6092, https://doi.org/10.5194/amt-18-6069-2025, https://doi.org/10.5194/amt-18-6069-2025, 2025
Short summary
Short summary
Two methods were developed to measure the mixed layer height, an important variable for weather forecasting and air quality studies. An aerosol-based method and a thermodynamic method were tested using a lidar system that can measure vertical profiles of aerosols, humidity, and temperature. Each method performed best under different conditions. Together, they provide a path toward more reliable mixed layer height monitoring with a single instrument.
Robert A. Stillwell, Adam Karboski, Matthew Hayman, and Scott M. Spuler
Atmos. Meas. Tech., 18, 4119–4130, https://doi.org/10.5194/amt-18-4119-2025, https://doi.org/10.5194/amt-18-4119-2025, 2025
Short summary
Short summary
A method is introduced to expand the observational capability of a diode-laser-based lidar system. This method allows the lidar transmitter to change the laser pulse characteristics from one shot to the next. We use this capability to lower the minimum altitude of observation and to observe clouds with higher range resolution.
John S. Schreck, Gabrielle Gantos, Matthew Hayman, Aaron Bansemer, and David John Gagne
Atmos. Meas. Tech., 15, 5793–5819, https://doi.org/10.5194/amt-15-5793-2022, https://doi.org/10.5194/amt-15-5793-2022, 2022
Short summary
Short summary
We show promising results for a new machine-learning based paradigm for processing field-acquired cloud droplet holograms. The approach is fast, scalable, and leverages GPUs and other heterogeneous computing platforms. It combines applications of transfer and active learning by using synthetic data for training and a small set of hand-labeled data for refinement and validation. Artificial noise applied during synthetic training enables optimized models for real-world situations.
Willem J. Marais and Matthew Hayman
Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, https://doi.org/10.5194/amt-15-5159-2022, 2022
Short summary
Short summary
For atmospheric science and weather prediction, it is important to make water vapor measurements in real time. A low-cost lidar instrument has been developed by Montana State University and the National Center for Atmospheric Research. We developed an advanced signal-processing method to extend the scientific capability of the lidar instrument. With the new method we show that the maximum altitude at which the MPD can make water vapor measurements can be extended up to 8 km.
Cited articles
Beck, A. and Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems, IEEE Transactions on Image Processing, 18, 2419–2434, https://doi.org/10.1109/TIP.2009.2028250, 2009. a
Copernicus Climate Change Service (C3S): ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate, Copernicus Climate Change Service Climate Data Store (CDS), https://doi.org/10.26023/WKM7-HNCF-FX0B, 2025. a, b
Groß, S., Wirth, M., Schäfler, A., Fix, A., Kaufmann, S., and Voigt, C.: Potential of airborne lidar measurements for cirrus cloud studies, Atmos. Meas. Tech., 7, 2745–2755, https://doi.org/10.5194/amt-7-2745-2014, 2014. a
Harmany, Z. T., Marcia, R. F., and Willett, R. M.: This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms – Theory and Practice, IEEE Transactions on Image Processing, 21, 1084–1096, https://doi.org/10.1109/TIP.2011.2168410, 2012. a
Hayman, M. and Spuler, S.: Demonstration of a diode-laser-based high spectral resolution lidar (HSRL) for quantitative profiling of clouds and aerosols, Optics Express, 25, A1096–A1110, https://doi.org/10.1364/OE.25.0A1096, 2017. a
Hayman, M., Marais, W. J., Stillwell, R. A., Carnes, J., Kirchhoff, G., Spuler, S. M., and Thayer, J.: Interrogation of Heterogeneous Atmospheric Structure Through Statistical Signal Processing, in: 103rd Annual Meeting American Meteorological Society, https://ams.confex.com/ams/103ANNUAL/meetingapp.cgi/Paper/419855 (last access: 6 January 2026), 2023. a
Hayman, M., Stillwell, R. A., Carnes, J., Kirchhoff, G. J., Spuler, S. M., and Thayer, J. P.: 2D Signal Estimation for Sparse Distributed Target Photon Counting Data, Sci. Rep., 14, 10325, https://doi.org/10.1038/s41598-024-60464-1, 2024a. a, b, c, d
Hayman, M., Stillwell, R. A., Karboski, A., Marais, W. J., and Spuler, S. M.: Global estimation of range resolved thermodynamic profiles from micropulse differential absorption lidar, Opt. Express, 32, 14442–14460, https://doi.org/10.1364/OE.521178, 2024b. a, b, c, d
Hayman, M., Stillwell, R. A., Karboski, A., and Spuler, S. M.: SpiralTorch, GitHub [code], https://github.com/NCAR/SpiralTorch, last access: 25 June 2025. a
Hoffman, K. and Demoz, B.: Convection Parameters from Remote Sensing Observations over the Southern Great Plains, Sensors, 25, 4163, https://doi.org/10.3390/s25134163, 2025. a
Kirchhoff, G. J., Hayman, M., Marais, W. J., Thayer, J. P., and Barton-Grimley, R. A.: Development of a photon-counting deadtime noise model that extends dynamic range and resolution in atmospheric lidar, Appl. Opt., 64, 4568–4581, https://doi.org/10.1364/AO.543305, 2025. a, b
Marais, W. J. and Hayman, M.: Extending water vapor measurement capability of photon-limited differential absorption lidars through simultaneous denoising and inversion, Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, 2022. a, b
Marais, W. J., Holz, R. E., Hu, Y. H., Kuehn, R. E., Eloranta, E. E., and Willett, R. M.: Approach to simultaneously denoise and invert backscatter and extinction from photon-limited atmospheric lidar observations, Appl. Opt., 55, 8316–8334, https://doi.org/10.1364/AO.55.008316, 2016. a
NCAR/EOL-MPD-Team: NCAR MPD data. Version 1.0 (Version 1.0), Earth Observing Laboratory Field Data Archive [data set], https://doi.org/10.26023/MX0D-Z722-M406, 2020. a, b
Nehrir, A., Repasky, K., and Carlsten, J.: Eye-Safe Diode-Laser-Based Micropulse Differential Absorption Lidar (DIAL) for Water Vapor Profiling in the Lower Troposphere, Journal of Atmospheric and Oceanic Technology, 28, 131–147, https://doi.org/10.1175/2010JTECHA1452.1, 2011. a
Oh, A. K., Harmany, Z. T., and Willett, R. M.: Logarithmic total variation regularization for cross-validation in photon-limited imaging, in: 2013 IEEE International Conference on Image Processing, IEEE, 484–488, https://doi.org/10.1109/ICIP.2013.6738100, 2013. a
Price, I., Sanchez-Gonzalez, A., Alet, F., Andersson, T. R., El-Kadi, A., Masters, D., Ewalds, T., Stott, J., Mohamed, S., Battaglia, P., Lam, R., and Willson, M.: Probabilistic weather forecasting with machine learning, Nature, 637, 84–90, https://doi.org/10.1038/s41586-024-08252-9, 2025. a
Repasky, K. S., Moen, D., Spuler, S., Nehrir, A. R., and Carlsten, J. L.: Progress towards an Autonomous Field Deployable Diode-Laser-Based Differential Absorption Lidar (DIAL) for Profiling Water Vapor in the Lower Troposphere, Remote Sensing, 5, 6241–6259, https://doi.org/10.3390/rs5126241, 2013. a
Schreck, J. S., Sha, Y., Chapman, W., Kimpara, D., Berner, J., McGinnis, S., Kazadi, A., Sobhani, N., Kirk, B., Becker, C., Gantos, G., and Gange II, D. J.: Community Research Earth Digital Intelligence Twin: a scalable framework for AI-driven Earth System Modeling, npj Clim. Atmos. Sci., 8, https://doi.org/10.1038/s41612-025-01125-6, 2025. a
Spuler, S. M., Repasky, K. S., Morley, B., Moen, D., Hayman, M., and Nehrir, A. R.: Field-deployable diode-laser-based differential absorption lidar (DIAL) for profiling water vapor, Atmos. Meas. Tech., 8, 1073–1087, https://doi.org/10.5194/amt-8-1073-2015, 2015. a, b
Stillwell, R. A., Spuler, S. M., Hayman, M., Repasky, K. S., and Bunn, C. E.: Demonstration of a combined differential absorption and high spectral resolution lidar for profiling atmospheric temperature, Optics Express, 28, 71–93, https://doi.org/10.1364/OE.379804, 2020. a
Tuckman, P. J. and Emanuel, K.: Origins of Extreme CAPE Around the World, J. Geophys. Res. Atmospheres, 129, e2024JD041833, https://doi.org/10.1029/2024JD041833, 2024. a
Short summary
A new processing method for lidar data obtained from rapidly changing laser pulse lengths enables measurement of atmospheric water vapor from the ground up to 6 km. The technique blends all captured data to reveal hidden water vapor structures, especially near the surface. This solution offers continuous, high-resolution insights, key for improving weather forecasts. It showcases how flexible laser technology can enhance atmospheric observation.
A new processing method for lidar data obtained from rapidly changing laser pulse lengths...