Articles | Volume 19, issue 2
https://doi.org/10.5194/amt-19-405-2026
© Author(s) 2026. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-19-405-2026
© Author(s) 2026. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Signal processing to denoise and retrieve water vapor from multi-pulse-length lidar data
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Robert A. Stillwell
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Adam Karboski
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Scott M. Spuler
Earth Observing Laboratory, NSF National Center for Atmospheric Research, Boulder, CO, USA
Related authors
Luke Colberg, Kevin S. Repasky, Matthew Hayman, Robert A. Stillwell, and Scott M. Spuler
Atmos. Meas. Tech., 18, 6069–6092, https://doi.org/10.5194/amt-18-6069-2025, https://doi.org/10.5194/amt-18-6069-2025, 2025
Short summary
Short summary
Two methods were developed to measure the mixed layer height, an important variable for weather forecasting and air quality studies. An aerosol-based method and a thermodynamic method were tested using a lidar system that can measure vertical profiles of aerosols, humidity, and temperature. Each method performed best under different conditions. Together, they provide a path toward more reliable mixed layer height monitoring with a single instrument.
Robert A. Stillwell, Adam Karboski, Matthew Hayman, and Scott M. Spuler
Atmos. Meas. Tech., 18, 4119–4130, https://doi.org/10.5194/amt-18-4119-2025, https://doi.org/10.5194/amt-18-4119-2025, 2025
Short summary
Short summary
A method is introduced to expand the observational capability of a diode-laser-based lidar system. This method allows the lidar transmitter to change the laser pulse characteristics from one shot to the next. We use this capability to lower the minimum altitude of observation and to observe clouds with higher range resolution.
John S. Schreck, Gabrielle Gantos, Matthew Hayman, Aaron Bansemer, and David John Gagne
Atmos. Meas. Tech., 15, 5793–5819, https://doi.org/10.5194/amt-15-5793-2022, https://doi.org/10.5194/amt-15-5793-2022, 2022
Short summary
Short summary
We show promising results for a new machine-learning based paradigm for processing field-acquired cloud droplet holograms. The approach is fast, scalable, and leverages GPUs and other heterogeneous computing platforms. It combines applications of transfer and active learning by using synthetic data for training and a small set of hand-labeled data for refinement and validation. Artificial noise applied during synthetic training enables optimized models for real-world situations.
Willem J. Marais and Matthew Hayman
Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, https://doi.org/10.5194/amt-15-5159-2022, 2022
Short summary
Short summary
For atmospheric science and weather prediction, it is important to make water vapor measurements in real time. A low-cost lidar instrument has been developed by Montana State University and the National Center for Atmospheric Research. We developed an advanced signal-processing method to extend the scientific capability of the lidar instrument. With the new method we show that the maximum altitude at which the MPD can make water vapor measurements can be extended up to 8 km.
Scott M. Spuler, Matthew Hayman, Robert A. Stillwell, Joshua Carnes, Todd Bernatsky, and Kevin S. Repasky
Atmos. Meas. Tech., 14, 4593–4616, https://doi.org/10.5194/amt-14-4593-2021, https://doi.org/10.5194/amt-14-4593-2021, 2021
Short summary
Short summary
Continuous water vapor and temperature profiles are critically needed for improved understanding of the lower atmosphere and potential advances in weather forecasting skill. To address this observation need, an active remote sensing technology based on a diode-laser-based lidar architecture is being developed. We discuss the details of the lidar architecture and analyze how it addresses a national-scale profiling network's need to provide continuous thermodynamic observations.
Luke Colberg, Kevin S. Repasky, Matthew Hayman, Robert A. Stillwell, and Scott M. Spuler
Atmos. Meas. Tech., 18, 6069–6092, https://doi.org/10.5194/amt-18-6069-2025, https://doi.org/10.5194/amt-18-6069-2025, 2025
Short summary
Short summary
Two methods were developed to measure the mixed layer height, an important variable for weather forecasting and air quality studies. An aerosol-based method and a thermodynamic method were tested using a lidar system that can measure vertical profiles of aerosols, humidity, and temperature. Each method performed best under different conditions. Together, they provide a path toward more reliable mixed layer height monitoring with a single instrument.
Robert A. Stillwell, Adam Karboski, Matthew Hayman, and Scott M. Spuler
Atmos. Meas. Tech., 18, 4119–4130, https://doi.org/10.5194/amt-18-4119-2025, https://doi.org/10.5194/amt-18-4119-2025, 2025
Short summary
Short summary
A method is introduced to expand the observational capability of a diode-laser-based lidar system. This method allows the lidar transmitter to change the laser pulse characteristics from one shot to the next. We use this capability to lower the minimum altitude of observation and to observe clouds with higher range resolution.
John S. Schreck, Gabrielle Gantos, Matthew Hayman, Aaron Bansemer, and David John Gagne
Atmos. Meas. Tech., 15, 5793–5819, https://doi.org/10.5194/amt-15-5793-2022, https://doi.org/10.5194/amt-15-5793-2022, 2022
Short summary
Short summary
We show promising results for a new machine-learning based paradigm for processing field-acquired cloud droplet holograms. The approach is fast, scalable, and leverages GPUs and other heterogeneous computing platforms. It combines applications of transfer and active learning by using synthetic data for training and a small set of hand-labeled data for refinement and validation. Artificial noise applied during synthetic training enables optimized models for real-world situations.
Willem J. Marais and Matthew Hayman
Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, https://doi.org/10.5194/amt-15-5159-2022, 2022
Short summary
Short summary
For atmospheric science and weather prediction, it is important to make water vapor measurements in real time. A low-cost lidar instrument has been developed by Montana State University and the National Center for Atmospheric Research. We developed an advanced signal-processing method to extend the scientific capability of the lidar instrument. With the new method we show that the maximum altitude at which the MPD can make water vapor measurements can be extended up to 8 km.
Scott M. Spuler, Matthew Hayman, Robert A. Stillwell, Joshua Carnes, Todd Bernatsky, and Kevin S. Repasky
Atmos. Meas. Tech., 14, 4593–4616, https://doi.org/10.5194/amt-14-4593-2021, https://doi.org/10.5194/amt-14-4593-2021, 2021
Short summary
Short summary
Continuous water vapor and temperature profiles are critically needed for improved understanding of the lower atmosphere and potential advances in weather forecasting skill. To address this observation need, an active remote sensing technology based on a diode-laser-based lidar architecture is being developed. We discuss the details of the lidar architecture and analyze how it addresses a national-scale profiling network's need to provide continuous thermodynamic observations.
Cited articles
Beck, A. and Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems, IEEE Transactions on Image Processing, 18, 2419–2434, https://doi.org/10.1109/TIP.2009.2028250, 2009. a
Copernicus Climate Change Service (C3S): ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate, Copernicus Climate Change Service Climate Data Store (CDS), https://doi.org/10.26023/WKM7-HNCF-FX0B, 2025. a, b
Groß, S., Wirth, M., Schäfler, A., Fix, A., Kaufmann, S., and Voigt, C.: Potential of airborne lidar measurements for cirrus cloud studies, Atmos. Meas. Tech., 7, 2745–2755, https://doi.org/10.5194/amt-7-2745-2014, 2014. a
Harmany, Z. T., Marcia, R. F., and Willett, R. M.: This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms – Theory and Practice, IEEE Transactions on Image Processing, 21, 1084–1096, https://doi.org/10.1109/TIP.2011.2168410, 2012. a
Hayman, M. and Spuler, S.: Demonstration of a diode-laser-based high spectral resolution lidar (HSRL) for quantitative profiling of clouds and aerosols, Optics Express, 25, A1096–A1110, https://doi.org/10.1364/OE.25.0A1096, 2017. a
Hayman, M., Marais, W. J., Stillwell, R. A., Carnes, J., Kirchhoff, G., Spuler, S. M., and Thayer, J.: Interrogation of Heterogeneous Atmospheric Structure Through Statistical Signal Processing, in: 103rd Annual Meeting American Meteorological Society, https://ams.confex.com/ams/103ANNUAL/meetingapp.cgi/Paper/419855 (last access: 6 January 2026), 2023. a
Hayman, M., Stillwell, R. A., Carnes, J., Kirchhoff, G. J., Spuler, S. M., and Thayer, J. P.: 2D Signal Estimation for Sparse Distributed Target Photon Counting Data, Sci. Rep., 14, 10325, https://doi.org/10.1038/s41598-024-60464-1, 2024a. a, b, c, d
Hayman, M., Stillwell, R. A., Karboski, A., Marais, W. J., and Spuler, S. M.: Global estimation of range resolved thermodynamic profiles from micropulse differential absorption lidar, Opt. Express, 32, 14442–14460, https://doi.org/10.1364/OE.521178, 2024b. a, b, c, d
Hayman, M., Stillwell, R. A., Karboski, A., and Spuler, S. M.: SpiralTorch, GitHub [code], https://github.com/NCAR/SpiralTorch, last access: 25 June 2025. a
Hoffman, K. and Demoz, B.: Convection Parameters from Remote Sensing Observations over the Southern Great Plains, Sensors, 25, 4163, https://doi.org/10.3390/s25134163, 2025. a
Kirchhoff, G. J., Hayman, M., Marais, W. J., Thayer, J. P., and Barton-Grimley, R. A.: Development of a photon-counting deadtime noise model that extends dynamic range and resolution in atmospheric lidar, Appl. Opt., 64, 4568–4581, https://doi.org/10.1364/AO.543305, 2025. a, b
Marais, W. J. and Hayman, M.: Extending water vapor measurement capability of photon-limited differential absorption lidars through simultaneous denoising and inversion, Atmos. Meas. Tech., 15, 5159–5180, https://doi.org/10.5194/amt-15-5159-2022, 2022. a, b
Marais, W. J., Holz, R. E., Hu, Y. H., Kuehn, R. E., Eloranta, E. E., and Willett, R. M.: Approach to simultaneously denoise and invert backscatter and extinction from photon-limited atmospheric lidar observations, Appl. Opt., 55, 8316–8334, https://doi.org/10.1364/AO.55.008316, 2016. a
NCAR/EOL-MPD-Team: NCAR MPD data. Version 1.0 (Version 1.0), Earth Observing Laboratory Field Data Archive [data set], https://doi.org/10.26023/MX0D-Z722-M406, 2020. a, b
Nehrir, A., Repasky, K., and Carlsten, J.: Eye-Safe Diode-Laser-Based Micropulse Differential Absorption Lidar (DIAL) for Water Vapor Profiling in the Lower Troposphere, Journal of Atmospheric and Oceanic Technology, 28, 131–147, https://doi.org/10.1175/2010JTECHA1452.1, 2011. a
Oh, A. K., Harmany, Z. T., and Willett, R. M.: Logarithmic total variation regularization for cross-validation in photon-limited imaging, in: 2013 IEEE International Conference on Image Processing, IEEE, 484–488, https://doi.org/10.1109/ICIP.2013.6738100, 2013. a
Price, I., Sanchez-Gonzalez, A., Alet, F., Andersson, T. R., El-Kadi, A., Masters, D., Ewalds, T., Stott, J., Mohamed, S., Battaglia, P., Lam, R., and Willson, M.: Probabilistic weather forecasting with machine learning, Nature, 637, 84–90, https://doi.org/10.1038/s41586-024-08252-9, 2025. a
Repasky, K. S., Moen, D., Spuler, S., Nehrir, A. R., and Carlsten, J. L.: Progress towards an Autonomous Field Deployable Diode-Laser-Based Differential Absorption Lidar (DIAL) for Profiling Water Vapor in the Lower Troposphere, Remote Sensing, 5, 6241–6259, https://doi.org/10.3390/rs5126241, 2013. a
Schreck, J. S., Sha, Y., Chapman, W., Kimpara, D., Berner, J., McGinnis, S., Kazadi, A., Sobhani, N., Kirk, B., Becker, C., Gantos, G., and Gange II, D. J.: Community Research Earth Digital Intelligence Twin: a scalable framework for AI-driven Earth System Modeling, npj Clim. Atmos. Sci., 8, https://doi.org/10.1038/s41612-025-01125-6, 2025. a
Spuler, S. M., Repasky, K. S., Morley, B., Moen, D., Hayman, M., and Nehrir, A. R.: Field-deployable diode-laser-based differential absorption lidar (DIAL) for profiling water vapor, Atmos. Meas. Tech., 8, 1073–1087, https://doi.org/10.5194/amt-8-1073-2015, 2015. a, b
Stillwell, R. A., Spuler, S. M., Hayman, M., Repasky, K. S., and Bunn, C. E.: Demonstration of a combined differential absorption and high spectral resolution lidar for profiling atmospheric temperature, Optics Express, 28, 71–93, https://doi.org/10.1364/OE.379804, 2020. a
Tuckman, P. J. and Emanuel, K.: Origins of Extreme CAPE Around the World, J. Geophys. Res. Atmospheres, 129, e2024JD041833, https://doi.org/10.1029/2024JD041833, 2024. a
Short summary
A new processing method for lidar data obtained from rapidly changing laser pulse lengths enables measurement of atmospheric water vapor from the ground up to 6 km. The technique blends all captured data to reveal hidden water vapor structures, especially near the surface. This solution offers continuous, high-resolution insights, key for improving weather forecasts. It showcases how flexible laser technology can enhance atmospheric observation.
A new processing method for lidar data obtained from rapidly changing laser pulse lengths...