Articles | Volume 18, issue 7
https://doi.org/10.5194/amt-18-1689-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/amt-18-1689-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
16 Apr 2025
Research article |
| 16 Apr 2025
| 16 Apr 2025
Predictions of failed satellite retrieval of air quality using machine learning
Edward Malina
CORRESPONDING AUTHOR
Jet Propulsion Laboratory, California Institute of Technology, Pasadena, California, USA
currently at: ESA/ESRIN, Frascati, Italy
Jure Brence
Department of Knowledge Technologies, Jožef Stefan Institute, Ljubljana, Slovenia
Jennifer Adams
Remote Sensing Laboratories, Department of Geography, University of Zurich, Zurich, Switzerland
Jovan Tanevski
Department of Knowledge Technologies, Jožef Stefan Institute, Ljubljana, Slovenia
Institute for Computational Biomedicine, Heidelberg University, Heidelberg, Germany
Sašo Džeroski
Department of Knowledge Technologies, Jožef Stefan Institute, Ljubljana, Slovenia
Phi-lab, ESA/ESRIN, Frascati, Italy
Valentin Kantchev
Swift Software Group, Glendale, California, USA
Kevin W. Bowman
Jet Propulsion Laboratory, California Institute of Technology, Pasadena, California, USA
Related authors
Edward Malina, Kevin W. Bowman, Valentin Kantchev, Le Kuai, Thomas P. Kurosu, Kazuyuki Miyazaki, Vijay Natraj, Gregory B. Osterman, Fabiano Oyafuso, and Matthew D. Thill
Atmos. Meas. Tech., 17, 5341–5371, https://doi.org/10.5194/amt-17-5341-2024, https://doi.org/10.5194/amt-17-5341-2024, 2024
Short summary
Short summary
Characterizing the distribution of ozone in the atmosphere is a challenging problem, with current Earth observation satellites using either thermal infrared (TIR) or ultraviolet (UV) instruments, sensitive to different portions of the atmosphere, making it difficult to gain a full picture. In this work, we combine measurements from the TIR and UV instruments Suomi NPP CrIS and Sentinel-5P/TROPOMI to improve sensitivity through the whole atmosphere and improve knowledge of ozone distribution.
Elyse A. Pennington, Gregory B. Osterman, Vivienne H. Payne, Kazuyuki Miyazaki, Kevin W. Bowman, and Jessica L. Neu
Atmos. Chem. Phys., 25, 8533–8552, https://doi.org/10.5194/acp-25-8533-2025, https://doi.org/10.5194/acp-25-8533-2025, 2025
Short summary
Short summary
Tropospheric ozone is a harmful pollutant and powerful greenhouse gas. For satellite products to accurately quantify trends in tropospheric ozone, they must have a low bias compared to a reliable source of data. This study compares three NASA satellite products to ozonesonde data. They have low global measurement bias and thus can be used to detect global tropospheric ozone trends, but the measurement bias should be considered in certain regions and time periods.
Kazuyuki Miyazaki, Yuliya Marchetti, James Montgomery, Steven Lu, and Kevin Bowman
Atmos. Chem. Phys., 25, 8507–8532, https://doi.org/10.5194/acp-25-8507-2025, https://doi.org/10.5194/acp-25-8507-2025, 2025
Short summary
Short summary
This study employs explainable machine learning to analyze the causes of significant biases in surface ozone estimates from chemical reanalysis. By analyzing global observations and chemical reanalysis outputs, key bias drivers, such as meteorological conditions and precursor emissions, were identified. This provides actionable insights to improve chemical transport models, observation systems, and emissions inventories, ultimately enhancing ozone reanalysis for better air pollution management.
Hannah Nesser, Kevin W. Bowman, Matthew D. Thill, Daniel J. Varon, Cynthia A. Randles, Ashutosh Tewari, Felipe J. Cardoso-Saldaña, Emily Reidy, Joannes D. Maasakkers, and Daniel J. Jacob
EGUsphere, https://doi.org/10.5194/egusphere-2025-2850, https://doi.org/10.5194/egusphere-2025-2850, 2025
Short summary
Short summary
Regional analyses of atmospheric trace gases can improve knowledge of fluxes and their trends at high resolution but rely on the specification of boundary conditions at the domain edges. Biases in the often-uncertain boundary conditions propagate to the inferred fluxes. We develop a framework to explain how errors in the boundary conditions influence the optimized fluxes, derive two metrics to estimate this influence, and compare two methods to correct for the biases.
Lucas A. Estrada, Daniel J. Varon, Melissa Sulprizio, Hannah Nesser, Zichong Chen, Nicholas Balasus, Sarah E. Hancock, Megan He, James D. East, Todd A. Mooring, Alexander Oort Alonso, Joannes D. Maasakkers, Ilse Aben, Sabour Baray, Kevin W. Bowman, John R. Worden, Felipe J. Cardoso-Saldaña, Emily Reidy, and Daniel J. Jacob
Geosci. Model Dev., 18, 3311–3330, https://doi.org/10.5194/gmd-18-3311-2025, https://doi.org/10.5194/gmd-18-3311-2025, 2025
Short summary
Short summary
Reducing emissions of methane, a powerful greenhouse gas, is a top policy concern for mitigating anthropogenic climate change. The Integrated Methane Inversion (IMI) is an advanced, cloud-based software that translates satellite observations into actionable emissions data. Here we present IMI version 2.0 with vastly expanded capabilities. These updates enable a wider range of scientific and stakeholder applications from individual basin to global scales with continuous emissions monitoring.
Raphaël Savelli, Dustin Carroll, Dimitris Menemenlis, Jonathan Lauderdale, Clément Bertin, Stephanie Dutkiewicz, Manfredi Manizza, Anthony Bloom, Karel Castro-Morales, Charles E. Miller, Marc Simard, Kevin W. Bowman, and Hong Zhang
EGUsphere, https://doi.org/10.5194/egusphere-2025-1707, https://doi.org/10.5194/egusphere-2025-1707, 2025
Short summary
Short summary
Accounting for carbon and nutrients in rivers is essential for resolving carbon dioxide (CO2) exchanges between the ocean and the atmosphere. In this study, we add the effect of present-day rivers to a pioneering global-ocean biogeochemistry model. This study highlights the challenge for global ocean numerical models to cover the complexity of the flow of water and carbon across the Land-to-Ocean Aquatic Continuum.
Anne Boynard, Catherine Wespes, Juliette Hadji-Lazaro, Selviga Sinnathamby, Daniel Hurtmans, Pierre-François Coheur, Marie Doutriaux-Boucher, Jacobus Onderwaater, Wolfgang Steinbrecht, Elyse A. Pennington, Kevin Bowman, and Cathy Clerbaux
EGUsphere, https://doi.org/10.5194/egusphere-2025-1054, https://doi.org/10.5194/egusphere-2025-1054, 2025
Short summary
Short summary
This study analyzes 16 years of global ozone data to assess its impact on air quality and climate. Using satellite measurements, we observed a global decrease in tropospheric ozone, particularly in tropical and European regions. The study highlights the importance of long-term data for tracking trends, especially during events like the pandemic. We emphasize the need for improved data processing and integrating multiple datasets to better understand ozone trends.
Min Huang, Gregory R. Carmichael, Kevin W. Bowman, Isabelle De Smedt, Andreas Colliander, Michael H. Cosh, Sujay V. Kumar, Alex B. Guenther, Scott J. Janz, Ryan M. Stauffer, Anne M. Thompson, Niko M. Fedkin, Robert J. Swap, John D. Bolten, and Alicia T. Joseph
Atmos. Chem. Phys., 25, 1449–1476, https://doi.org/10.5194/acp-25-1449-2025, https://doi.org/10.5194/acp-25-1449-2025, 2025
Short summary
Short summary
We use model simulations along with multiplatform, multidisciplinary observations and a range of analysis methods to estimate and understand the distributions, temporal changes, and impacts of reactive nitrogen and ozone over the most populous US region that has undergone significant environmental changes. Deposition, biogenic emissions, and extra-regional sources have been playing increasingly important roles in controlling pollutant budgets in this area as local anthropogenic emissions drop.
Edward Malina, Kevin W. Bowman, Valentin Kantchev, Le Kuai, Thomas P. Kurosu, Kazuyuki Miyazaki, Vijay Natraj, Gregory B. Osterman, Fabiano Oyafuso, and Matthew D. Thill
Atmos. Meas. Tech., 17, 5341–5371, https://doi.org/10.5194/amt-17-5341-2024, https://doi.org/10.5194/amt-17-5341-2024, 2024
Short summary
Short summary
Characterizing the distribution of ozone in the atmosphere is a challenging problem, with current Earth observation satellites using either thermal infrared (TIR) or ultraviolet (UV) instruments, sensitive to different portions of the atmosphere, making it difficult to gain a full picture. In this work, we combine measurements from the TIR and UV instruments Suomi NPP CrIS and Sentinel-5P/TROPOMI to improve sensitivity through the whole atmosphere and improve knowledge of ozone distribution.
Karen E. Cady-Pereira, Xuehui Guo, Rui Wang, April B. Leytem, Chase Calkins, Elizabeth Berry, Kang Sun, Markus Müller, Armin Wisthaler, Vivienne H. Payne, Mark W. Shephard, Mark A. Zondlo, and Valentin Kantchev
Atmos. Meas. Tech., 17, 15–36, https://doi.org/10.5194/amt-17-15-2024, https://doi.org/10.5194/amt-17-15-2024, 2024
Short summary
Short summary
Ammonia is a significant precursor of PM2.5 particles and thus contributes to poor air quality in many regions. Furthermore, ammonia concentrations are rising due to the increase of large-scale, intensive agricultural activities. Here we evaluate satellite measurements of ammonia against aircraft and surface network data, and show that there are differences in magnitude, but the satellite data are spatially and temporally well correlated with the in situ data.
Drew C. Pendergrass, Daniel J. Jacob, Hannah Nesser, Daniel J. Varon, Melissa Sulprizio, Kazuyuki Miyazaki, and Kevin W. Bowman
Geosci. Model Dev., 16, 4793–4810, https://doi.org/10.5194/gmd-16-4793-2023, https://doi.org/10.5194/gmd-16-4793-2023, 2023
Short summary
Short summary
We have built a tool called CHEEREIO that allows scientists to use observations of pollutants or gases in the atmosphere, such as from satellites or surface stations, to update supercomputer models that simulate the Earth. CHEEREIO uses the difference between the model simulations of the atmosphere and real-world observations to come up with a good guess for the actual composition of our atmosphere, the true emissions of various pollutants, and whatever else they may want to study.
Brendan Byrne, David F. Baker, Sourish Basu, Michael Bertolacci, Kevin W. Bowman, Dustin Carroll, Abhishek Chatterjee, Frédéric Chevallier, Philippe Ciais, Noel Cressie, David Crisp, Sean Crowell, Feng Deng, Zhu Deng, Nicholas M. Deutscher, Manvendra K. Dubey, Sha Feng, Omaira E. García, David W. T. Griffith, Benedikt Herkommer, Lei Hu, Andrew R. Jacobson, Rajesh Janardanan, Sujong Jeong, Matthew S. Johnson, Dylan B. A. Jones, Rigel Kivi, Junjie Liu, Zhiqiang Liu, Shamil Maksyutov, John B. Miller, Scot M. Miller, Isamu Morino, Justus Notholt, Tomohiro Oda, Christopher W. O'Dell, Young-Suk Oh, Hirofumi Ohyama, Prabir K. Patra, Hélène Peiro, Christof Petri, Sajeev Philip, David F. Pollard, Benjamin Poulter, Marine Remaud, Andrew Schuh, Mahesh K. Sha, Kei Shiomi, Kimberly Strong, Colm Sweeney, Yao Té, Hanqin Tian, Voltaire A. Velazco, Mihalis Vrekoussis, Thorsten Warneke, John R. Worden, Debra Wunch, Yuanzhi Yao, Jeongmin Yun, Andrew Zammit-Mangion, and Ning Zeng
Earth Syst. Sci. Data, 15, 963–1004, https://doi.org/10.5194/essd-15-963-2023, https://doi.org/10.5194/essd-15-963-2023, 2023
Short summary
Short summary
Changes in the carbon stocks of terrestrial ecosystems result in emissions and removals of CO2. These can be driven by anthropogenic activities (e.g., deforestation), natural processes (e.g., fires) or in response to rising CO2 (e.g., CO2 fertilization). This paper describes a dataset of CO2 emissions and removals derived from atmospheric CO2 observations. This pilot dataset informs current capabilities and future developments towards top-down monitoring and verification systems.
Tai-Long He, Dylan B. A. Jones, Kazuyuki Miyazaki, Kevin W. Bowman, Zhe Jiang, Xiaokang Chen, Rui Li, Yuxiang Zhang, and Kunna Li
Atmos. Chem. Phys., 22, 14059–14074, https://doi.org/10.5194/acp-22-14059-2022, https://doi.org/10.5194/acp-22-14059-2022, 2022
Short summary
Short summary
We use a deep-learning (DL) model to estimate Chinese NOx emissions by combining satellite analysis and in situ measurements. Our results are consistent with conventional analyses of Chinese NOx emissions. Comparison with mobility data shows that the DL model has a better capability to capture changes in NOx. We analyse Chinese NOx emissions during the COVID-19 pandemic lockdown period. Our results illustrate the potential use of DL as a complementary tool for conventional air quality studies.
Brendan Byrne, Junjie Liu, Yonghong Yi, Abhishek Chatterjee, Sourish Basu, Rui Cheng, Russell Doughty, Frédéric Chevallier, Kevin W. Bowman, Nicholas C. Parazoo, David Crisp, Xing Li, Jingfeng Xiao, Stephen Sitch, Bertrand Guenet, Feng Deng, Matthew S. Johnson, Sajeev Philip, Patrick C. McGuire, and Charles E. Miller
Biogeosciences, 19, 4779–4799, https://doi.org/10.5194/bg-19-4779-2022, https://doi.org/10.5194/bg-19-4779-2022, 2022
Short summary
Short summary
Plants draw CO2 from the atmosphere during the growing season, while respiration releases CO2 to the atmosphere throughout the year, driving seasonal variations in atmospheric CO2 that can be observed by satellites, such as the Orbiting Carbon Observatory 2 (OCO-2). Using OCO-2 XCO2 data and space-based constraints on plant growth, we show that permafrost-rich northeast Eurasia has a strong seasonal release of CO2 during the autumn, hinting at an unexpectedly large respiration signal from soils.
Helen M. Worden, Gene L. Francis, Susan S. Kulawik, Kevin W. Bowman, Karen Cady-Pereira, Dejian Fu, Jennifer D. Hegarty, Valentin Kantchev, Ming Luo, Vivienne H. Payne, John R. Worden, Róisín Commane, and Kathryn McKain
Atmos. Meas. Tech., 15, 5383–5398, https://doi.org/10.5194/amt-15-5383-2022, https://doi.org/10.5194/amt-15-5383-2022, 2022
Short summary
Short summary
Satellite observations of global carbon monoxide (CO) are essential for understanding atmospheric chemistry and pollution sources. This paper describes a new data product using radiance measurements from the Cross-track Infrared Sounder (CrIS) instrument on the Suomi National Polar-orbiting Partnership (SNPP) satellite that provides vertical profiles of CO from single-field-of-view observations. We show how these satellite CO profiles compare to aircraft observations and evaluate their biases.
Vivienne H. Payne, Susan S. Kulawik, Emily V. Fischer, Jared F. Brewer, L. Gregory Huey, Kazuyuki Miyazaki, John R. Worden, Kevin W. Bowman, Eric J. Hintsa, Fred Moore, James W. Elkins, and Julieta Juncosa Calahorrano
Atmos. Meas. Tech., 15, 3497–3511, https://doi.org/10.5194/amt-15-3497-2022, https://doi.org/10.5194/amt-15-3497-2022, 2022
Short summary
Short summary
We compare new satellite measurements of peroxyacetyl nitrate (PAN) with reference aircraft measurements from two different instruments flown on the same platform. While there is a systematic difference between the two aircraft datasets, both show the same large-scale distribution of PAN and the discrepancy between aircraft datasets is small compared to the satellite uncertainties. The satellite measurements show skill in capturing large-scale variations in PAN.
Min Huang, James H. Crawford, Gregory R. Carmichael, Kevin W. Bowman, Sujay V. Kumar, and Colm Sweeney
Atmos. Chem. Phys., 22, 7461–7487, https://doi.org/10.5194/acp-22-7461-2022, https://doi.org/10.5194/acp-22-7461-2022, 2022
Short summary
Short summary
This study demonstrates that ozone dry-deposition modeling can be improved by revising the model's dry-deposition parameterizations to better represent the effects of environmental conditions including the soil moisture fields. Applying satellite soil moisture data assimilation is shown to also have added value. Such advancements in coupled modeling and data assimilation can benefit the assessments of ozone impacts on human and vegetation health.
Jennifer D. Hegarty, Karen E. Cady-Pereira, Vivienne H. Payne, Susan S. Kulawik, John R. Worden, Valentin Kantchev, Helen M. Worden, Kathryn McKain, Jasna V. Pittman, Róisín Commane, Bruce C. Daube Jr., and Eric A. Kort
Atmos. Meas. Tech., 15, 205–223, https://doi.org/10.5194/amt-15-205-2022, https://doi.org/10.5194/amt-15-205-2022, 2022
Short summary
Short summary
Carbon monoxide (CO) is produced by combustion of substances such as fossil fuels and plays an important role in atmospheric pollution and climate. We evaluated estimates of atmospheric CO derived from outgoing radiation measurements of the Atmospheric Infrared Sounder (AIRS) on a satellite orbiting the Earth against CO measurements from aircraft to show that these satellite measurements are reliable for continuous global monitoring of atmospheric CO concentrations.
Min Huang, James H. Crawford, Joshua P. DiGangi, Gregory R. Carmichael, Kevin W. Bowman, Sujay V. Kumar, and Xiwu Zhan
Atmos. Chem. Phys., 21, 11013–11040, https://doi.org/10.5194/acp-21-11013-2021, https://doi.org/10.5194/acp-21-11013-2021, 2021
Short summary
Short summary
This study evaluates the impact of satellite soil moisture data assimilation on modeled weather and ozone fields at various altitudes above the southeastern US during the summer. It emphasizes the importance of soil moisture in the understanding of surface ozone pollution and upper tropospheric chemistry, as well as air pollutants’ source–receptor relationships between the US and its downwind areas.
Zhe Jiang, Hongrong Shi, Bin Zhao, Yu Gu, Yifang Zhu, Kazuyuki Miyazaki, Xin Lu, Yuqiang Zhang, Kevin W. Bowman, Takashi Sekiya, and Kuo-Nan Liou
Atmos. Chem. Phys., 21, 8693–8708, https://doi.org/10.5194/acp-21-8693-2021, https://doi.org/10.5194/acp-21-8693-2021, 2021
Short summary
Short summary
We use the COVID-19 pandemic as a unique natural experiment to obtain a more robust understanding of the effectiveness of emission reductions toward air quality improvement by combining chemical transport simulations and observations. Our findings imply a shift from current control policies in California: a strengthened control on primary PM2.5 emissions and a well-balanced control on NOx and volatile organic compounds are needed to effectively and sustainably alleviate PM2.5 and O3 pollution.
Joannes D. Maasakkers, Daniel J. Jacob, Melissa P. Sulprizio, Tia R. Scarpelli, Hannah Nesser, Jianxiong Sheng, Yuzhong Zhang, Xiao Lu, A. Anthony Bloom, Kevin W. Bowman, John R. Worden, and Robert J. Parker
Atmos. Chem. Phys., 21, 4339–4356, https://doi.org/10.5194/acp-21-4339-2021, https://doi.org/10.5194/acp-21-4339-2021, 2021
Short summary
Short summary
We use 2010–2015 GOSAT satellite observations of atmospheric methane over North America in a high-resolution inversion to estimate methane emissions. We find general consistency with the gridded EPA inventory but higher oil and gas production emissions, with oil production emissions twice as large as in the latest EPA Greenhouse Gas Inventory. We find lower wetland emissions than predicted by WetCHARTs and a small increasing trend in the eastern US, apparently related to unconventional oil/gas.
Junjie Liu, Latha Baskaran, Kevin Bowman, David Schimel, A. Anthony Bloom, Nicholas C. Parazoo, Tomohiro Oda, Dustin Carroll, Dimitris Menemenlis, Joanna Joiner, Roisin Commane, Bruce Daube, Lucianna V. Gatti, Kathryn McKain, John Miller, Britton B. Stephens, Colm Sweeney, and Steven Wofsy
Earth Syst. Sci. Data, 13, 299–330, https://doi.org/10.5194/essd-13-299-2021, https://doi.org/10.5194/essd-13-299-2021, 2021
Short summary
Short summary
On average, the terrestrial biosphere carbon sink is equivalent to ~ 20 % of fossil fuel emissions. Understanding where and why the terrestrial biosphere absorbs carbon from the atmosphere is pivotal to any mitigation policy. Here we present a regionally resolved satellite-constrained net biosphere exchange (NBE) dataset with corresponding uncertainties between 2010–2018: CMS-Flux NBE 2020. The dataset provides a unique perspective on monitoring regional contributions to the CO2 growth rate.
A. Anthony Bloom, Kevin W. Bowman, Junjie Liu, Alexandra G. Konings, John R. Worden, Nicholas C. Parazoo, Victoria Meyer, John T. Reager, Helen M. Worden, Zhe Jiang, Gregory R. Quetin, T. Luke Smallman, Jean-François Exbrayat, Yi Yin, Sassan S. Saatchi, Mathew Williams, and David S. Schimel
Biogeosciences, 17, 6393–6422, https://doi.org/10.5194/bg-17-6393-2020, https://doi.org/10.5194/bg-17-6393-2020, 2020
Short summary
Short summary
We use a model of the 2001–2015 tropical land carbon cycle, with satellite measurements of land and atmospheric carbon, to disentangle lagged and concurrent effects (due to past and concurrent meteorological events, respectively) on annual land–atmosphere carbon exchanges. The variability of lagged effects explains most 2001–2015 inter-annual carbon flux variations. We conclude that concurrent and lagged effects need to be accurately resolved to better predict the world's land carbon sink.
Cited articles
Aumann, H. H., Chahine, M. T., Gautier, C., Goldberg, M. D., Kalnay, E., McMillin, L. M., Revercomb, H., Rosenkranz, P. W., Smith, W. L., Staelin, D. H., Strow, L. L., and Susskind, J.: AIRS/AMSU/HSB on the aqua mission: Design, science objectives, data products, and processing systems, IEEE T. Geosci. Remote Sens., 41, 253–263, https://doi.org/10.1109/TGRS.2002.808356, 2003. a, b
Bowman, K. W., Steck, T., Worden, H. M., Worden, J., Clough, S., and Rodgers, C.: Capturing time and vertical variability of tropospheric ozone: A study using TES nadir retrievals, J. Geophys. Res.-Atmos., 107, ACH21–1–ACH21–11, https://doi.org/10.1029/2002JD002150, 2002. a
Bowman, K. W., Rodgers, C. D., Kulawik, S. S., Worden, J., Sarkissian, E., Osterman, G., Steck, T., Lou, M., Eldering, A., Shephard, M., Worden, H., Lampel, M., Clough, S., Brown, P., Rinsland, C., Gunson, M., and Beer, R.: Tropospheric Emission Spectrometer: Retrieval method and error analysis, IEEE T. Geosci. Remote Sens., 44, 1297–1306, https://doi.org/10.1109/TGRS.2006.871234, 2006. a
Brence, J.: brencej/RetrievalFailure: v1.0.0, Zenodo [code], https://doi.org/10.5281/zenodo.15189518, 2025. a
Brence, J., Tanevski, J., Adams, J., Malina, E., and Džeroski, S.: Surrogate models of radiative transfer codes for atmospheric trace gas retrievals from satellite observations, Mach. Learn., 112, 1337–1363, https://doi.org/10.1007/s10994-022-06155-2, 2023. a
Brodrick, P. G., Thompson, D. R., Fahlen, J. E., Eastwood, M. L., Sarture, C. M., Lundeen, S. R., Olson-Duvall, W., Carmon, N., and Green, R. O.: Generalized radiative transfer emulation for imaging spectroscopy reflectance retrievals, Remote Sens. Environ., 261, 112476, https://doi.org/10.1016/j.rse.2021.112476, 2021. a
Byrne, B., Liu, J., Lee, M., Yin, Y., Bowman, K. W., Miyazaki, K., Norton, A. J., Joiner, J., Pollard, D. F., Griffith, D. W. T., Velazco, V. A., Deutscher, N. M., Jones, N. B., and Paton-Walsh, C.: The Carbon Cycle of Southeast Australia During 2019–2020: Drought, Fires, and Subsequent Recovery, AGU Adv., 2, e2021AV000469, https://doi.org/10.1029/2021AV000469, 2021. a
Chawla, N. V., Bowyer, K. W., Hall, L. O., and Kegelmeyer, W. P.: SMOTE: Synthetic Minority Over-sampling Technique, J. Artif. Intell. Res., 16, 321–357, https://doi.org/10.1613/JAIR.953, 2002. a
Efremenko, D. S., Loyola, D. G., Spurr, R. J., and Doicu, A.: Acceleration of radiative transfer model calculations for the retrieval of trace gases under cloudy conditions, J. Quant. Spectrosc. Ra., 135, 58–65, https://doi.org/10.1016/J.JQSRT.2013.11.014, 2014. a
Fawcett, T.: An introduction to ROC analysis, Pattern Recogn. Lett., 27, 861–874, https://doi.org/10.1016/J.PATREC.2005.10.010, 2006. a
Flach, P., Hernández-Orallo, J., and Ferri, C.: A Coherent Interpretation of AUC as a Measure of Aggregated Classification Performance C'esar Ferri, Proceedings of the 28th International Conference on Machine Learning, International Conference on Machine Learning, 28 June–2 July 2011, Bellevuew, Washington, USA, https://icml.cc/2011/papers/385_icmlpaper.pdf (last access: 10 April 2025), 2011. a
Fu, D., Worden, J. R., Liu, X., Kulawik, S. S., Bowman, K. W., and Natraj, V.: Characterization of ozone profiles derived from Aura TES and OMI radiances, Atmos. Chem. Phys., 13, 3445–3462, https://doi.org/10.5194/acp-13-3445-2013, 2013. a, b, c, d
Fu, D., Bowman, K. W., Worden, H. M., Natraj, V., Worden, J. R., Yu, S., Veefkind, P., Aben, I., Landgraf, J., Strow, L., and Han, Y.: High-resolution tropospheric carbon monoxide profiles retrieved from CrIS and TROPOMI, Atmos. Meas. Tech., 9, 2567–2579, https://doi.org/10.5194/amt-9-2567-2016, 2016. a
Fu, D., Kulawik, S. S., Miyazaki, K., Bowman, K. W., Worden, J. R., Eldering, A., Livesey, N. J., Teixeira, J., Irion, F. W., Herman, R. L., Osterman, G. B., Liu, X., Levelt, P. F., Thompson, A. M., and Luo, M.: Retrievals of tropospheric ozone profiles from the synergism of AIRS and OMI: methodology and validation, Atmos. Meas. Tech., 11, 5587–5605, https://doi.org/10.5194/amt-11-5587-2018, 2018. a, b, c, d, e
Garane, K., Koukouli, M.-E., Verhoelst, T., Lerot, C., Heue, K.-P., Fioletov, V., Balis, D., Bais, A., Bazureau, A., Dehn, A., Goutail, F., Granville, J., Griffin, D., Hubert, D., Keppens, A., Lambert, J.-C., Loyola, D., McLinden, C., Pazmino, A., Pommereau, J.-P., Redondas, A., Romahn, F., Valks, P., Van Roozendael, M., Xu, J., Zehner, C., Zerefos, C., and Zimmer, W.: TROPOMI/S5P total ozone column data: global ground-based validation and consistency with other satellite missions, Atmos. Meas. Tech., 12, 5263–5287, https://doi.org/10.5194/amt-12-5263-2019, 2019. a
GES DISC: TROPESS–MUSES data, NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) [data set], https://daac.gsfc.nasa.gov/datasets?project=TROPESS, last access: 9 April 2025. a
Geurts, P., Ernst, D., and Wehenkel, L.: Extremely randomized trees, Mach Learn, 63, 3–42, https://doi.org/10.1007/s10994-006-6226-1, 2006. a, b
Han, Y., Revercomb, H., Cromp, M., Gu, D., Johnson, D., Mooney, D., Scott, D., Strow, L., Bingham, G., Borg, L., Chen, Y., DeSlover, D., Esplin, M., Hagan, D., Jin, X., Knuteson, R., Motteler, H., Predina, J., Suwinski, L., Taylor, J., Tobin, D., Tremblay, D., Wang, C., Wang, L., Wang, L., and Zavyalov, V.: Suomi NPP CrIS measurements, sensor data record algorithm, calibration and validation activities, and record data quality, J. Geophys. Res.-Atmos., 118, 12734–12748, https://doi.org/10.1002/2013JD020344, 2013. a, b
Hedelt, P., Efremenko, D. S., Loyola, D. G., Spurr, R., and Clarisse, L.: Sulfur dioxide layer height retrieval from Sentinel-5 Precursor/TROPOMI using FP_ILM, Atmos. Meas. Tech., 12, 5503–5517, https://doi.org/10.5194/amt-12-5503-2019, 2019. a
Himes, M. D., Harrington, J., Cobb, A. D., Baydin, A. G., Soboczenski, F., O'Beirne, M. D., Zorzan, S., Wright, D. C., Scheffer, Z., Domagal-Goldman, S. D., and Arney, G. N.: Accurate Machine Learning Atmospheric Retrieval via a Neural Network Surrogate Model for Radiative Transfer, arXiv preprint arXiv:2003.02430, 2020. a
Ingmann, P., Veihelmann, B., Langen, J., Lamarre, D., Stark, H., and Courrèges-Lacoste, G. B.: Requirements for the GMES Atmosphere Service and ESA's implementation concept: Sentinels-4/-5 and -5p, Remote Sens. Environ., 120, 58–69, https://doi.org/10.1016/j.rse.2012.01.023, 2012. a
Iturbide-Sanchez, F., Strow, L., Tobin, D., Chen, Y., Tremblay, D., Knuteson, R. O., Johnson, D. G., Buttles, C., Suwinski, L., Thomas, B. P., Rivera, A. R., Lynch, E., Zhang, K., Wang, Z., Porter, W. D., Jin, X., Predina, J. P., Eresmaa, R. I., Collard, A., Ruston, B., Jung, J. A., Barnet, C. D., Beierle, P. J., Yan, B., Mooney, D., and Revercomb, H.: Recalibration and Assessment of the SNPP CrIS Instrument: A Successful History of Restoration After Midwave Infrared Band Anomaly, IEEE T. Geosci. Remote Sens., 60, 1–21, https://doi.org/10.1109/TGRS.2021.3112400, 2021. a
Jindal, P., Shukla, M. V., Sharma, S. K., and Thapliyal, P. K.: Retrieval of ozone profiles from geostationary infrared sounder observations using principal component analysis, Q. J. Roy. Meteorol. Soc., 142, 3015–3025, https://doi.org/10.1002/qj.2884, 2016. a
Kulawik, S. S., Worden, J., Eldering, A., Bowman, K., Gunson, M., Osterman, G. B., Zhang, L., Clough, S. A., Shephard, M. W., and Beer, R.: Implementation of cloud retrievals for Tropospheric Emission Spectrometer (TES) atmospheric retrievals: part 1. Description and characterization of errors on trace gas retrievals, J. Geophys. Res., 111, D24204, https://doi.org/10.1029/2005JD006733, 2006. a, b
Kulawik, S. S., Worden, J. R., Payne, V. H., Fu, D., Wofsy, S. C., McKain, K., Sweeney, C., Daube Jr., B. C., Lipton, A., Polonsky, I., He, Y., Cady-Pereira, K. E., Dlugokencky, E. J., Jacob, D. J., and Yin, Y.: Evaluation of single-footprint AIRS CH4 profile retrieval uncertainties using aircraft profile measurements, Atmos. Meas. Tech., 14, 335–354, https://doi.org/10.5194/amt-14-335-2021, 2021. a, b, c, d
Levelt, P. F., Oord, G. H. J. V. D., Dobber, M. R., Mälkki, A., Visser, H., Vries, J. D., Stammes, P., Lundell, J. O. V., and Saari, H.: The ozone monitoring instrument, IEEE T. Geosci. Remote Sens., 44, 1093–1100, https://doi.org/10.1109/TGRS.2006.872333, 2006. a
Levelt, P. F., Joiner, J., Tamminen, J., Veefkind, J. P., Bhartia, P. K., Stein Zweers, D. C., Duncan, B. N., Streets, D. G., Eskes, H., van der A, R., McLinden, C., Fioletov, V., Carn, S., de Laat, J., DeLand, M., Marchenko, S., McPeters, R., Ziemke, J., Fu, D., Liu, X., Pickering, K., Apituley, A., González Abad, G., Arola, A., Boersma, F., Chan Miller, C., Chance, K., de Graaf, M., Hakkarainen, J., Hassinen, S., Ialongo, I., Kleipool, Q., Krotkov, N., Li, C., Lamsal, L., Newman, P., Nowlan, C., Suleiman, R., Tilstra, L. G., Torres, O., Wang, H., and Wargan, K.: The Ozone Monitoring Instrument: overview of 14 years in space, Atmos. Chem. Phys., 18, 5699–5745, https://doi.org/10.5194/acp-18-5699-2018, 2018. a
Liu, C., Yao, B., Natraj, V., Weng, F., Le, T., Shia, R. L., and Yung, Y. L.: A Spectral Data Compression (SDCOMP) Radiative Transfer Model for High-Spectral-Resolution Radiation Simulations, J. Atmos. Sci., 77, 2055–2066, https://doi.org/10.1175/JAS-D-19-0238.1, 2020. a
Loyola, D. G., Xu, J., Heue, K.-P., and Zimmer, W.: Applying FP_ILM to the retrieval of geometry-dependent effective Lambertian equivalent reflectivity (GE_LER) daily maps from UVN satellite measurements, Atmos. Meas. Tech., 13, 985–999, https://doi.org/10.5194/amt-13-985-2020, 2020. a, b
Luo, M., Read, W., Kulawik, S., Worden, J., Livesey, N., Bowman, K., and Herman, R.: Carbon monoxide (CO) vertical profiles derived from joined TES and MLS measurements, J. Geophys. Res.-Atmos., 118, 10601–10613, https://doi.org/10.1002/JGRD.50800, 2013. a, b
Malina, E., Bowman, K. W., Kantchev, V., Kuai, L., Kurosu, T. P., Miyazaki, K., Natraj, V., Osterman, G. B., Oyafuso, F., and Thill, M. D.: Joint spectral retrievals of ozone with Suomi NPP CrIS augmented by S5P/TROPOMI, Atmos. Meas. Tech., 17, 5341–5371, https://doi.org/10.5194/amt-17-5341-2024, 2024. a, b, c, d
Mandrake, L., Frankenberg, C., O'Dell, C. W., Osterman, G., Wennberg, P., and Wunch, D.: Semi-autonomous sounding selection for OCO-2, Atmos. Meas. Tech., 6, 2851–2864, https://doi.org/10.5194/amt-6-2851-2013, 2013. a
Mauceri, S., O’Dell, C. W., McGarragh, G., and Natraj, V.: Radiative Transfer Speed-Up Combining Optimal Spectral Sampling With a Machine Learning Approach, Front. Remote Sens., 0, 66, https://doi.org/10.3389/FRSEN.2022.932548, 2022. a
Mendonca, J., Nassar, R., O'Dell, C. W., Kivi, R., Morino, I., Notholt, J., Petri, C., Strong, K., and Wunch, D.: Assessing the feasibility of using a neural network to filter Orbiting Carbon Observatory 2 (OCO-2) retrievals at northern high latitudes, Atmos. Meas. Tech., 14, 7511–7524, https://doi.org/10.5194/amt-14-7511-2021, 2021. a, b
Miyazaki, K., Bowman, K., Sekiya, T., Eskes, H., Boersma, F., Worden, H., Livesey, N., Payne, V. H., Sudo, K., Kanaya, Y., Takigawa, M., and Ogochi, K.: Updated tropospheric chemistry reanalysis and emission estimates, TCR-2, for 2005–2018, Earth Syst. Sci. Data, 12, 2223–2259, https://doi.org/10.5194/essd-12-2223-2020, 2020a. a
Miyazaki, K., Bowman, K. W., Yumimoto, K., Walker, T., and Sudo, K.: Evaluation of a multi-model, multi-constituent assimilation framework for tropospheric chemical reanalysis, Atmos. Chem. Phys., 20, 931–967, https://doi.org/10.5194/acp-20-931-2020, 2020b. a
Miyazaki, K., Bowman, K., Sekiya, T., Takigawa, M., Neu, J. L., Sudo, K., Osterman, G., and Eskes, H.: Global tropospheric ozone responses to reduced NOx emissions linked to the COVID-19 worldwide lockdowns, Sci. Adv., 7, https://doi.org/10.1126/sciadv.abf7460, 2021. a
Moore III, B., Crowell, S. M. R., Rayner, P. J., Kumer, J., O'Dell, C. W., O'Brien, D., Utembe, S., Polonsky, I., Schimel, D., and Lemen, J.: The Potential of the Geostationary Carbon Cycle Observatory (GeoCarb) to Provide Multi-scale Constraints on the Carbon Cycle in the Americas, Front. Environ. Sci., 6, 109, https://doi.org/10.3389/fenvs.2018.00109, 2018. a
NASES: Thriving on Our Changing Planet: A Decadal Strategy for Earth Observation from Space, National Academies Press, Washington DC, https://doi.org/10.17226/24938, 2018. a
Nassar, R., McLinden, C., Sioris, C. E., McElroy, C. T., Mendonca, J., Tamminen, J., MacDonald, C. G., Adams, C., Boisvenue, C., Bourassa, A., Cooney, R., Degenstein, D., Drolet, G., Garand, L., Girard, R., Johnson, M., Jones, D. B., Kolonjari, F., Kuwahara, B., Martin, R. V., Miller, C. E., O'Neill, N., Riihelä, A., Roche, S., Sander, S. P., Simpson, W. R., Singh, G., Strong, K., Trishchenko, A. P., van Mierlo, H., Zanjani, Z. V., Walker, K. A., and Wunch, D.: The Atmospheric Imaging Mission for Northern Regions: AIM-North, Can. J. Remote Sens., 45, 423–442, https://doi.org/10.1080/07038992.2019.1643707, 2019. a
Natraj, V., Jiang, X., Shia, R. L., Huang, X., Margolis, J. S., and Yung, Y. L.: Application of principal component analysis to high spectral resolution radiative transfer: A case study of the O2 A band, J. Quant. Spectrosc. Ra., 95, 539–556, https://doi.org/10.1016/J.JQSRT.2004.12.024, 2005. a
Natraj, V., Shia, R. L., and Yung, Y. L.: On the use of principal component analysis to speed up radiative transfer calculations, J. Quant. Spectrosc. Ra., 111, 810–816, https://doi.org/10.1016/J.JQSRT.2009.11.004, 2010. a
Natraj, V., Liu, X., Kulawik, S., Chance, K., Chatfield, R., Edwards, D. P., Eldering, A., Francis, G., Kurosu, T., Pickering, K., Spurr, R., and Worden, H.: Multi-spectral sensitivity studies for the retrieval of tropospheric and lowermost tropospheric ozone from simulated clear-sky GEO-CAPE measurements, Atmos. Environ., 45, 7151–7165, https://doi.org/10.1016/j.atmosenv.2011.09.014, 2011. a
Natraj, V., Luo, M., Blavier, J.-F., Payne, V. H., Posselt, D. J., Sander, S. P., Zeng, Z.-C., Neu, J. L., Tremblay, D., Wu, L., Roman, J. A., Wu, Y.-H., and Dorsky, L. I.: Simulated multispectral temperature and atmospheric composition retrievals for the JPL GEO-IR Sounder, Atmos. Meas. Tech., 15, 1251–1267, https://doi.org/10.5194/amt-15-1251-2022, 2022. a
Nicks, D., Baker, B., Lasnik, J., Delker, T., Chance, K., Liu, X., Flittner, D., Kim, J., and Howell, J.: Hyperspectral remote sensing of air pollution from geosynchronous orbit with GEMS and TEMPO, in: Earth Observing Missions and Sensors: Development, Implementation, and Characterization V, edited by: Xiong, X. and Kimura, T., Vol. 10781, p. 30, SPIE, ISBN 9781510621374, ISSN 1996756X, https://doi.org/10.1117/12.2324781, 2018. a
NOAA: Geostationary and Extended Orbits (GeoXO) NOAA SATELLITE AND INFORMATION SERVICE | GOES-R SERIES PROGRAM OFFICE FACT SHEET, https://www.nesdis.noaa.gov/GeoXO (last access: 10 April 2025), 2025. a
Noël, S., Reuter, M., Buchwitz, M., Borchardt, J., Hilker, M., Schneising, O., Bovensmann, H., Burrows, J. P., Di Noia, A., Parker, R. J., Suto, H., Yoshida, Y., Buschmann, M., Deutscher, N. M., Feist, D. G., Griffith, D. W. T., Hase, F., Kivi, R., Liu, C., Morino, I., Notholt, J., Oh, Y.-S., Ohyama, H., Petri, C., Pollard, D. F., Rettinger, M., Roehl, C., Rousogenous, C., Sha, M. K., Shiomi, K., Strong, K., Sussmann, R., Té, Y., Velazco, V. A., Vrekoussis, M., and Warneke, T.: Retrieval of greenhouse gases from GOSAT and GOSAT-2 using the FOCAL algorithm, Atmos. Meas. Tech., 15, 3401–3437, https://doi.org/10.5194/amt-15-3401-2022, 2022. a
Olson, R. S., Bartley, N., Urbanowicz, R. J., and Moore, J. H.: Evaluation of a tree-based pipeline optimization tool for automating data science, GECCO 2016 – Proceedings of the 2016 Genetic and Evolutionary Computation Conference, 485–492 pp., https://doi.org/10.1145/2908812.2908918, 2016. a
Pal, A., Mahajan, S., and Norman, M. R.: Using deep neural networks as cost-effective surrogate models for super-parameterized E3SM radiative transfer, Geophys. Res. Lett., 46, 6069–6079, 2019. a
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E.: Scikit-learn: Machine Learning in Python, J. Mach. Learn. Res., 12, 2825–2830, 2011. a
Petković, M., Kocev, D., and Džeroski, S.: Feature ranking for multi-target regression, Mach. Learn., 109, 1179–1204, https://doi.org/10.1007/s10994-019-05829-8, 2020. a
Rivera, J. P., Verrelst, J., Gómez-Dans, J., Muñoz-Marí, J., Moreno, J., and Camps-Valls, G.: An emulator toolbox to approximate radiative transfer models with statistical learning, Remote Sens., 7, 9347–9370, https://doi.org/10.3390/rs70709347, 2015. a
Rodgers, C. D.: Inverse Methods for Atmospheric Sounding – Theory and Practice, vol. 2, World Scientific, ISBN 9789812813718, https://doi.org/10.1142/9789812813718, 2000. a, b, c
Somkuti, P., Boesch, H., Natraj, V., and Kopparla, P.: Application of a PCA-Based Fast Radiative Transfer Model to XCO2 Retrievals in the Shortwave Infrared, J. Geophys. Res.-Atmos., 122, 10477–10496, https://doi.org/10.1002/2017JD027013, 2017. a
Spurr, R. J.: VLIDORT: A linearized pseudo-spherical vector discrete ordinate radiative transfer code for forward model and retrieval studies in multilayer multiple scattering media, J. Quant. Spectrosc. Ra., 102, 316–342, https://doi.org/10.1016/j.jqsrt.2006.05.005, 2006. a
Szopa, S., Naik, V., Adhikary, B., Artaxo, P., Berntsen, T., Collins, W. D., Fuzzi, S., Gallardo, L., Scharr, A. K., Klimont, Z., Liao, H., Unger, N., and Zanis, P.: Short-Lived Climate Forcers, in: Climate Change 2021: The Physical Science Basis, Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 817–922, https://doi.org/10.1017/9781009157896.008, 2021. a, b
TROPESS: TROPESS | Data Products, https://tes.jpl.nasa.gov/tropess/get-data/products/ (last access: 10 April 2025), 2025. a
Van Damme, M., Whitburn, S., Clarisse, L., Clerbaux, C., Hurtmans, D., and Coheur, P.-F.: Version 2 of the IASI NH3 neural network retrieval algorithm: near-real-time and reanalysed datasets, Atmos. Meas. Tech., 10, 4905–4914, https://doi.org/10.5194/amt-10-4905-2017, 2017. a
Worden, J.: Predicted errors of tropospheric emission spectrometer nadir retrievals from spectral window selection, J. Geophys. Res., 109, D09308, https://doi.org/10.1029/2004JD004522, 2004. a
Worden, J., Liu, X., Bowman, K., Chance, K., Beer, R., Eldering, A., Gunson, M., and Worden, H.: Improved tropospheric ozone profile retrievals using OMI and TES radiances, Geophys. Res. Lett., 34, L01809, https://doi.org/10.1029/2006GL027806, 2007. a, b, c, d
Worden, J., Kulawik, S., Frankenberg, C., Payne, V., Bowman, K., Cady-Peirara, K., Wecht, K., Lee, J.-E., and Noone, D.: Profiles of CH4, HDO, H2O, and N2O with improved lower tropospheric vertical resolution from Aura TES radiances, Atmos. Meas. Tech., 5, 397–411, https://doi.org/10.5194/amt-5-397-2012, 2012. a
Worden, J. R., Kulawik, S. S., Fu, D., Payne, V. H., Lipton, A. E., Polonsky, I., He, Y., Cady-Pereira, K., Moncet, J.-L., Herman, R. L., Irion, F. W., and Bowman, K. W.: Characterization and evaluation of AIRS-based estimates of the deuterium content of water vapor, Atmos. Meas. Tech., 12, 2331–2339, https://doi.org/10.5194/amt-12-2331-2019, 2019. a
Zoogman, P., Liu, X., Suleiman, R. M., Pennington, W. F., Flittner, D. E., Al-Saadi, J. A., Hilton, B. B., Nicks, D. K., Newchurch, M. J., Carr, J. L., Janz, S. J., Andraschko, M. R., Arola, A., Baker, B. D., Canova, B. P., Chan Miller, C., Cohen, R. C., Davis, J. E., Dussault, M. E., Edwards, D. P., Fishman, J., Ghulam, A., González Abad, G., Grutter, M., Herman, J. R., Houck, J., Jacob, D. J., Joiner, J., Kerridge, B. J., Kim, J., Krotkov, N. A., Lamsal, L., Li, C., Lindfors, A., Martin, R. V., McElroy, C. T., McLinden, C., Natraj, V., Neil, D. O., Nowlan, C. R., O'Sullivan, E. J., Palmer, P. I., Pierce, R. B., Pippin, M. R., Saiz-Lopez, A., Spurr, R. J., Szykman, J. J., Torres, O., Veefkind, J. P., Veihelmann, B., Wang, H., Wang, J., and Chance, K.: Tropospheric emissions: Monitoring of pollution (TEMPO), J. Quant. Spectrosc. Ra., 186, 17–39, https://doi.org/10.1016/j.jqsrt.2016.05.008, 2017. a
Short summary
The large fleet of Earth observation satellites in orbit currently generate huge volumes of data, requiring significant computational resources to process these data in a timely manner. We present a method for predicting poor-quality measurements using machine learning. We find that machine learning methods can accurately predict poor-quality measurements and remove them from the processing chain, saving time and computational resources.
The large fleet of Earth observation satellites in orbit currently generate huge volumes of...
