References

AMT

Atmospheric Measurement Techniques

AMT

Atmos. Meas. Tech.

1867-8548

Copernicus Publications

Göttingen, Germany

10.5194/amt-7-523-2014

Insights into Tikhonov regularization: application to trace gas column retrieval and the efficient calculation of total column averaging kernels

Borsdorff

https://orcid.org/0000-0002-4421-0187

¹ Hasekamp

O. P.

¹ Wassmann

¹ Landgraf

SRON – Netherlands Institute for Space Research, Utrecht, the Netherlands

14 02 2014

7 2 523 535

2014

This work is licensed under the Creative Commons Attribution 3.0 Unported License. To view a copy of this licence, visit https://creativecommons.org/licenses/by/3.0/

This article is available from https://amt.copernicus.org/articles/7/523/2014/amt-7-523-2014.html

The full text article is available as a PDF file from https://amt.copernicus.org/articles/7/523/2014/amt-7-523-2014.pdf

Insights are given into Tikhonov regularization and its application to the retrieval of vertical column densities of atmospheric trace gases from remote sensing measurements. The study builds upon the equivalence of the least-squares profile-scaling approach and Tikhonov regularization method of the first kind with an infinite regularization strength. Here, the vertical profile is expressed relative to a reference profile. On the basis of this, we propose a new algorithm as an extension of the least-squares profile scaling which permits the calculation of total column averaging kernels on arbitrary vertical grids using an analytic expression. Moreover, we discuss the effective null space of the retrieval, which comprises those parts of a vertical trace gas distribution which cannot be inferred from the measurements. Numerically the algorithm can be implemented in a robust and efficient manner. In particular for operational data processing with challenging demands on processing time, the proposed inversion method in combination with highly efficient forward models is an asset. For demonstration purposes, we apply the algorithm to CO column retrieval from simulated measurements in the 2.3 μm spectral region and to O3 column retrieval from the UV. These represent ideal measurements of a series of spaceborne spectrometers such as SCIAMACHY, TROPOMI, GOME, and GOME-2. For both spectral ranges, we consider clear-sky and cloudy scenes where clouds are modelled as an elevated Lambertian surface. Here, the smoothing error for the clear-sky and cloudy atmosphere is significant and reaches several percent, depending on the reference profile which is used for scaling. This underlines the importance of the column averaging kernel for a proper interpretation of retrieved column densities. Furthermore, we show that the smoothing due to regularization can be underestimated by calculating the column averaging kernel on a too coarse vertical grid. For both retrievals, this effect becomes negligible for a vertical grid with 20–40 equally thick layers between 0 and 50 km.

References 1

Angelbratt, J., Mellqvist, J., Blumenstock, T., Borsdorff, T., Brohede, S., Duchatelet, P., Forster, F., Hase, F., Mahieu, E., Murtagh, D., Petersen, A. K., Schneider, M., Sussmann, R., and Urban, J.: A new method to detect long term trends of methane (CH4) and nitrous oxide (N2O) total columns measured within the NDACC ground-based high resolution solar FTIR network, Atmos. Chem. Phys., 11, 6167–6183, <a href="http://dx.doi.org/10.5194/acp-11-6167-2011">https://doi.org/10.5194/acp-11-6167-2011</a>, 2011.

Barret, B., de Mazière, M., and Demoulin, P.: Retrieval and characterization of ozone profiles from solar infrared spectra at the Jungfraujoch, J. Geophys. Res., 107, 4788, <a href="http://dx.doi.org/10.1029/2001JD001298">https://doi.org/10.1029/2001JD001298</a>, 2002.

Bhartia, P. K., McPeters, R. D., Flynn, L. E., Taylor, S., Kramarova, N. A., Frith, S., Fisher, B., and DeLand, M.: Solar Backscatter UV (SBUV) total ozone and profile algorithm, Atmos. Meas. Tech., 6, 2533–2548, <a href="http://dx.doi.org/10.5194/amt-6-2533-2013">https://doi.org/10.5194/amt-6-2533-2013</a>, 2013.

Borsdorff, T. and Sussmann, R.: On seasonality of stratomesospheric CO above midlatitudes: New insight from solar FTIR spectrometry at Zugspitze and Garmisch, Geophys. Res. Lett., 36, L21804, <a href="http://dx.doi.org/10.1029/2009GL040056">https://doi.org/10.1029/2009GL040056</a>, 2009.

Bovensmann, H., Burrows, J. P., Buchwitz, M., Frerick, J., Noël, S., Rozanov, V. V., Chance, K. V., and Goedec, A. P. H.: SCIAMACHY: Mission Objectives and Measurement Modes, J. Atmos. Sci., 56, 127–150, 1999.

Brion, J., Chakir, A., Daumont, D., Malicet, J., and Parisse, C.: High-resolution laboratory absorption cross section of O3, Temperature effect, Chem. Phys. Lett., 213, 610–612, <a href="http://dx.doi.org/10.1016/0009-2614(93)89169-I">https://doi.org/10.1016/0009-2614(93)89169-I</a>, 1993.

Buchwitz, M. and Burrows, J. P.: Retrieval of CH4, CO and CO2 total column amounts from SCIAMACHY near-infrared nadir spectra: Retrieval algorithm and first results, Remote Sensing of Clouds and the Atmosphere VIII, Proc. SPIE, 5235, 375–388, 2004.

Burrows, J. P., Weber, M., Buchwitz, M., Rozanov, V., Ladstäter-Weißenmayer, A., Richter, A., DeBeek, R., Hoogen, R., Bramstedt, K., Eichmann, K. U., Eisinger, M., and Perner, D.: The global monitoring experiment (GOME): Mission concept and first scientific results, J. Atmos. Sci., 56, 151–175, <a href="http://dx.doi.org/10.1175/1520-0469(1999)056<0151:TGOMEG>2.0.CO;2">https://doi.org/10.1175/1520-0469(1999)056<0151:TGOMEG>2.0.CO;2</a>, 1999.

Butz, A., Guerlet, S., Hasekamp, O., Schepers, A. G., Aben, I., Frankenberg, C., Hartmann, J. M., Tran, H., Kuze, A., Keppel-Aleks, G. T., Wunch, D., Wennberg, P., Deutscher, N., Griffith, D., Macatangay, R., Messerschmidt, J., Notholt, J., and Warneke, T.: Toward accurate CO2 and CH4 observations from GOSAT, Geophys. Res. Lett., 38, L14812, <a href="http://dx.doi.org/10.1029/2011GL047888">https://doi.org/10.1029/2011GL047888</a>, 2011.

Callies, J., Corpaccioli, E., Eisinger, M., Hahne, A., and Lefebvre, A.: GOME-2 – Metop's Second Generation Sensor for Operational Ozone Monitoring, ESA Bulletin, 102, ESTEC, Noordwijk, the Netherlands, 2000.

Eskes, H. J. and Boersma, K. F.: Averaging kernels for DOAS total-column satellite retrievals, Atmos. Chem. Phys., 3, 1285–1291, <a href="http://dx.doi.org/10.5194/acp-3-1285-2003">https://doi.org/10.5194/acp-3-1285-2003</a>, 2003.

Eskes, H. J., van der A, R. J., Brinksma, E. J., Veefkind, J. P., de Haan, J. F., and Valks, P. J. M.: Retrieval and validation of ozone columns derived from measurements of SCIAMACHY on Envisat, Atmos. Chem. Phys. Discuss., 5, 4429–4475, <a href="http://dx.doi.org/10.5194/acpd-5-4429-2005">https://doi.org/10.5194/acpd-5-4429-2005</a>, 2005.

Frankenberg, C., Platt, U., and Wagner, T.: Retrieval of CO from SCIAMACHY onboard ENVISAT: detection of strongly polluted areas and seasonal patterns in global CO abundances, Atmos. Chem. Phys., 5, 1639–1644, <a href="http://dx.doi.org/10.5194/acp-5-1639-2005">https://doi.org/10.5194/acp-5-1639-2005</a>, 2005.

Frankenberg, C., Meirink, J. F., Bergamaschi, P., Goede, A. P. H., Heimann, M., Köner, S., Platt, U., Weele, M. V., and Wagner, T.: Satellite chartography of atmospheric methane from SCIAMACHY on board ENVISAT: analysis of the years 2003 and 2004, J. Geophys. Res., 111, D07303, <a href="http://dx.doi.org/10.1029/2005JD006235">https://doi.org/10.1029/2005JD006235</a>, 2006.

Frankenberg, C., Fisher, J. B., Worden, J., Badgley, G., Saatchi, S. S., Lee, J., Toon, G. C., Butz, A., Jung, M., Kuze, A., and Yokota, T.: New global observations of the terrestrial carbon cycle from GOSAT: Patterns of plant fluorescence with gross primary productivity, J. Geophys. Res., 38, L17706, <a href="http://dx.doi.org/10.1029/2011GL048738">https://doi.org/10.1029/2011GL048738</a>, 2011.

Gloudemans, A. M. S., Schrijver, H., Hasekamp, O. P., and Aben, I.: Error analysis for CO and CH4 total column retrievals from SCIAMACHY 2.3 μm spectra, Atmos. Chem. Phys., 8, 3999–4017, 2008.

Griesfeller, A., Griesfeller, J., Hase, F., Blumenstock, T., and Nakajima, H.: Comparison of ILAS-II Data With Ground-based FTIR Measurements of O3, HNO3, N2O, and CH4 Over Kiruna, Sweden, AGU Fall Meeting Abstracts, p. C950, 2005.

Hansen, C.: Analysis of discrete ill-posed problems by means of the L-curve, Soc. Indust. Appl. Math., 34, 561–580, 1992.

Hansen, C.: The use of the L-curve in the regularization of discrete ill-posed problems, SIAM J. Sci. Comput., 14, 1487–1503, <a href="http://dx.doi.org/10.1137/0914086">https://doi.org/10.1137/0914086</a>, 1993.

Hansen, C.: Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, 1998.

Hasekamp, O. P. and Landgraf, J.: Ozone profile retrieval from backscattered ultraviolet radiances: The inverse problem solved by regularization, J. Geophys. Res.-Atmos., 106, 8077–8088, <a href="http://dx.doi.org/10.1029/2000JD900692">https://doi.org/10.1029/2000JD900692</a>, 2001.

Lerot, C., van Roozendael, M., Lambert, J. C., Granville, J., van Gent, J., Loyola, D., and Spurr, R.: The GODFIT algorithm: a direct fitting approach to improve the accuracy of total ozone measurements from GOME, Int. J. Remote Sens., 31, 543–550, <a href="http://dx.doi.org/10.1080/01431160902893576">https://doi.org/10.1080/01431160902893576</a>, 2010.

Levelt, P. F., van den Oord, G. H. J., Dobber, M. R., Malkki, A., Visser, H., de Vries, J., Stammes, P., Lundell, J. O. V., and Saari, H.: The ozone monitoring instrument, IEEE T. Geosci. Remote, 44, 1093–1101, <a href="http://dx.doi.org/10.1109/TGRS.2006.872333">https://doi.org/10.1109/TGRS.2006.872333</a>, 2006.

Levelt, P. F., Veefkind, J. P., Kerridge, B. J., Siddans, R., de Leeuw, G., Remedios, J., and Coheur, P. F.: Observation Techniques and Mission Concepts for Atmospheric Chemistry (CAMELOT), Report 20533/07NL/HE, European Space Agency, Noordwijk, The Netherlands, 2009.

Marshak, A., Davis, A., Wiscombe, W., and Titov, G.: The Verisimilitude of the Independent Pixel Approximation Used in Cloud Remote Sensing, Remote Sens. Environ., 52, 71–78, 1995.

NOAA: U.S. Standard Atmosphere, 1976, Report NOAA-S/T76-1562, National Oceanic and Atmospheric Administration, US Gov. Printing Office, Washington, DC, 1976.

Notholt, J., Toon, G. C., Rinsland, C. P., Pougatchev, N. S., Jones, N. B., Connor, B. J., Weller, R., Gautrois, M., and Schrems, O.: Latitudinal variations of trace gas concentrations in the free troposphere measured by solar absorption spectroscopy during a ship cruise, J. Geophys. Res., 105, 1337–1350, <a href="http://dx.doi.org/10.1029/1999JD900940">https://doi.org/10.1029/1999JD900940</a>, 2000.

Phillips, B. C.: A technique for the numerical solution of certain integral equations of the first kind, J. Ass. Comput. Mach., 9, 84–97, <a href="http://dx.doi.org/10.1145/321105.321114">https://doi.org/10.1145/321105.321114</a>, 1962.

Pougatchev, N. S. and Rinsland, C. P.: Spectroscopic study of the seasonal variation of carbon monoxide vertical distribution above Kitt Peak, J. Geophys. Res., 100, 1409–1416, <a href="http://dx.doi.org/10.1029/94JD02387">https://doi.org/10.1029/94JD02387</a>, 1995.

Richter, A. and Burrows, J. P.: Tropospheric NO2 from GOME measurements, Adv. Space Res., 29, 1673–1683, <a href="http://dx.doi.org/10.1016/S0273-1177(02)00100-X">https://doi.org/10.1016/S0273-1177(02)00100-X</a>, 2002.

Rinsland, C. P., Jones, N. B., Connor, B. J., Wood, S. W., Goldman, A., Stephen, T. M., Murcray, F. J., Chiou, L. S., Zander, R., and Mahieu, E.: Multiyear infrared solar spectroscopic measurements of HCN, CO, C2H6, and C2H2 tropospheric columns above Lauder, New Zealand (45° S latitude), J. Geophys. Res., 107, 4185, <a href="http://dx.doi.org/10.1029/2001JD001150">https://doi.org/10.1029/2001JD001150</a>, 2002.

Rodgers, C. D.: Inverse Methods for Atmospheres: Theory and Practice, Vol. 2, World Scientific, Singapore, New Jersey, London, Hong Kong, 2000.

Rodgers, C. D. and Connor, B. J.: Intercomparison of remote sounding instruments, J. Geophys. Res., 108, 4116, <a href="http://dx.doi.org/10.1029/2002JD002299">https://doi.org/10.1029/2002JD002299</a>, 2003.

Rothman, L. S., Barbe, A., Benner, D. C., Brown, L. R., Camy-Peyret, C., Carleer, M. R., Chance, K., Clerbaux, C., Dana, V., Devi, V. M., Fayt, A., Flaud, J.-M., Gamache, R. R., Goldman, A., Jacquemart, D., Jucks, K. W., Lafferty, W. J., Mandin, J.-Y., Massie, S. T., Nemtchinov, V., Newnham, D. A., Perrin, A., Rinsland, C. P., Schroeder, J., Smith, K. M., Smith, M. A. H., Tang, K., Toth, R. A., Vander Auwera, J., Varanasi, P., and Yoshino, K.: The HITRAN molecular spectroscopic database: edition of 2000 including updates through 2001, J. Quant. Spectrosc. Ra., 82, 5–44, <a href="http://dx.doi.org/10.1016/S0022-4073(03)00146-8">https://doi.org/10.1016/S0022-4073(03)00146-8</a>, 2003.

Schepers, D., Guerlet, S., Butz, A., Landgraf, J., Frankenberg, C., Hasekamp, O., Blavier, J. F., Deutscher, N. M., Griffith, D. W. T., Hase, F., Kyro, E., Morino, I., Sherlock, V., Sussmann, R., and Aben, I.: Methane retrievals from Greenhouse Gases Observing Satellite (GOSAT) shortwave infrared measurements: Performance comparison of proxy and physics retrieval algorithms, J. Geophys. Res., 117, D10307, <a href="http://dx.doi.org/10.1029/2012JD017549">https://doi.org/10.1029/2012JD017549</a>, 2012.

Schneider, M., Hase, F., Blumenstock, T., Redondas, A., and Cuevas, E.: Quality assessment of O3 profiles measured by a state-of-the-art ground-based FTIR observing system, Atmos. Chem. Phys., 8, 5579–5588, <a href="http://dx.doi.org/10.5194/acp-8-5579-2008">https://doi.org/10.5194/acp-8-5579-2008</a>, 2008.

Sussmann, R. and Borsdorff, T.: Technical Note: Interference errors in infrared remote sounding of the atmosphere, Atmos. Chem. Phys., 7, 3537–3557, <a href="http://dx.doi.org/10.5194/acp-7-3537-2007">https://doi.org/10.5194/acp-7-3537-2007</a>, 2007.

Tikhonov, A.: On the solution of incorrectly stated problems and a method of regularization, Dokl. Acad. Nauk SSSR, 151, 501–504, 1963a.

Tikhonov, A.: On the regularization of ill-posed problems, Dokl. Acad. Nauk SSSR, 153, 49–52, 1963b.

Twomey, S.: On the numerical solution of Fredholm integral equations of the first kind by the inversion of the linear system produced by quadrature, J. Ass. Comput. Mach., 10, 97–101, <a href="http://dx.doi.org/10.1145/321150.321157">https://doi.org/10.1145/321150.321157</a>, 1963.

Veefkind, J. P., Aben, I., McMullan, K., Forster, H., de Vries, J., Otter, G., Claas, J., Eskes, H. J., de Haan, J. F., Kleipool, Q., van Weele, M., Hasekamp, O., Hoogeveen, R., Landgraf, J., Snel, R., Tol, P., Ingmann, P., Voors, R., Kruizinga, B., Vink, R., Visser, H., and Levelt, P. F.: TROPOMI on the ESA Sentinel-5 Precursor: A GMES mission for global observations of the atmospheric composition for climate, air quality and ozone layer applications, Remote Sens. Environ., 120, 70–83, <a href="http://dx.doi.org/10.1016/j.rse.2011.09.027">https://doi.org/10.1016/j.rse.2011.09.027</a>, 2012.

Vigouroux, C., De Mazière, M., Errera, Q., Chabrillat, S., Mahieu, E., Duchatelet, P., Wood, S., Smale, D., Mikuteit, S., Blumenstock, T., Hase, F., and Jones, N.: Comparisons between ground-based FTIR and MIPAS N2O and HNO3 profiles before and after assimilation in BASCOE, Atmos. Chem. Phys., 7, 377–396, <a href="http://dx.doi.org/10.5194/acp-7-377-2007">https://doi.org/10.5194/acp-7-377-2007</a>, 2007.

von Clarmann, T. and Grabowski, U.: Elimination of hidden a priori information from remotely sensed profile data, Atmos. Chem. Phys., 7, 397–408, <a href="http://dx.doi.org/10.5194/acp-7-397-2007">https://doi.org/10.5194/acp-7-397-2007</a>, 2007.

Washenfelder, R. A., Wennberg, P. O., and Toon, G. C.: Tropospheric methane retrieved from ground based near IR solar absorption spectra, Geophys. Res. Lett., 30, 2226, <a href="http://dx.doi.org/10.1029/2003GL017969">https://doi.org/10.1029/2003GL017969</a>, 2003.

Wunch, D., Toon, G. C., Wennberg, P. O., Wofsy, S. C., Stephens, B. B., Fischer, M. L., Uchino, O., Abshire, J. B., Bernath, P., Biraud, S. C., Blavier, J.-F. L., Boone, C., Bowman, K. P., Browell, E. V., Campos, T., Connor, B. J., Daube, B. C., Deutscher, N. M., Diao, M., Elkins, J. W., Gerbig, C., Gottlieb, E., Griffith, D. W. T., Hurst, D. F., Jiménez, R., Keppel-Aleks, G., Kort, E. A., Macatangay, R., Machida, T., Matsueda, H., Moore, F., Morino, I., Park, S., Robinson, J., Roehl, C. M., Sawa, Y., Sherlock, V., Sweeney, C., Tanaka, T., and Zondlo, M. A.: Calibration of the Total Carbon Column Observing Network using aircraft profile data, Atmos. Meas. Tech., 3, 1351–1362, <a href="http://dx.doi.org/10.5194/amt-3-1351-2010">https://doi.org/10.5194/amt-3-1351-2010</a>, 2010.

Yang, Z., Toon, G. C., Margolis, J. S., and Wennberg, P. O.: Atmospheric CO2 retrieved from ground-based near IR solar spectra, Geophys. Res. Lett., 29, 1339, <a href="http://dx.doi.org/10.1029/2001GL014537">https://doi.org/10.1029/2001GL014537</a>, 2002.

Yurganov, L. N., Blumenstock, T., Grechko, E. I., Hase, F., Hyer, E. J., Kasischke, E. S., Koike, M., Kondo, Y., Kramer, I., Leung, F.-Y., Mahieu, E., Mellqvist, J., Notholt, J., Novelli, P. C., Rinsland, C. P., Scheel, H. E., Schulz, A., Strandberg, A., Sussmann, R., Tanimoto, H., Velazco, V., Zander, R., and Zhao, Y.: A quantitative assessment of the 1998 carbon monoxide emission anomaly in the Northern Hemisphere based on total column and surface concentration measurements, J. Geophys. Res., 109, D15305, <a href="http://dx.doi.org/10.1029/2004JD004559">https://doi.org/10.1029/2004JD004559</a>, 2004.

Yurganov, L. N., Duchatelet, P., Dzhola, A. V., Edwards, D. P., Hase, F., Kramer, I., Mahieu, E., Mellqvist, J., Notholt, J., Novelli, P. C., Rockmann, A., Scheel, H. E., Schneider, M., Schulz, A., Strandberg, A., Sussmann, R., Tanimoto, H., Velazco, V., Drummond, J. R., and Gille, J. C.: Increased Northern Hemispheric carbon monoxide burden in the troposphere in 2002 and 2003 detected from the ground and from space, Atmos. Chem. Phys., 5, 563–573, <a href="http://dx.doi.org/10.5194/acp-5-563-2005">https://doi.org/10.5194/acp-5-563-2005</a>, 2005.