Articles | Volume 11, issue 12
https://doi.org/10.5194/amt-11-6539-2018
https://doi.org/10.5194/amt-11-6539-2018
Research article
 | 
11 Dec 2018
Research article |  | 11 Dec 2018

Improved retrievals of carbon dioxide from Orbiting Carbon Observatory-2 with the version 8 ACOS algorithm

Christopher W. O'Dell, Annmarie Eldering, Paul O. Wennberg, David Crisp, Michael R. Gunson, Brendan Fisher, Christian Frankenberg, Matthäus Kiel, Hannakaisa Lindqvist, Lukas Mandrake, Aronne Merrelli, Vijay Natraj, Robert R. Nelson, Gregory B. Osterman, Vivienne H. Payne, Thomas E. Taylor, Debra Wunch, Brian J. Drouin, Fabiano Oyafuso, Albert Chang, James McDuffie, Michael Smyth, David F. Baker, Sourish Basu, Frédéric Chevallier, Sean M. R. Crowell, Liang Feng, Paul I. Palmer, Mavendra Dubey, Omaira E. García, David W. T. Griffith, Frank Hase, Laura T. Iraci, Rigel Kivi, Isamu Morino, Justus Notholt, Hirofumi Ohyama, Christof Petri, Coleen M. Roehl, Mahesh K. Sha, Kimberly Strong, Ralf Sussmann, Yao Te, Osamu Uchino, and Voltaire A. Velazco
Abstract

Since September 2014, NASA's Orbiting Carbon Observatory-2 (OCO-2) satellite has been taking measurements of reflected solar spectra and using them to infer atmospheric carbon dioxide levels. This work provides details of the OCO-2 retrieval algorithm, versions 7 and 8, used to derive the column-averaged dry air mole fraction of atmospheric CO2 (XCO2) for the roughly 100 000 cloud-free measurements recorded by OCO-2 each day. The algorithm is based on the Atmospheric Carbon Observations from Space (ACOS) algorithm which has been applied to observations from the Greenhouse Gases Observing SATellite (GOSAT) since 2009, with modifications necessary for OCO-2. Because high accuracy, better than 0.25 %, is required in order to accurately infer carbon sources and sinks from XCO2, significant errors and regional-scale biases in the measurements must be minimized. We discuss efforts to filter out poor-quality measurements, and correct the remaining good-quality measurements to minimize regional-scale biases. Updates to the radiance calibration and retrieval forward model in version 8 have improved many aspects of the retrieved data products. The version 8 data appear to have reduced regional-scale biases overall, and demonstrate a clear improvement over the version 7 data. In particular, error variance with respect to TCCON was reduced by 20 % over land and 40 % over ocean between versions 7 and 8, and nadir and glint observations over land are now more consistent. While this paper documents the significant improvements in the ACOS algorithm, it will continue to evolve and improve as the CO2 data record continues to expand.

1 Introduction

Bias-free measurement of atmospheric CO2 concentrations from space is a long-pursued goal in the carbon cycle community. Such measurements are critical for inferring sources and sinks of carbon, and how these sources and sinks change over time due to both anthropogenic and natural causes (Baker et al.2010; Chevallier et al.2007; Rayner and O'Brien2001). The first instrument capable of CO2 measurements from space using the near- and short-wavelength infrared was SCIAMACHY, the SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (Buchwitz et al.2005; Reuter et al.2011), which operated from 2002 to 2012. This was followed by the first dedicated greenhouse gas satellite, the Japanese Greenhouse gases Observing SATellite (GOSAT), which launched in January 2009 (Yokota et al.2009). The Orbiting Carbon Observatory-2 (OCO-2) followed on 2 July 2014, with the goal of measuring the column-averaged dry air mole fraction of carbon dioxide (XCO2) with sufficient precision and accuracy to enable greatly enhanced understanding of the surface–atmosphere exchange of CO2 on regional scales (Crisp2015; Crisp et al.2008). OCO-2 was preceded by the original OCO mission, which failed due to a launch vehicle malfunction in 2009. Retrieval algorithms originally developed for OCO (Connor et al.2008) have been continuously refined since 2009 (O'Dell et al.2012), by application to data from GOSAT.

XCO2 measurements from the OCO-2 version 7 data product (Eldering et al.2017a) have recently been used to estimate CO2 fluxes from both natural (Chatterjee et al.2017; Crowell et al.2018a; Liu et al.2017) and anthropogenic (Hakkarainen et al.2016; Nassar et al.2017; Schwandner et al.2017) sources; see Eldering et al. (2017b) for a complete review of these findings. However, XCO2 measurements must be both extremely accurate and precise in order to accurately determine fluxes (Miller et al.2007), since fluxes are determined from small (<2.5 %) spatial and temporal gradients in the XCO2 field. Spatially coherent biases in XCO2 on regional scales as small as a few tenths of a part-per-million (ppm) in XCO2 can lead to spurious values of inferred fluxes (Chevallier et al.2014).

The ACOS algorithm was originally developed for OCO. It was first applied to GOSAT data in 2009 and has continuously evolved and improved in the intervening years. Generally, good error statistics were shown for GOSAT observations over both land and water, with typical biases below 1 ppm based on comparisons to both ground-based (Kulawik et al.2016; Lindqvist et al.2015) and aircraft (Frankenberg et al.2016) validation data. After the successful launch of OCO-2, the ACOS algorithm was further modified and tuned for application to the OCO-2 spectra. XCO2 error statistics are similar to those from GOSAT, with rms errors less than 1.5 ppm when compared against most ground-based Total Carbon Column Observing Network (TCCON, Wunch et al.2010) stations (Wunch et al.2017). However, Wunch et al. (2017) noted that important biases remain, in particular related to latitude, surface properties, and atmospheric scattering by clouds and aerosols. A particularly troubling bias evident in the Southern Hemisphere mid-latitude ocean in austral winter had amplitudes as large as several ppm. This bias was not seen in ACOS retrievals using GOSAT data, though GOSAT's ocean glint viewing geometry was restricted and could not typically see this far south, potentially masking the problem.

Table 1Prescreening filter criteria.

Download Print Version | Download XLSX

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f01

Figure 1Fraction of soundings passing the OCO-2 B8 prescreening filter in December 2015 (a, c) and June 2016 (b, d), for both nadir mode (a, b) and glint mode (c, d). Starting in November 2015, about one-third of all orbits are performed in nadir mode, and two-thirds are performed in glint mode.

Download

The primary purpose of this paper is to describe the details of the ACOS XCO2 retrieval algorithm as applied to OCO-2 data (Gunson and Eldering2017), in particular the latest version 8 (also referred to as build 8 or B8). Because science results have already been published with version 7 (also referred to as build 7 or B7) as discussed above, we also discuss the differences between versions 7 and 8. This paper is organized as follows: Sect. 2 discusses prescreening of the data to remove cloudy and difficult-to-retrieve soundings. Section 3 lists the details of the retrieval algorithm and its evolution since O'Dell et al. (2012). Section 4 discusses the methodology and results of the post-retrieval filtering and bias correction. Section 5 provides a brief evaluation of XCO2 from both versions 7 and 8, and the discussion in Sect. 6 concludes the paper.

2 Data and prescreening

Because only scenes with sufficient signal and nearly devoid of cloud and aerosol contamination can yield successful XCO2 retrievals, a prescreener is used for OCO-2 soundings before processing by the Level-2 “Full-Physics” (L2FP) XCO2 retrieval algorithm. Our prescreening module requires outputs from two fast algorithms, described in detail in Taylor et al. (2016). First, the “A-band Preprocessor” (ABP) performs a fast retrieval of surface pressure using the O2A band only, assuming that no clouds or aerosols are present. Poor spectral fits and differences between the retrieved and a priori surface pressure greater than 25 hPa are used to identify the presence of cloud or aerosol contamination. Scenes without sufficient signal to noise in the O2A band are skipped altogether. Second, the “IMAP-DOAS” preprocessor performs fast, clear-sky fits to the weak and strong CO2 bands at 1.61 and 2.06 µm, respectively. While this preprocessor solves for a number of variables, the CO2 and H2O columns, which are fit independently of each of these two bands, are most relevant for cloud screening. From these spectral fits, the strong-to-weak ratios of the column-integrated CO2 and H2O are derived. The CO2 ratio must be within a certain range (near unity) for the scene to be deemed sufficiently clear to warrant a Full-Physics retrieval. Other screens are used to remove soundings unlikely to yield successful XCO2, such as those at high solar zenith angle or for which the continuum SNR levels are too low. Unlike in version 7 of the OCO-2 algorithm, there is no explicit screen for snow- and ice-covered surfaces. However, the surface albedo in the strong CO2 band is low over snow and ice, and therefore the strong CO2 band SNR filter will remove many of those scenes. The full prescreening criteria for OCO-2 B8 are given in Table 1.

In total, roughly 26 % of land soundings pass our prescreener (28 % land nadir, 25 % land glint) and 27 % of ocean glint soundings pass it as well. Generally these fractions are strong functions of both location and time of year. To illustrate this, the fractions of soundings passing the prescreening criteria for December 2015 and June 2016 are shown in Fig. 1. A number of features are observed. A higher fraction of soundings are passed in the tropics than at higher latitudes relative to the sub-solar latitude (-23 in December and +23 in June), and the passing rates tend to be higher over bright versus dark surfaces. Also, few soundings survive over the tropical rainforests in South America and Africa, which are often cloudy. A significant number of soundings survive prescreening over the Greenland and Antarctic ice sheets during their summer season (this was not the case in version 7), though it is shown later that most of these fail the post-retrieval quality screening (Sect. 4.2). About 10 % of nadir soundings over ocean pass the prescreening criteria; this occurs in regions where the nadir view is relatively close to the glint geometry, typically near the sub-solar latitude. These nadir ocean soundings are currently removed by post-retrieval filtering, as their quality relative to the glint ocean observations has not yet been evaluated. A final obvious feature is that fewer soundings are available in nadir mode than in glint – this is because many orbits over the Atlantic and Pacific oceans became “full-time” glint-mode orbits beginning in November 2015 (Crisp et al.2017). Prior to that, there were equal numbers of nadir and glint orbits, but after that change, approximately one-third of all orbits are nadir and two-thirds are glint.

3 The NASA ACOS XCO2 retrieval algorithm as applied to OCO-2

The original ACOS XCO2 retrieval algorithm over land (version 2.9) was described in O'Dell et al. (2012), with details specific to GOSAT given in Crisp et al. (2012). Details of the spectroscopy used at that time were published in Thompson et al. (2012). In this section, we give an overview of the evolution from ACOS version 2.9 to OCO-2 versions 7 and 8, including spectroscopy, aerosol treatment, and a number of other changes.

Table 2General setup of the ACOS state vector.

Download Print Version | Download XLSX

Briefly, the NASA ACOS algorithm uses optimal estimation to solve for parameters of a state vector to obtain the best match to spectra from the three GOSAT or OCO-2 near- infrared bands and consistent with a prior constraint. These bands are the O2A band at 0.76 µm (band 1), the weak CO2 band at 1.61 µm (band 2), and the strong CO2 band at 2.06 µm (band 3). The state vector parameters, listed in Table 2, include the profile of CO2 at twenty atmospheric levels along with a number of ancillary parameters to which the GOSAT and OCO-2 near-infrared spectra are sensitive. These include surface pressure, surface albedo parameters (over land only), a temperature profile offset and water vapor profile multiplier, and parameters related to the wavelength scale of the spectra (dispersion shift and stretch). The latter are relative to the preflight values of these parameters, described in Lee et al. (2017). Because telluric line positions are known with high accuracy, the retrieval solves for them with virtually no dependence on the prior. To account for scattering effects of thin cloud or aerosol, the retrieval also solves simultaneously for amounts and Gaussian vertical profiles (as described in Sect. 3.1) of five different kinds of scatterers with fixed optical properties: a water cloud type, an ice cloud type, two fixed aerosol types, and beginning in version 8, an Upper Tropospheric/Lower Stratospheric (UTLS) sulfate aerosol layer. In addition, the retrieval also fits scaling factors for three spectral patterns per band, to account for imperfections in the spectroscopy, solar model, and instrument model, and determined using singular value decomposition of our fit residuals run on clear-sky soundings (Sect. 3.3). For solar-induced fluorescence (SIF) emission from plants on land, we fit for two SIF parameters which are needed to account for this fluorescence in the L2 spectra (Sect. 3.5). These SIF parameters are not the official SIF data product; that product is derived from the IMAP prescreener through a dedicated fit (Sun et al.2018). In total, there are typically 55 fitted parameters for land retrievals and 53 for ocean1. With the exception of CO2, the a priori covariance matrix is diagonal, with the 1σ uncertainties as given in Table 2.

Table 3Significant ACOS retrieval algorithm changes.

Download Print Version | Download XLSX

Table 4ACOS retrieval differences between GOSAT and OCO-2.

Download Print Version | Download XLSX

The first documented algorithm version, B2.9 as described in O'Dell et al. (2012), had several deficiencies which occasionally produced large biases in the retrieved XCO2 (Wunch et al.2011a). This early version of the algorithm also contained some cumbersome traits, such as a variable number of vertical levels from sounding to sounding, which made the output difficult to use. The observed XCO2 biases were partially related to the aerosol parameterization, demonstrated by the fact that clear-sky retrievals of clear-sky simulations did not exhibit substantial biases (O'Dell et al.2012). Furthermore, errors in the O2 and CO2 spectroscopy were suspected to be an additional source of bias. Over the course of several years, a number of changes to the algorithm were therefore implemented to yield the present version, B8. The changes are too numerous to fully describe here, but the most important ones are listed in Table 3. The changes fall into several major categories, with spectroscopy, aerosol treatment, treatment of the ocean surface, and chlorophyll fluorescence being the most important. In B8, the meteorology used to prescribe the a priori temperature profile, water vapor profile, and surface pressure was also changed (Sect. 3.5).

Further, as listed in Table 4, some minor retrieval differences exist between the GOSAT and OCO-2 versions of the algorithm. Besides using instrument models specific to each instrument (such as wavelengths of the various channels, noise model, and instrument line shape functions), slightly different spectral ranges are fit for each instrument. Generally, this is because the trusted calibrated range of OCO-2 spectra is slightly smaller than that of GOSAT, due to the differences in design of the OCO-2 grating spectrometer versus the GOSAT Fourier transform spectrometers. Additionally, while all channels in each band in the given spectral ranges are used for GOSAT, some band channels are masked out for OCO-2. This is due to either underlying bad pixels in the detector arrays or to transient cosmic rays that induce temporary spurious readings in random channels. Both of these processes are described in detail in Crisp et al. (2017).

3.1 Aerosol-related changes

Starting with version B2.10, the 20-layer optical depth retrieval used for clouds and aerosols was replaced with a Gaussian-shaped vertical profile for each of the retrieved scattering particle types. As of version 8, two cloud types, two lower-atmosphere aerosol types, and one stratospheric aerosol are used. The new cloud and aerosol profile treatment is similar to that of Butz et al. (2009) but specifies the aerosol concentration ρaer as a function of x, the pressure relative to the surface pressure. Therefore, x ranges from zero at the top of the atmosphere to one at the surface. The functional form is simply

(1) ρ aer ( x ) = C exp - ( x - x 0 ) 2 2 σ a 2 ,

where for each aerosol type x0 is the vertical location at peak aerosol density and σa is the Gaussian 1σ profile width. Both of the latter variables are specified in units of relative pressure x. The prefactor C is defined such that the aerosol or cloud optical depth at 755 nm, hereafter OD755, equals the desired value. In the retrieval algorithm, the fitted quantities are lnOD755 and peak height pr,0 for each aerosol type, with the exception of the stratospheric aerosol (described in Sect. 3.1.1) for which only the optical depth is retrieved. Because it has been shown that GOSAT and OCO-2-like spectra have little sensitivity to the Gaussian profile width (Butz et al.2009), this parameter is fixed in both the GOSAT and OCO-2 retrievals for all particle types. The prior profiles for each fitted type are shown in Fig. 2.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f02

Figure 2Prior Gaussian profiles of the lower tropospheric aerosol types (red), water cloud (blue), ice cloud (purple), and stratospheric aerosol (green). The local aerosol optical depth (AOD) per unit pressure at 755 nm is plotted as a function of the relative pressure. The lower tropospheric aerosol prior optical depth is not fixed as for the other types, but rather is taken from a climatology described in the text.

Download

The change to a sigma-level pressure system was incorporated at about the same time as the shift to Gaussian aerosol profiles. Instead of fixed pressure levels, the pressure levels scale with the surface pressure:

(2) p i = a i p surf ,

where the ai are chosen such that the total number of pressure boundaries is 20, and the layers have roughly equal pressure widths. The top-most model level is set to 0.01 hPa.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f03

Figure 3Optical properties of aerosols and clouds used in the L2FP code as a function of wavelength. (a) Extinction efficiency relative to that at 755 nm. (b) Single scattering albedo. (c) Asymmetry parameter. DU: dust, SS: sea salt, BC: black carbon, OC: organic carbon, SO: sulfate, WC: water cloud, IC: ice cloud. The spectral ranges of the three OCO-2 bands are demarcated by the dashed vertical lines.

Download

The optical properties of the four scattering types remained unchanged from versions B2.9 to B3.4 and are described in O'Dell et al. (2012). However, the use of two fixed aerosol types, types “2b” and “3b” from the Kahn et al. (2001) climatology, did not accurately represent the true global variability of aerosol on the length scales and timescales probed by GOSAT and OCO-2. Beginning with build 3.5, the aerosol types were changed to be location- and time-dependent, with the prior type information coming from the aerosol climatology of the Modern-Era Retrospective analysis for Research and Applications (MERRA, Rienecker et al.2011). The MERRA aerosol field is driven by the Georgia Tech/Goddard Global Ozone Chemistry Aerosol Radiation and Transport (GOCART) model (Chin et al.2002), and modified by assimilating aerosol optical depth from the MODIS instruments onboard the Terra and Aqua satellites (Colarco et al.2010). MERRA contains five broad aerosol types: dust (DU), sea salt (SS), sulfate (SO), and black and organic carbon (BC and OC, respectively). Dust and sea salt are each tracked in five separate size bins. Organic carbon and black carbon are tracked in both hydrophobic and hydrophilic categories. In addition to the carbonaceous types, sulfate aerosol and sea salt are also hydrophilic and hence have optical properties that depend on the local relative humidity (RH).

For the aerosol prior in the ACOS retrieval, we primarily sought to specify the typical dominant aerosol types present (in terms of their contribution to the optical depth in the OCO-2 bands) in a given location at a given time of year. Monthly aerosol fields were derived from the MERRA model for the year 2010, and are used for all years in the ACOS retrieval. We aggregated the 15 MERRA types, eight of which have RH-dependent optical properties, into the five aggregated types listed above. We used typical density weightings and relative humidity values to create the optical properties for these aggregated types, as described in Crisp et al. (2017). Their optical properties, including extinction efficiency, single scattering albedo, and asymmetry parameter, are shown in Fig. 3. The organic carbon and sulfate aerosol are generally similar in their optical properties, though their single scattering albedos diverge somewhat in the CO2 bands. The sea salt, water cloud, and dust optical properties are relatively similar across the OCO-2 spectral range.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f04

Figure 4Comparison of XCO2 time series for OCO-2 version 7 and TCCON, over several years at the station in Wollongong, Australia (Griffith et al.2014b). Each OCO-2 symbol represents an overpass average. A simple geometric colocation strategy was used in which OCO-2 soundings within ±7.5 latitude and ±30 longitude of the TCCON station were retained. Large positive biases occur in the ocean glint soundings in the Southern Hemisphere winter (blue arrows). As seen in Fig. 19, these large biases primarily occur in the southern oceans.

Download

At each sounding location, the two aggregated aerosol types with the highest mean monthly values of the OD755 are selected to be retrieved by the L2FP algorithm. In previous algorithm versions, the total prior OD755 was set to 0.15, apportioned equally among four scattering types (water cloud, ice cloud, and two tropospheric aerosol types). However, it was found this was generally too high to allow a fit near OD755=0 for scenes that were almost entirely free of aerosol. This “clear-sky bias” was seen in early simulation tests (O'Dell et al.2012). The prior OD755 is now set to 0.0125 for each cloud type, and set from the MERRA aerosol climatology for each tropospheric aerosol type as the average OD755 of that type (at a particular location and month). There is some evidence that the tropospheric aerosol priors are occasionally still too high; methods for specifying the aerosol prior are a continuing topic of investigation.

The cloud ice optical properties were updated in version 7. Before that, they were based on the band-averaged model developed by Baum et al. (2005) primarily for the MODIS instrument and known as the MODIS Collection 5 model. This cloud ice model considered an ensemble of size-dependent non-spherical ice crystal habits in random orientation. As ice crystal surface roughness was later shown to significantly affect scattering by ice crystals, and simulations with roughened model particles were more consistent with satellite observations of ice cloud polarized reflectances (Yang et al.2013), we updated the cloud ice optical properties to correspond to the MODIS Collection 6 model, which describes scattering by severely roughened hexagonal column ice crystal aggregates (Baum et al.2014). This update also fixed several minor issues in the previous cloud ice model, such as those resulting from linear interpolation of the optical properties from MODIS wavelength bands to OCO-2, and those relating to truncation of the phase function.

3.1.1 The need for a stratospheric aerosol

When validating version 7 XCO2 retrievals, it was discovered via comparisons to both TCCON and models that most ocean soundings in the most southerly ∼10 degrees of latitude exhibited a high bias of 1–3 ppm during the austral winter (Wunch et al.2017). Figure 4 shows the bias appears in the Southern Hemisphere winter over the Wollongong TCCON station. The bias is seen in soundings over ocean but not land. The bias is also apparent relative to the Lauder TCCON station (Wunch et al.2017). Comparisons of OCO-2 soundings to models (Fig. 19) show the bias as a quasi-zonal band over the Southern Hemisphere oceans, again with the larger bias occurring in the Southern Hemisphere winter. There is also evidence of a similar but weaker band of high bias in the Northern Hemisphere. For 2015, it was hypothesized that small aerosol particles may have been injected into the UTLS by the explosive eruptions of the Calbuco (22–30 April 2015) and Wolf (late May 2015) volcanos in southern–central Chile and the Galapagos Islands, respectively. The presence of an aerosol layer with visible optical depths around 0.01 was later confirmed with observations from the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observatory (CALIPSO) and the Ozone Mapping Profile Suite (OMPS) satellites (Bègue et al.2017). These optical depths are small, but have a large impact on the radiances, especially in the O2A band, due to their high altitude.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f05

Figure 5Results of several hundred retrievals of a single ocean glint sounding (28.5 S, 52.3 W) measured on 26 June 2015. Each retrieval is identical except that each has a different first guess state, consistent with the prior uncertainty distribution. The retrieved relative sulfate height (0= top-of-atmosphere; 1= surface) is shown on the ordinate, the reduced χ2 from the strong (2.06 µm) CO2 band retrieval is shown on the abscissa, and the retrieved XCO2 is indicated by color. For reference, the result from the operational retrieval (version 7) is shown as the large filled circle. When the retrieval places the sulfate near the surface, as in the version 7 case, both the strong CO2 band χ2 value and XCO2 tend to be higher. Conversely, when the retrieval pushes the sulfate closer to the top-of-atmosphere, the strong CO2 band χ2 values and XCO2 tend toward lower values, a result that is more physically plausible.

Download

It was recognized that our version 7 retrieval algorithm had no way to accommodate the spectral signature of small stratospheric aerosol particles, which have a significantly larger effect on the O2A band than either of the CO2 bands due to the small size parameter, i.e, the ratio of the size of the scattering particle to the spectral wavelength. The spectral signature would essentially appear as a radiance offset in the O2A band. As a first test, we ran hundreds of retrievals on a single sounding that had a large positive bias in the operational retrieval, using slightly different first-guess values for each retrieval. Essentially, a continuum of solutions was found (Fig. 5). On one end of retrieval space, an approximately correct value of surface pressure was found by inserting a thicker ice cloud, which contains larger particles starting in the stratosphere, and therefore has a strong effect on all three bands (see Fig. 3). This type of solution produced a poor χ2 in the strong CO2 band, typically >2. On the other end of the continuum were solutions where the sulfate layer, which was placed near the surface in the prior, was moved high up into the atmosphere. This solution regime had a much lower reduced χ2 (around 1.5) in the strong CO2 band and an XCO2 that was typically 3–4 ppm lower, and much more in line with TCCON and model estimates. In these cases, the amount of upper atmosphere cloud ice retrieved was also reduced, as its role was taken over by the sulfate.

These tests indicated that a more realistic solution would often be found if the retrieval could push the prior sulfate into the upper atmosphere, though this seldom occurred. The amount of sulfate needed in the upper atmosphere in these cases is small, approximately 0.01 optical depth at 755 nm. That value is consistent with other observations (Bègue et al.2017). In addition to actual small particles in the UTLS, the OCO-2 instrument has a documented problem which produces a similar impact on the O2A and spectrum. As described in Crisp et al. (2017), a very thin layer of ice appears to build up on the OCO-2 Focal Plane Arrays (FPAs) over time. As this ice layer grows to a thickness similar to the anti-reflective coating thickness (tens of nanometers), it enhances the surface reflectance on the O2A band FPA, producing a scattered light contribution of 0.1 to 0.2 %. Much smaller effects are seen on the CO2 detectors. The ice layer is sublimed off every 3–6 months when the instrument goes through a decontamination cycle. While attempts have been made to remove this scattered light contribution in the version 8 calibrated radiance (L1B) product, it is likely that some residual signal remains. Because this is primarily a radiance offset in the O2A band alone, it produces a signal similar to a small UTLS aerosol, and hence would also be mitigated by including a stratospheric aerosol in the retrieval. During algorithm testing of the stratospheric aerosol using version 7 L1B radiances (which contained the scattered light signature), we found that the amount of UTLS aerosol retrieved indeed correlated with the decontamination cycles, lending credence to this hypothesis.

Thus, in version 8 an additional sulfate aerosol was included in the retrieval state vector. For simplicity, a sulfate type identical to the lower-atmosphere type in terms of optical properties was used. Only the total optical depth of the stratospheric sulfate is retrieved, while its Gaussian height and width are kept fixed. This solution treats both actual small particles in the UTLS as well as the radiometric offsets that accompany the real O2A band scattered light signal. Our testing of the version 8 algorithm showed that including this state vector element not only reduced the Southern Ocean bias, but also reduced the negative tropical ocean bias and positive bias over higher northern-latitude lands that were also apparent in Fig. 19. A more complete comparison of version 7 and version 8 validation statistics is given in Sect. 5.

3.2 Spectroscopy-related changes

There have been substantial changes between the molecular cross sections used in the earliest ACOS versions and those used in B8. We continue to use in-house lookup tables of absorption coefficients (ABSCO) parameterized as a function of temperature, pressure, wavelength, and water vapor mixing ratio for each of the main absorbing gases in the OCO-2 bands: O2, CO2, and water vapor (H2O). Successive versions of these tables have been refined by incorporating new laboratory results and theoretical models for increasingly accurate absorption coefficients. The ABSCO version used in the B8 algorithm is ABSCO v5.0 (Drouin et al.2017; Oyafuso et al.2017); B7 used the previous ABSCO version, v4.2.

The ABSCO v5.0 O2A band tables represent a major step forward from previous ABSCO versions. Earlier ABSCO versions integrated the highest-quality spectroscopic input from a range of studies that had focused on fitting different parameters independently. (See, for example, Thompson et al.2012, and references therein.) The ABSCO v5.0 tables are based on self-consistent multispectral fits to laboratory spectra that include line mixing, speed-dependent Voigt line shape parameters, and collision-induced absorption (CIA). This self-consistency, and the use of laboratory spectra covering a range of pressures, temperatures, and measurement techniques, are key features of the approach. The O2 spectral line parameters, line mixing, and CIA used in ABSCO v5.0 are described in Drouin et al. (2017). Parameters for broadening of O2 by H2O are from the study by Drouin et al. (2014).

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f06

Figure 6Retrieved minus prior surface pressure for a large selection of OCO-2 soundings, using the oxygen-A band spectroscopy model from both (a) ABSCO v4.2 and (b) ABSCO v5.0, as described in the text. ABSCO v5.0 spectroscopy leads to a more consistent retrieval of surface pressure over both land and ocean surfaces.

Download

The impact of the latest multi-spectrum fitting update in the O2A band is shown in terms of the accuracy of the retrieved surface pressure in Fig. 6. Panel (a) shows the retrieved surface pressure minus the prior for ABSCO version 4.2, which was used in version 7 of the algorithm, while panel (b) shows the same for ABSCO v5.0, used in version 8. The main improvements seen are that the retrieved surface pressures in version 8 are essentially unbiased with respect to the meteorological prior over land, and that the land and ocean differences are reduced and centered closer to zero. We also note that for OCO-2, no additional line strength scaling was required in the O2A band, as has been necessary for all previous ACOS/GOSAT versions (Crisp et al.2012). For ACOS-GOSAT B3.5 retrievals, an O2 scaling factor of 1.0125 was found to be beneficial, perhaps because of slight instrumental differences between OCO-2 and GOSAT.

The ABSCO v5.0 tables for the 1.61 and 2.06 µm CO2 bands use line parameters and line mixing models derived from self-consistent, multispectral fits by Devi et al. (2016) and Benner et al. (2016), respectively. The parameters are derived from fits to laboratory spectra at multiple pressures and temperatures and the computation incorporates a speed-dependent Voigt line profile with nearest-neighbor line mixing. Earlier versions of the ABSCO tables (Benner et al.1995; Devi et al.2007) were based entirely on room temperature multi-spectrum fitting, with theoretical temperature dependences of the line shape and line mixing parameters. The updated spectroscopy includes analyses of spectra recorded at temperatures from 170 to 296 K, representing a significant advance. Parameters for broadening of CO2 by H2O are from Sung et al. (2009) for the 4.3 µm CO2 band and extrapolated to OCO-2's CO2 bands. Validation of the ABSCO v5.0 tables using up-looking TCCON spectra is described in Drouin et al. (2017) and Oyafuso et al. (2017). We note one important difference between the reference databases and our CO2 absorption coefficients. We found it necessary to incorporate additional absorption in the center of the 2.06 µm band. This additional absorption was parameterized in order to reduce errors in retrievals with TCCON up-looking spectra. Further details can be found in Thompson et al. (2012) and Oyafuso et al. (2017).

Because the laboratory spectra underlying ABSCO currently are only good to roughly 1 % absolute accuracy of line intensities, the algorithm allows for overall scaling factors for each of the two CO2 bands. For the 1.61 µm band, the ABSCO v5.0 tables include a uniform scaling to bring the intensities from the Devi et al. (2016) multispectrum fit into line with reference intensity measurements (estimated accuracy ∼0.2 %) from Polyansky et al. (2015). Oyafuso et al. (2017) show that this pre-scaling of the ABSCO using reference laboratory measurements results in good consistency between single-band up-looking XCO2 retrievals from ground-based FTS spectra and the XCO2 values reported by TCCON (which are themselves calibrated to agree with reference airborne profiles). Reference intensity measurements are not available for the 2.06 µm band at the current time. In tests within the OCO-2 Level 2 algorithm, using OCO-2 radiances, a scaling of 1.004 for the 2.06 µm ABSCO table was found to yield the best agreement between single-band retrievals performed using this band compared with single-band retrievals performed using the 1.61 µm ABSCO table as described above.

Finally, ABSCO v5.0 tables incorporate H2O line parameters from the HITRAN 2012 compilation (Rothman et al.2013). We use an unofficial, modified version of the MT_CKD continuum, supplied by Eli Mlawer (Mlawer et al.2012). This continuum version offers a compromise between previous versions of MT_CKD and measurements by Ptashnik et al. (2011), and falls relatively close to measurements by Mondelain et al. (2013). The subsequently released MT-CKD 3.2 has been tested and shown to be a modest improvement over the unofficial version incorporated into ABSCO v5.0, with negligible changes to XCO2 but noteworthy improvements to the water column determination. Methane is not currently included in the B8 (or previous versions) of the forward model, as the impact of methane absorption was found to be negligible for XCO2 retrievals performed using the OCO-2 spectral ranges.

3.3 Residual fitting using empirical orthogonal functions (EOFs)

ACOS B3.3 introduced a new way to deal with large spectral residuals caused by imperfect spectroscopy, and solar model and instrument characterization, which were previously treated using a simple “empirical noise” parameterization (Crisp et al.2012). In contrast, the new approach fits scaling factors to fixed spectral residual patterns for each band.

These patterns are the EOFs that result from a singular value decomposition of spectral residuals from training retrievals. Training scenes were selected to be largely devoid of cloud and aerosol effects, such that residual patterns due to unfitted clouds and aerosols are not a large contributor to the resulting EOF patterns. The EOFs are constructed such that the residuals rs,b of each sounding s and band b can be approximately represented as a linear combination of the EOF patterns:

(3) r s , b = j = 1 N eof c j , s , b e j , b ,

where the vectors ej,b are the EOFs for each band. For a diverse set of training retrievals, a matrix M is created for each spectral band and populated by the residuals of the spectral fits within that band. Training sets typically included more than 10 000 soundings.

Each matrix M is then decomposed into its eigenvectors using traditional singular value decomposition:

(4) M = UWV T ,

with the columns of U spanning an orthonormal basis of the most persistent spectral residual vectors observed in the training data set. By convention, the first eigenvector explains the largest fraction of the total variance, as indicated by descending order of singular values (the diagonal elements of W).

Application of this EOF technique substantially reduces the spectral residuals, yielding values of the relative rms of the residuals of ∼0.1 % for each band, and reduced χ2 values near unity. For GOSAT, only the first EOF was found to be necessary. For OCO-2 B7 (and B8) target-mode observations, better agreement with TCCON XCO2 was found when the largest three EOFs were employed. The first two EOFs for GOSAT, as well as the first three EOFs for OCO-2, are shown in Fig. 7 for each spectral band. The EOFs for each of the eight spatial footprints sampled by OCO-2 are extremely similar, though they are solved for independently due to the slightly different spectroscopic response of each. The first EOFs for OCO-2 and GOSAT are very similar for each band, indicating that common forward model errors such as spectroscopy and top-of-atmosphere solar flux, rather than instrument-specific effects, are driving the EOF patterns. The first EOF is also very similar to the mean residual pattern, and typically accounts for 50 %–60 % of the variance in the residuals. The second and third EOFs typically account for only 1 %–3 % of the variance in the residuals, with higher-order EOFs accounting for even less. For the O2A band, the second EOF appears as a Doppler shift of the first. In the weak CO2 band, the second EOF appears to be due to water vapor lines, while the third EOF appears to be a Doppler shift of the first. Higher-order EOFs often exhibit additional instrument artifacts (such as unidentified bad spectral samples) and forward model errors related to water vapor, as well as other effects that are difficult to interpret.

The EOF formulation was modified in B8 in several ways. First, the EOFs were defined in terms of radiance per unit noise rather than pure radiance, in order to be consistent with the cost function metric that is minimized during the retrieval itself. However, the structure of the EOFs in B8 was much the same as in B7. Second, improved filtering of spectral samples that are contaminated by noisy or dead detector pixels greatly reduced their impact on the EOF patterns. Finally, a manual re-ordering of the EOFs was performed for each of OCO-2's eight spatial footprints, because the standard ranking by variance would occasionally flip the EOF patterns in different footprints. This mattered because sometimes the third and fourth EOFs would change places (and the current algorithm only fits the first three EOFs). This ensured that, to the extent that the EOFs of each footprint roughly matched, the same three EOF patterns for each footprint are fit within the L2FP retrieval.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f07

Figure 7Spectral patterns of the EOFs for the O2A band (a), weak CO2 band (b), and strong CO2 band (c), for both GOSAT B3.5 (green) and OCO-2 B7 footprint 4 (black). For reference, the light gray trace in each panel shows the modeled spectrum (not to scale). Some stronger water vapor absorption lines (blue vertical lines) in the weak and strong CO2 bands correlate with features in the second and third EOFs.

Download

3.4 Surface model

The forward model for ACOS L2FP retrievals uses one of two surface models, depending on the location of the footprint. Water surfaces are simulated as a linear combination of a Cox–Munk ocean surface (Cox and Munk1954) and Lambertian reflector. This surface has seven parameters: wind speed, and a Lambertian albedo at a reference wavenumber with a linear spectral slope term in each of the three spectral bands. The prior wind speed is taken from the resampled meteorology (either ECMWF or GEOS5 FP-IT, as discussed in the next section), as for the other meteorological parameters. The strong CO2 band Lambertian albedo is fixed to 0.02; the other six terms are fit in an essentially unconstrained fashion. This approach leads to the fitted Lambertian albedos generally staying small and positive, the latter of which is currently required by our radiative transfer module.

Through ACOS B7, land surfaces were assumed to be purely Lambertian, with an albedo and albedo spectral slope retrieved for each band. The Lambertian surface assumes that the bidirectional reflectance distribution function (BRDF; the ratio of the radiance in the reflected direction to the irradiance from the incident direction; Schaepman-Strub et al.2006) is a constant that is often specified as a scalar albedo. Since independent fits are done within each of the three OCO-2 spectral bands, this yields six state variables for land footprints.

Analysis of B7 OCO-2 target-mode observations showed that the retrieved Lambertian albedo and aerosol optical depth sometimes exhibited dependence on the sensor zenith angle for observations of the same surface location. This indicated that the true surface BRDF has dependence on the observation angles. A more physically justified approach would use a non-Lambertian model for the surface BRDF. For trace gas retrievals, a Lambertian surface assumption introduces no errors in the absence of multiple scattering between the surface and atmosphere; in this case, the retrieved albedo is interpreted as the surface reflectance at the primary scattering geometry (Sun–surface–satellite). However, over brighter surfaces with some atmospheric scattering, the assumed BRDF could in principle affect the retrieval via the interaction of the retrieved aerosol, surface pressure, and gas concentrations. Therefore, in B8 it was decided to change the surface model for land footprints to a non-Lambertian surface model. This model assumes a fixed BRDF shape and assumes the surface is azimuthally symmetric, but allows for spectral dependence of the amplitude between and within each of our three bands; full details of the BRDF model are given in Appendix B. While this model does often show reduced correlation between view zenith and the retrieved BRDF amplitude, the retrieved XCO2 (as well as most other state vector parameters) shows very little change versus a version of the B8 retrieval run with a Lambertian surface. Therefore, while B8 does use a non-Lambertian BRDF parameterization, a Lambertian surface appears to work equally well. This fact may be a consequence of the strong filtering used in B8, which tends to remove soundings with multiple scattering. Future applications of the ACOS L2FP algorithm to cases with higher AOD may be more strongly impacted by the non-Lambertian BRDF.

3.5 Additional retrieval algorithm changes

In addition to these changes, a number of additional (mostly minor) changes have also been made to the ACOS L2FP algorithm since B2.9. In B2.10, the prior CO2 profile was changed to match that used by TCCON, which was more realistic than our previous prior formulation; as of B8, this corresponds to the GGG2014 version (Toon and Wunch2014). Generally speaking the TCCON CO2 prior profile is relatively simple: it is a function of latitude, altitude, and date only. It includes a simple formulation of the seasonal cycle and currently assumes a fixed secular increase of 0.52 % yr−1 (or 2.08 ppm yr−1 at 400 ppm). There is no land–ocean or other meridional dependence. It requires specifying the tropopause height, and has simple formulations for the profile in the boundary layer, free troposphere, and stratosphere. A small mistake in the XCO2 averaging kernel was also fixed in B2.10; this was caused by inconsistent assumptions regarding the pressure-dependent gas absorption cross sections throughout our retrieval code, which led to an obvious “kink” in the averaging kernel that had long been visually evident (Connor et al.2008). We use the 2016 version of the Toon solar transmittance spectrum (available at https://mark4sun.jpl.nasa.gov/toon/solar/solar_spectrum.html, last access: 4 December 2018) (Toon2014). Changes in the prior covariance matrix for CO2 (O'Dell et al.2012) were also considered, but rejected, as tests using alternate covariance matrices showed insignificant performance improvements.

In B3.3, solar-induced chlorophyll fluorescence (SIF) fitting over land surfaces was introduced. This change was introduced to combat a bias in XCO2 that results from not fitting for fluorescence when it is present, due to its impact on the O2A band. This problem and our fluorescence fitting scheme are described in detail in Frankenberg et al. (2012). Briefly, we fit for the mean and slope of the fluorescence at the top-of-canopy as a function of wavelength; the mean is expressed as a fraction of the continuum radiance level at a wavelength of 755 nm. The spectral dependence of the fluorescence is taken to be linear. Additional minor algorithm changes to B3.3 included reducing the prior surface pressure uncertainty from 4 to 1 hPa for GOSAT, which is likely to be a more accurate representation of the true prior surface pressure uncertainty for the majority of scenes (Salstein et al.2008). This has the added benefit of reducing the interference error between SIF, aerosols, zero-level offset, and surface pressure. In B3.4, fitting for SIF was turned off for GOSAT medium gain observations over land, as these regions are nearly all desert with very little biological activity. For OCO-2, the SIF prior is taken from the official SIF retrieval, as described in Sun et al. (2018), because SIF retrievals from individual soundings are meaningful for OCO-2 due to its relatively high SNR.

Table 5Median ±1σ of GEOS5 FP-IT–ECMWF differences for GOSAT soundings passing the ABP cloud filter.

Download Print Version | Download XLSX

In B8, the prior height of the cirrus cloud layer relative to the surface pressure was moved slightly, from the fixed value of x=0.3 to just below the tropopause height (which is a relatively strong function of latitude). The calculation of the tropopause height itself was also refined in B8, which also improved the calculation of the prior CO2 profile. Finally, the prior meteorology was changed in B8 from ECMWF to GEOS5-FP-IT (Lucchesi2013; Suarez et al.2008). Some statistics regarding differences in surface pressure, temperature, water vapor, and surface wind speed between the two models for retrieved GOSAT soundings are given in Table 5; the corresponding difference statistics for OCO-2 soundings are nearly identical. Only soundings passing the O2A band prescreener are included. In general, the two models are very similar, with for instance 95 % of all soundings having a surface pressure difference of less than 1.5 hPa. Surface pressure probably affects our retrieved XCO2 the most, as it is used not only in the retrieval, but also in the bias correction, where differences in the prior surface pressure will lead to a first-order change in the bias-corrected XCO2. Currently then, the “noise” from the surface pressure difference between these two models would amount to roughly 0.6 hPa, or about 0.25 ppm in XCO2, which is quite a bit less than our noise-driven error (∼1.4 hPa on average) and regional biases (∼2.4 hPa on average). Retrieved surface pressure errors are discussed in more detail in Sect. 4.3.4.

4 Retrieval filtering and bias correction

All soundings passing the prescreening criteria (Table 1) are processed with the L2FP retrieval algorithm. Of these, some 10 %–20 % fail to converge to a solution, typically because of unscreened clouds or other factors that cannot properly be modeled in the retrieval. Some fail simply because of the nonlinear nature of the problem – in general, there is no perfect way to minimize the cost function. Of the 80 %–90 % of soundings that do converge to a minimum in the cost function, typically three to six iterations are required.

Despite our best efforts to prefilter problematic soundings, there are inevitably some retrievals with XCO2 errors that exceed those predicted by theory. Ideally, the XCO2 errors would be normally distributed, with errors consistent with the 1σ a posteriori uncertainty on XCO2 from the retrieval (Rodgers2000), but often there are retrievals with systematically biased XCO2 and/or larger-than-expected scatter. This problem is partially mitigated by applying a bias correction, which can reduce both scatter on smaller spatial scales and biases on larger spatial scales. However, problematic soundings still remain. A quality-filtering procedure then attempts to remove these soundings with larger-than-expected differences from our truth metrics. For GOSAT, this process was described in O'Dell et al. (2012) and Crisp et al. (2012). The problem of biases is dealt with via a linear bias correction (Wunch et al.2011a). In this section, we describe both filtering and bias-correction procedures for XCO2 for B8 retrievals only, unless otherwise noted. A similar procedure was used for GOSAT data as well as OCO-2 B7, but the procedures were more mature and robust for B8.

4.1 Truth proxy training data sets

Both filtering and bias correction require a training data set, which consists of soundings for which we have both the OCO-2 retrieved XCO2 as well as a reliable, independent estimate of XCO2. The latter we call a “truth proxy”. We used four such data sets: TCCON, models, models in the Southern Hemisphere only, and a new validation method for OCO-2 called the “small-area approximation”. Table 6 lists the truth proxies used in version 8, while Fig. 8 shows the spatial distribution of the truth proxy data sets matched to actual OCO-2 soundings.

Table 6XCO2 truth proxies for retrieval evaluation.

Download Print Version | Download XLSX

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f08

Figure 8Sounding density of the truth proxy data in 4× 4 bins used in the OCO-2 version 8 XCO2 filtering and bias correction. (b) shows both the full global model-based truth proxy and the Southern Hemisphere truth proxy as the portion below the dashed black line.

Download

4.1.1 TCCON-based truth proxy

The most direct truth proxy is the comparison to TCCON, which currently has 25 operational stations globally, but with heavy representation in North America, Europe, Asia, and Oceania. For the OCO-2 B8 evaluation, the latest version of TCCON retrievals was employed (Wunch et al.2015). Many schemes have been used to match air masses observed by satellites to those viewed from TCCON stations. Examples include a geographic-centric scheme (Cogan et al.2012; Inoue et al.2013; Kulawik et al.2016; Oshchepkov et al.2013), a scheme based on the potential temperature at 700 hPa (Keppel-Aleks et al.2011; Wunch et al.2011b), model-based selection (Guerlet et al.2013), and geostatistical selection (Nguyen et al.2014). These more sophisticated techniques were primarily used because GOSAT had fairly sparse data and required relatively loose matching criteria to yield sufficient numbers of matched observations. This is less of a problem with OCO-2 at lower and mid latitudes, with its higher spatial sampling density. High-latitude validation with TCCON remains challenging, where OCO-2 data are still sparse.

Goo et al. (2014)Feist et al. (2014)Deutscher et al. (2015)Velazco et al. (2017)Notholt et al. (2014)Wennberg et al. (2015)Griffith et al. (2014a)Iraci et al. (2016)Wunch et al. (2016)Strong et al. (2016)Sussmann and Rettinger (2014)Blumenstock et al. (2014)Hase et al. (2015)Wennberg et al. (2016)Sherlock et al. (2014)Dubey et al. (2014)Notholt et al. (2017)Warneke et al. (2014)Te et al. (2014)Wennberg et al. (2014)De Mazière et al. (2014)Morino et al. (2016b)Kawakami et al. (2014)Kivi and Heikkinen (2016)Morino et al. (2016a)Griffith et al. (2014b)

Table 7TCCON stations used in this work.

Download Print Version | Download XLSX

Table 7 lists the TCCON sites used as truth proxies in this work. Training data ranges correspond to the quality-filtering and bias-correction procedures described in Sect. 4.2 and 4.3, respectively. Validation data ranges correspond to the basic validation described in Sect. 5. Our colocation requirements for B8 were similar to those used for Wunch et al. (2017), in which we required that OCO-2 footprints were within 2.5 latitude and 5.0 longitude of the TCCON station, and that the observations occurred within 2 h of each other. These requirements were modified slightly for the Caltech, Armstrong, and Tsukuba stations in order to discriminate satellite observations taken over the nearby megacities of Los Angeles and Tokyo. Because of additional station data and a longer training period, there were roughly twice as many station months of valid colocations for B8 as compared to our B7 training (roughly 400 versus 190 station months).

We estimate TCCON colocation errors to be on the order of 0.5 ppm, due to both colocation errors and TCCON station-level biases (Hedelius et al.2017). Even with these small errors, TCCON is an incomplete validation source due to its limited spatial coverage. For example, there are few stations in the tropics, none in the central Pacific or central Asia, and, with the exception of Armstrong, none in bright desert regions. Except when specifically stated, we employed the OCO-2 averaging kernel correction. A general treatment of averaging kernel corrections was first given in Wunch et al. (2011a). The specific correction we employ is taken from Nguyen et al. (2014), in which the TCCON-retrieved profile is convolved with the OCO-2 column averaging kernel before it is compared to OCO-2. This effect is generally smaller than 0.3 ppm in the column.

4.1.2 Small-area approximation truth proxy

To supplement TCCON, we used a method new for OCO-2 called the “small area approximation”, or SAA2. The SAA relies on the high spatial resolution of OCO-2 footprints (1.3×2.3 km2), and the relatively long decorrelation length of CO2 concentration in the atmosphere (Chevallier et al.2017). Specifically, this approximation assumes that for a given overpass of an area not larger than 100 km in spatial extent, XCO2 can be considered uniform over the area. True XCO2 variability was evaluated by Worden et al. (2017) by examining output from the GEOS-5 7×7 km2 “nature run”. It was found to be typically less than 0.1 ppm per 100 km areas away from strong known sources, thus justifying our small area assumption. In fact, this error is considerably lower than can be obtained by any of the other truth metrics. The major drawback of this method is that it is insensitive to biases due to variables that vary slowly on these small scales, such as those related to viewing geometry and some surface and aerosol parameters.

Chevallier et al. (2010)Feng et al. (2009)Rödenbeck (2005)Peters et al. (2007)Basu et al. (2013)Crowell et al. (2018b)

Table 8Models used in this work.

Download Print Version | Download XLSX

4.1.3 Model-based truth proxies

The third validation data set is based on results from global carbon flux inverse models, and is referred to as the “multi-model median”. In order to evaluate OCO-2 retrievals against a posteriori results from an array of models, and to avoid the biases in one particular model, a suite of six models sampled at the OCO-2 sounding locations and times was used. Table 8 provides a summary of the models that were used. The models generally differed in their prior flux assumptions, prior flux uncertainty, transport model, initial conditions, spatial resolution, and inverse method, but had one commonality in that all assimilated in situ CO2 concentration data. Because of these differences, the models often yielded a posteriori XCO2 fields that disagreed to some extent, with differences ranging from a few tenths of a ppm to several ppm as discussed below. We used model output that covered a minimum period from September 2014 through December 2015, though a few models (CarbonTracker, TM5-4DVar) extended into March 2016. To compare against the models, for simplicity we computed only true XCO2 values from the a posteriori CO2 concentrations, rather than averaging-kernel-corrected values. Previous authors have shown that this effect is typically small, on the order of a few tenths of a ppm (Inoue et al.2013; Lindqvist et al.2015; Wunch et al.2011a).

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f09

Figure 9Maximum difference between each model and the model median in ppm, averaged over 4×4 grid boxes. Two seasons are shown: DJF (a) and JJA (b). Soundings for which all models are within 1.5 ppm of the model median are retained in the model-based truth proxy.

Download

For each matched OCO-2 sounding, the model median was computed from all available models for that sounding. If any model XCO2 value differed by more than 1.5 ppm from the model median, that sounding was excluded from our training data set. This requirement helped ensure that at the very least, all the models were generally consistent with each other for a given sounding in our training set. Generally the root-mean-squared difference of the model XCO2 values was less than 0.7 ppm for any given sounding satisfying this requirement. The median of the model-predicted XCO2 for soundings satisfying this criterion was then taken as the truth estimate.

Figure 9 shows maximum difference from the model median for both the Northern Hemisphere winter (December, January, February; DJF) and summer (June, July, August; JJA). Most soundings passed our “model-agreement” requirement over ocean at all times and over land in DJF, where the bulk of the land biosphere is quiet and hence XCO2 is more robustly modeled. In JJA, however, a substantial fraction of land soundings fail this test, in particular over Northern Hemisphere regions such as Asia. Tests showed that our results were not strongly sensitive to the agreement threshold chosen.

Finally, Wunch et al. (2011a) used a truth proxy called the “Southern Hemisphere Approximation” (SHA) in which it was assumed that the Southern Hemisphere (25–55 S) could be taken to be meridionally uniform in XCO2 at any given time, with a latitudinal gradient of −1 ppm from 25 to 55 S, and the change in mean XCO2 over time could be prescribed with a linear secular trend (taken to be 1.9 ppm yr−1). This served reasonably well for the GOSAT retrievals at that time, which exhibited rather large errors. However, the SHA has the primary shortcoming that meridional anomalies can sometimes exceed 0.5–1.0 ppm and are typically larger over land versus ocean. We find that substituting the model median instead of the zonally corrected mean used in Wunch et al. (2011a) results in error variances of the approximation 3–4 times lower, when comparing against any particular model as truth. Therefore, in order to maintain a connection to the truth metric of Wunch et al. (2011a), in this work we adopt the modified SHA called “Model_SHA”. This is simply the model median, discussed above but only used in the Southern Hemisphere below a latitude of 20 S.

4.2 Quality filtering

The construction of the operational OCO-2 filtering and bias correction for B7 is described in detail in Mandrake et al. (2015), with updates for B8 described in an online user's guide (Eldering et al.2017b). The training procedure for both filtering and bias correction for these two versions followed a similar approach. Below, we discuss the filtering and bias correction for version 8 only, and make notes where version 7 differed significantly. The filtering procedure yields two quantities. The first is a binary flag denoted the XCO2 quality flag, which requires that a series of parameter-based tests are all passed. The second is a graded set of “warn levels”, which assigns each retrieval an integer value from 0 (most likely to yield accurate XCO2) to 5 (least likely to yield accurate XCO2). A genetic algorithm (Mandrake et al.2013) finds combinations of variables that are best at predicting variance reduction in XCO2 over both small areas (10×80 km2) and in the Southern Hemisphere (south of 25 S). In this document, we focus only on the quality flag filtering.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f10

Figure 10δXCO2 versus select filtering variables for land (nadir + glint) data, using TCCON as a truth proxy. Shown are the mean bias in each parameter bin for both raw (black circles) and bias-corrected (light blue circles) XCO2 as well as the standard deviation of the bias-corrected δXCO2 (dark blue diamonds). The histogram of each parameter is shown in gray. The vertical black dashed lines denote filtering thresholds for the XCO2 quality flag, while the thin red solid lines show filtering thresholds for the warn levels. The quality flag filters are applied cumulatively from left to right and top to bottom. The fraction passing at each step, as well as the rms error of the bias-corrected XCO2, are shown in the upper right corner of each panel. Please see Table A1 for a complete definition of all of the filter variables.

Download

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f11

Figure 11Same as Fig. 10 but for ocean glint measurements, where the truth proxy is the multi-model median.

Download

Filtering is accomplished by first identifying variables that cause the largest δXCO2, where δXCO2 is defined as the retrieved–true XCO2, the latter of which is evaluated for a given truth proxy. This was done sequentially, by identifying the single variable responsible for the largest fraction of the variance in δXCO2. We then created a simple threshold-based filter for this variable. After application of the filter, this process was repeated multiple times until it appeared that the majority of problematic data were removed. Because bias correction affected this procedure, a preliminary filter set was first created, after which a preliminary bias correction was developed. The preliminary bias correction was then applied, δXCO2 was updated accordingly, and the filters were re-derived using this bias-corrected δXCO2. Generally this had only a minor effect on the filters, and often served to increase the fraction of data passed through filtering.

Selection of thresholds for particular filters was somewhat subjective: generally bias was regarded as more problematic than scatter, but both were considered. Variables were typically selected as filters if they were correlated with bias greater than about 0.5 ppm, or significant scatter (greater than about 2 ppm). The filtering variables and thresholds were derived separately for land (combined nadir and glint) and ocean soundings. The final values of the filtering thresholds for the XCO2 quality flag are given in Appendix A. Filtering variables selected and their thresholds were the same or similar, regardless of the particular truth proxy used.

An example of this sequential filtering approach is shown in Fig. 10, which shows the XCO2 error versus filtering parameters for nadir and glint land soundings, using TCCON as the truth proxy. Overall, the results were found to be robust for all our truth proxies. Just a few variables do the bulk of the filtering. For both land and ocean, the CO2 and H2O ratios computed by the IMAP-DOAS preprocessor account for a significant fraction of the total filtering. These variables represent the ratio of the total column CO2 (H2O) as derived from the weak CO2 band to that from the strong CO2 band. As discussed at length in Taylor et al. (2016), values of these gas ratios that deviate significantly from unity indicate the presence of significant atmospheric scattering. As shown in Fig. 10, ratios significantly away from the median values can result in both large scatter and large biases. Another robust finding is that biases are associated with large absolute values of the retrieved–prior surface pressure (dP) for both the Level-2 and ABP preprocessor retrievals. All of these variables (CO2 and H2O ratios and surface pressure) are most likely diagnosing scattering-induced errors due to improperly modeled clouds and aerosols.

Two variables associated with small-scale variability are also associated with increased scatter: the standard deviation of the surface altitude within OCO-2's field-of-view, and another parameter called “Max_Declocking”, which is determined independently for each of the three OCO-2 bands. The latter is related to a slope in the observed radiance within an individual sounding's field-of-view, and is determined from OCO-2's color slices as discussed in Crisp et al. (2017). The scatter associated with surface elevation appears to be related to an instrument-to-spacecraft offset specification error, which results in small (several hundred meters) pointing errors, which is improved in the next data version (version 9) and allows for relaxation of this filter (Kiel et al.2018).

Another interesting variable that can result in both bias and scatter is the tropospheric lapse rate of the retrieved CO2 profile, called co2_grad_del. It is determined by the difference in retrieved CO2 between the surface and the retrieval pressure level at 0.7 times the surface pressure, minus this same quantity for the prior:

(5) co2 _ grad _ del = c ( 1 ) - c ( 0.7 ) - c ap ( 1 ) - c ap ( 0.7 ) ,

where c(x) and cap(x) respectively denote the retrieved and a priori CO2 dry air mole fraction at relative pressure x. The reason why this variable is strongly associated with bias and scatter is still being investigated; it may be due to CO2 spectroscopy errors, or some other factor. There is also a filter associated with dark surfaces; scenes with a strong CO2 band albedo less than 0.05 consistently exhibit a bias in retrieved XCO2 and are thus excluded. Note this will tend to flag most snow- and ice-covered surfaces (such as over Greenland and Antarctica), which are highly absorbing at wavelengths longer than about 2 µm. It also tends to exclude dark forests such as in the Amazon. There are also filters associated with the retrieved slope of the strong CO2 band albedo, the fit quality in the CO2 bands, and a number of retrieved aerosol variables. Of particular note is the total retrieved optical depth associated with our larger aerosol types: dust, water cloud, and sea salt (DWS). High values of DWS are associated with negative biases in XCO2 over land, and it is used as both a filter and bias-correction variable. Although ice is also a large type, it is confined to the upper atmosphere in our retrieval and has its own dedicated filter.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f12

Figure 12Fraction of L2FP processed soundings passing a quality filter (a, b) and total number of good-quality soundings per month per 6×6 boxes (c, d), for the Northern Hemisphere winter (DJF) and summer (JJA). The number plots have a logarithmic color scale, and grid boxes with no data are shown in gray.

Download

Similar variables are used for filtering over water surfaces (Fig. 11), though note that almost no aerosol-related variables are used. This may be because water surfaces have relatively uniform optical properties, such that the retrieved variables indirectly associated with cloud and aerosol scattering, such as the CO2 and H2O ratios and the slope of the strong CO2 band albedo, are more effective than over land, obviating the need for additional aerosol-related filtering. It may also be because most downward-propagating, forward scattered light is absorbed by the ocean surface, so the pathways for aerosol contamination are significantly less than over land, as noted by Butz et al. (2013).

As seen in the upper left panel of Fig. 11, the dominant filtering variable for water-glint soundings is the slope of the strong CO2 band albedo. This is the slope of the retrieved Lambertian albedo in that band, which is generally small and is added onto the reflectivity coming from the primary Cox and Munk surface, which is a function of wind speed only. Negative slopes are strongly associated with XCO2 bias, which appears indicative of either cloud ice or sea salt aerosol scattering, both of which yield a negative slope in these units3. Large positive values of this slope are likely associated with contamination by sulfate aerosol or other small particle types. The sensitivity of this variable to cloud and aerosol scattering has been confirmed with simulations. About 10 % of water-glint soundings are flagged by this filter.

After filtration, about 31 % of land soundings and 55 % of water soundings pass the XCO2 quality flag4. As depicted in Fig. 12, the pass rates are not uniformly distributed around the globe. Over land, very bright and dark surfaces are preferentially filtered out, as well as locations with many low clouds such as the Amazon, which are sometimes missed by our prefilters (Taylor et al.2016). Nearly all soundings over ice surfaces are filtered out, because the albedo of ice is very low at 2 µm, hence yielding low signal-to-noise. The higher quality of water soundings is likely due to higher uniformity of water surfaces in glint mode, higher and more uniform SNR in all three bands, and fewer surface–atmosphere scattering mechanisms. Over both land and water, soundings at higher solar zenith angles are also removed at a higher rate by our quality flag. This is most likely due to the relatively large effects of scattering on our retrievals for these geometries, specifically when the fraction of the light received at the detector from atmospheric scattering is a larger fraction of the total. Over water, approximately 70 % of soundings pass at lower viewing angles, while nearly all soundings fail at high viewing angles.

Table 9Land bias-correction parameters, their coefficients, and percentage of the variance explained, for different truth proxies and observing modes.

* B7 used ln(DWS) rather than DWS in its bias correction.

Download Print Version | Download XLSX

4.3 Bias correction

After filtering, systematic biases remain in retrieved XCO2 which must be corrected in order to minimize errors. The OCO-2 bias correction contains three main pieces: parametric, footprint-level, and global biases. Parametric biases are functionally related to a given parameter associated with a given sounding. Examples of this could be surface pressure, albedo quantities, or retrieved aerosol quantities. Footprint-level biases are corrected to ensure that each of OCO-2's eight sensors, or “footprints”, yield the same XCO2 value when observing similar scenes. This is not always the case due to small calibration errors in the eight individual footprints. The final step of the bias correction removes any global mean bias that may remain. The overall bias-correction equation is then written as

(6) X CO 2 , bc = X CO 2 , raw - C P ( mode ) - C F ( j ) C 0 ( mode ) ,

where CP is the mode-dependent parametric bias, CF is the footprint-dependent bias for footprints j=1…8, and C0 represents a mode-dependent global scaling factor. The following subsections discuss each of these corrections in detail.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f13

Figure 13Multi-linear bias-correction fit to the three variables used for land soundings. Here, land nadir and glint observations are shown, with the multi-model median truth proxy. The circles show mean values in each parameter (x axis) bin, and the error bars are the 1σ standard deviations within each bin. The histogram shows the distribution of the parameter. The legend in each panel shows the starting and ending standard deviations after application of each variable, and the coefficient for that variable of the multiple regression using all three variables.

Download

4.3.1 Bias correction: parametric biases

The most complex but most important of the three aspects of the bias correction is inferring biases dependent upon different retrieval parameters. Most near-infrared XCO2 retrievals have required this, for both GOSAT (Cogan et al.2012; Guerlet et al.2013; Wunch et al.2011a) and OCO-2 (Reuter et al.2017; Wu et al.2018) measurements. A nontrivial fraction of the bias comes from the retrieval algorithm itself, as shown in the simulation-based study of O'Dell et al. (2012), in which the instrument model and spectroscopy were perfect yet biases still emerged in the retrievals. Previous versions of the ACOS algorithm applied to GOSAT have shown dependencies on the surface albedo in the CO2 bands, dP (retrieved minus prior surface pressure), co2_grad_del, the retrieved ice cloud height, and other variables. The parametric bias correction has the form of a multiple linear regression, following Wunch et al. (2011a):

(7) C P = i c i ( p i - p i , ref ) ,

where ci are the regression coefficients, pi are the selected parameters, and pi,ref are convenient reference values. We note that the reference values are nontrivial in that they interact with the last term in the bias correction, the global scaling factor. Ideally, the reference value will be the value of the parameter at which that parameter does not bias the retrieved XCO2, but this is impossible to disentangle from the global scaling factor. Wunch et al. (2011a) took the parameter reference values to be the estimated global mean value of each parameter. Here we do not require this, though for some variables, the estimated global mean is used.

In order to identify the variables of interest, we used all four truth proxies and identified combinations of one, two, three, and four variables that removed the most variance, for each observing mode and over both land and water. Variables that remove less than 5 % of the variance are not included, as overfitting is a potential danger here. Typically the different truth proxies agree on the most important variables but disagree on the variables that explain just a few percent of the variance or less. As shown in Table 9, it was found that three fit parameters were required over land, and that their values did not strongly depend on observing mode. These variables were dP (retrieved minus prior surface pressure), co2_grad_del, and finally DWS, which as stated previously is the combined retrieved optical depth of dust, water cloud, and sea salt aerosol. DWS represents the retrieved optical depth of large particles in the lower-to-middle troposphere in the retrieval. While ice cloud particles are large, they are placed in the upper troposphere in the retrieval, and all other aerosol types in the retrieval are much smaller.

Table 10Ocean glint bias-correction parameters for different truth proxies.

Download Print Version | Download XLSX

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f14

Figure 14Same as Fig. 13 but for ocean glint measurements again using the model mean truth proxy.

Download

In Table 9, the coefficients of each parameter inferred from each truth proxy and observing mode typically agree to within 10 %–20 %. The final result represents a combination of the average of these individual values, but was also driven by consensus amongst the scientists involved. Table 9 also gives the approximate uncertainty on each parameter, which is estimated as the standard deviation of the estimates from the different truth proxies and viewing modes. Also shown is the B7 bias correction, which was very similar, though it used ln(DWS) instead of DWS. Figure 13 shows the result of the multiple regression for these three variables against the model-based truth proxy, for all nadir and glint soundings over land. In general, dP explains about 30 % of the variance over land, co2_grad_del about 20 %, and DWS roughly 5 %–10 %.

A similar procedure was followed for glint soundings over water. For this observing mode, only dP and co2_grad_del were needed; all other variables explained only a very small fraction of the variance, and were not consistent among truth proxies. The fit to these two variables for the model-based truth proxy is shown in Fig. 14. A true linear regression will not work for co2_grad_del. Instead of fitting a nonlinear form, we instead fit against the variable max(co2_grad_del, −6). This gives essentially the fit as shown in the figure, where the best-fit line to the bias increases with increasing co2_grad_del until a value of −6, above which the fitted bias is held constant. As shown in Table 10, the different truth proxies again yielded similar results to within about 20 %, with the exception of “Models_SHA”, which was an outlier. The reason for this is unknown, though we speculate that the actual parameter variability in the Southern Hemisphere is too small to obtain sensible slopes. Therefore, this truth proxy was excluded in the calculation of the final coefficients for glint soundings over water. Also, it is worth noting that the dP coefficient in B7 was roughly 3 times smaller than the value of −0.23 adopted for B8. This was driven by inconsistencies in the B7 truth proxy data sets and a very small training data set, which yielded an unrealistically small value. Later analyses showed that B7 probably should have used a higher value, more in line with the B8 result.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f15

Figure 15Estimates of the OCO-2 footprint biases, estimated separately for each observing mode and surface type. Because of their similarity, a single set of biases was used in the end.

Download

4.3.2 Bias correction: footprint biases

After fitting for the parametric biases, the dependence of the XCO2 bias on footprint was evaluated. As with the parametric biases, the footprint biases were evaluated using the suite of truth proxies and for each observing mode separately (land nadir, land glint, and ocean glint). For all frames that contained all eight footprints, the difference of each footprint from the mean of its frame was calculated, with the result being the estimated set of footprint biases for each truth proxy. Note that this was done after application of the parametric bias correction. The resulting biases were quite consistent across truth proxies; thus, the results across truth proxies were averaged. As shown in Fig. 15, there was virtually no dependence on viewing mode, and no obvious land–water differences. It appears that the footprint-level biases are truly instrument-related, and thus do not seem to strongly depend on other factors. Therefore, a single set of footprint-level biases was used. The adopted footprint biases for footprints 1–8 were (−0.36, −0.15, −0.16, −0.14, 0.02, 0.33, 0.13, 0.34) ppm, with an uncertainty of roughly ±0.03 ppm (1σ) on each. The reason for the general increase in this bias with increasing footprint is not known. Finally, while the fraction of the variance explained by footprint-level biases (∼2 %) is small compared to that explained by the parametric biases, they are straightforward to evaluate and could have an effect on local-scale analyses, and are therefore removed.

4.3.3 Bias correction: global scaling

Despite the corrections described above, there is still an overall XCO2 bias on the order of 1–2 ppm relative to the true atmosphere. As shown in Eq. (6), the denominator term C0 represents a global bias correction, and is parametrized as a function of viewing mode. As for the quality filtering and parametric bias correction, we found that the land scaling factor is roughly the same for nadir, glint, and target modes, such that a single scaling can be used for all land soundings. Ocean glint required a slightly different global scaling factor.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f16

Figure 16Scatter plot of 130 OCO-2 B8 target-mode XCO2 observations versus colocated TCCON observations, used in the determination of the global scaling factor C0 from Eq. (6). OCO-2 values have the parametric and footprint bias corrections applied.

Download

Table 11Global scaling factors (divisors) for OCO-2 version 8.

* Using a value of 0.9958 for land soundings.

Download Print Version | Download XLSX

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f17

Figure 17Annual mean biases and changes from the prior for all quality-flag “good” soundings from September 2014 through September 2017. (a–c) Parametric biases for dP, co2_grad_del, and DWS. (d) Sum of the parametric bias terms – note the color scale change. (e) Departure of the raw retrieved XCO2, including the global scaling correction, from the prior, XCO2,raw/C0-XCO2,ap. (f) Departure of the bias-corrected XCO2 from the prior, XCO2,bc-XCO2,ap.

Download

The B8 global scaling was determined primarily from several hundred direct OCO-2 overpasses of TCCON stations. We followed the geometric colocation method of Wunch et al. (2017), with the exception that sites in the Southern Hemisphere required the same latitude and longitude colocation thresholds as sites in the Northern Hemisphere. The TCCON value for a given overpass was determined as the mean of the observations within ±2 h of the OCO-2 overpass. At least 3 valid TCCON and 20 quality-flag “good” OCO-2 soundings were required per overpass. For each viewing mode, the slope m of the best-fit line passing through the origin was calculated with the method of York et al. (2004):

(8) X CO 2 , tccon = X CO 2 , OCO 2 C 0 ,

which provides the best-fit value of C0. The results for each viewing mode are shown in Table 11 under Method “TCCON”. It can be seen that the three sets of land overpasses yielded a scaling factor C0 consistent with each other to within their respective errors. The errors are representative differences of the fitted slope due to both retrieval errors as well as linear fit differences (for instance, using a least-squares fit versus a least-absolute-deviation fit), and were typically ±0.0003 (∼0.12 ppm). Because target-mode observations were better colocated, the target observation value of 0.9958 was adopted for all land observations.

For ocean glint, the global scaling factor was estimated with three methods: direct overpasses of TCCON stations and two independent “bootstrap” methods, using coastline crossings and models. Direct overpasses of TCCON stations yielded a value of 0.9956, slightly lower than the adopted land value but still consistent to within errors. For the coastline bootstrap method, a set of several hundred small areas centered on coastlines were identified in which it was possible to ratio the mean value of XCO2 over water to the mean value of XCO2 over land. This yielded a mean water/land ratio of 0.9997±0.0001, meaning that ocean values were slightly lower than land values. Multiplying this water/land ratio by the land scaling value yielded an ocean scaling value of 0.9955. Finally, the multi-model median truth proxy was used, wherein the slope of OCO-2 versus models was calculated, sampled at good-quality OCO-2 sounding locations. It was found that land required a scaling of 0.9950 and ocean a scaling of 0.9946, suggesting a water/land ratio for OCO-2 of roughly 0.9996±0.0001, similar to that of the coastline crossing value, and thus an ocean scaling value of 0.9954. Note that the absolute comparison of models relative to OCO-2 was not used here, as spin-up issues and averaging kernel corrections (ignored in this analysis) could yield a spurious global offset between the models and OCO-2. Therefore, only relative land–ocean differences were used to infer C0 in this “Model Bootstrap” method. As seen in Table 11, the “bootstrap” methods were remarkably consistent with each other and with the direct TCCON overpass method, all suggesting an ocean scaling of roughly 0.9955.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f18

Figure 18TCCON validation for OCO-2 XCO2, versions B7 (a, c, e) and B8 (b, d, f), for land nadir (a, b), land glint (c, d), and ocean glint (e, f) observations. Each symbol represents the overpass–mean comparison for one site overpass, with the total number of overpasses per site given in parentheses. Thus each symbol represents tens to hundreds of OCO-2 observations co-averaged. Quality-filtered and bias-corrected XCO2 is shown for OCO-2, along with the averaging-kernel correction. The solid line denotes the one-to-one line, and the dashed line is the line of best fit. The colocation strategy is described in the text. Shown in the upper left of each panel are the total number of overpasses (N), the mean, standard deviation (σ), and rms of the OCO-2 minus TCCON differences, the slope of best fit, and the R2 of the two data sets.

Download

All of the methods described above for determining the global scaling of XCO2 show remarkable consistency with each other, giving confidence that the overall scale of OCO-2 data is known to within a few tenths of a ppm, and the land–ocean difference is known to better than 0.2 ppm. One caveat is that the direct TCCON overpass comparisons did not account for the averaging kernel correction in this analysis. After the release of OCO-2 XCO2 B8, subsequent analysis showed that this correction typically lowered the value of TCCON by ∼0.1 ppm on average relative to OCO-2. Therefore, there is additional possible uncertainty in the overall magnitude of OCO-2 data by this amount.

4.3.4 Bias-correction evaluation

With all three sources of bias now characterized, the overall role of the bias correction in the retrieval can be evaluated. Figure 17 is an attempt to show this at the mean annual scale. Panels (a)(c) show the biases due to the three different bias terms: dP, co2_grad_del, and DWS. Of these three, dP is the strongest. This is apparent in panel (d), which shows the sum of the parametric biases (note the scale change between columns). Panel (e) shows the mean change from the prior in the raw retrieval, after correcting for the global bias term only (which is likely due to spectroscopic and instrumental bias). The change from the prior to the bias-corrected XCO2 is shown in panel (f), which combines these two terms.

The parametric bias, while smaller than the difference between the raw retrieved and prior XCO2, is of a comparable order of magnitude. Ideally, the parametric bias would be much smaller. As noted above, the parametric bias is dominated by the dP term. This term reflects the fact that the error in XCO2 is reduced using the prior rather than retrieved surface pressure. That is, the ACOS-retrieved slant column of air is dominated by systematic errors that are not reflected in the estimated CO2 slant column. We have identified two easily correctable sources of such error, both related to how the B8 surface pressure prior fields were derived. One of these was caused by a slight error in the knowledge of the pointing of the OCO-2 instrument that induces spurious small-scale error in the estimated prior surface pressure in regions of high topographic variability. The second was caused by sampling the GEOS5 FP-IT surface pressure at the wrong time of day, by up to several hours. Both of these effects have been corrected for in the version 9 OCO-2 XCO2 data, described in detail in Kiel et al. (2018).

Even after correcting the prior, the OCO-2 surface pressure retrievals still contain significant regional biases. These biases have a largely zonal structure, with a negative bias of up to -5 hPa at the highest latitudes and a positive bias of several hPa in the tropics, with an overall mean bias of roughly +2 hPa. The standard deviation of the surface pressure bias (relative to the GEOS5 FP-IT prior) for quality-filtered soundings is roughly 2.8 hPa. By binning nearby soundings, it is found that more than 2.4 hPa of this variation comes from systematic error scales greater than 1. One possible hypothesis is that this systematic error is due to O2 absorption cross-sectional errors and how they manifest themselves in the retrieval. For instance, an incorrect parameterization of the temperature dependence of absorption could yield errors similar to those observed. Future updates to our spectroscopy may reduce this bias, and are an active area of research within the ACOS team.

Currently, however, these multi-hPa systematic errors in the retrieved surface pressure are likely larger than errors in the GEOS5 FP-IT prior, which are believed to be on the order of 1–2 hPa. For instance, three reanalysis surface pressure sets were recently compared, and it was found that the differences were as small as 0.5 hPa in the tropical oceans and became larger at higher latitudes, such as in the Southern Ocean, where rms differences were on the order of 2 hPa (Jucks et al.2015). This is the basic reason behind the artificially high (4 hPa) 1σ uncertainty on the prior surface pressure currently used in the OCO-2 retrieval. If future versions of the retrieval (including spectroscopy updates) yield a more unbiased retrieval of surface pressure, it may reduce the role of dP in the bias correction and lead to a more accurate retrieval of XCO2.

The figure reveals several additional interesting features. The co2_grad_del bias is of a smaller magnitude than the dP bias, and has the strongest effect in tropical forests and a more diffuse effect elsewhere, including the tropical and southern oceans. The DWS bias has the largest effects over northern Africa, temperate Eurasia, and Australia, where large dust particles are prevalent. The total parametric bias pattern can sometimes cancel the departure from the prior, such as over Australia, indicating that the original departure was likely spurious. However, the overall large positive departure in the northern middle-to-high latitudes is not strongly affected by the bias correction, and thus appears to be a feature well captured by the native retrieval itself. This latter feature seems to imply that the interhemispheric gradient is too weak in the TCCON prior. The GGG2014 TCCON CO2 prior relies exclusively on the age of the air to create the interhemispheric gradient of CO2. The next release of the TCCON software includes an age-independent term in the CO2 priors representing the source–sink imbalance, which will roughly double the interhemispheric gradient (Geoff Toon, personal communication, 2018).

5 Brief evaluation of OCO-2 XCO2

Thus far, we have completely described the mechanics of the current ACOS retrieval and methodology, but have yet to evaluate the actual algorithm performance. As B7 XCO2 was validated in detail in Wunch et al. (2017), in this section we focus primarily on the differences (mainly improvements) between B7 and B8. Figure 18 shows the relationship between colocated TCCON and OCO-2 XCO2 observations, for both B7 and B8 OCO-2 retrievals. Operational quality filtering and bias correction have been applied for each version. We used the same colocation strategy as described in Sect. 4.1.1, but with the additional requirement that fossil fuel emissions from the 1 km 2013 ODIAC database (Oda and Maksyutov2011), smoothed with a 5 km Gaussian smoother, be less than 300 g m−2 month−1 at the location of the OCO-2 soundings; this eliminated OCO-2 soundings in the vicinity of strong fossil fuel sources. All good-quality OCO-2 soundings within each overpass were averaged (thus, one symbol on each plot denotes one overpass). Only overpasses with at least 10 such OCO-2 soundings were included. The TCCON XCO2 values are averages of all good-quality TCCON soundings at that site within ±2 h of the OCO-2 overpass.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f19

Figure 19The difference between OCO-2 bias-corrected XCO2 versus the model median where the models agree for both version 7 (a, c) and version 8 (b, d), using the agreement criteria as given in Sect. 4.1.3. Results are shown for two seasons: DJF 2014–2015 (a, b) and JJA 2015 (c, d).

Download

Based on these figures, B8 appears generally superior to B7 in terms of agreement with TCCON. First, there are more good-quality data in B7, at least for glint observations. This is primarily due to improvements in the prescreeners. In terms of accuracy, the scatter and outliers of XCO2 over both land and ocean are reduced in B7, especially over ocean, for which the outliers were driven by Southern Hemisphere observations (in particular the high southern-latitude sites, Lauder and Wollongong). The bias over land in B7 was significant, with a 0.3 ppm difference between land nadir and land glint. The overall apparent bias over land of 0.2–0.3 ppm is partly due to neglecting the averaging kernel effect when solving for the global divisors in the bias correction, and partly due to methodological differences in how we calculate the global bias in the first place. While the R2 values are significantly higher than those reported in Wunch et al. (2017), this is due to the extended length of the data record used here. Coupled with the secular increase in CO2, this leads to a larger dynamic range in XCO2 and hence more signal and higher correlations than when using a shorter data record. Finally, we note that in B8 (and to some extent B7) there is generally a negative slope between TCCON and OCO-2. This appears to be due to a trend in OCO-2 XCO2 relative to TCCON (not shown), in which OCO-2 appears to be losing XCO2 at a rate of 0.1–0.2 ppm yr−1, though this trend is not statistically significant. The apparent trend may be due to an OCO-2 calibration effect, and is currently under study.

The general improvement in B8 over B7 can also be seen in comparisons to models. Figure 19 shows the comparison of both versions to the six-model suite as discussed in Sect. 4.1.3. The large-scale differences between OCO-2 and model XCO2 are generally reduced in the latest version. The positive bias with respect to models over the Southern Hemisphere mid-latitude oceans is nearly removed in B8, as are some negative biases over Australia and the Sahara. Positive biases in the Northern Hemisphere mid-to-high latitudes over land are also reduced. We also see that the latitudinal extent of the ocean glint data is greater in version 8, especially in DJF; again, this is primarily due to updates in the prescreeners. A large-scale negative difference between OCO-2 relative to the model median persists in the tropical oceans, particularly over the Pacific and Indian basins, and is currently under study.

There are clear deficiencies remaining in the B8 OCO-2 XCO2 product. First, note again that Fig. 18 showed overpass average statistics. As each overpass had at least 10 OCO-2 soundings, and each sounding typically had <1 ppm posterior uncertainty, if the errors were all independent, the overpass average errors would be less than 0.3 ppm. Even taking into account TCCON and colocation errors, it is likely that the overpass-level (small-area) errors are still much larger than this due to correlated errors in the OCO-2 retrievals. A more detailed validation of OCO-2 B8, along with how its errors are correlated and how they integrate down, is the subject of a forthcoming paper (Kulawik et al.2018). Other error sources also are still plainly visible in the OCO-2 data. For instance, the topography-related biases noted by Wunch et al. (2017) still exist in B8, but have recently been tracked to a misspecification of the satellite-to-ground pointing vector, and will be corrected in a forthcoming version 9. Also, there are still cloud-related errors in the OCO-2 data, for instance as noted by Massie et al. (2016). It is believed that these are often related to three-dimensional cloud effects, for instance as discussed in Merrelli et al. (2015).

6 Summary and outlook

As described in this paper, the OCO-2 retrieval algorithm for XCO2 has been evolving more or less continuously over the last decade, and is beginning to achieve accuracies that enable ground-breaking carbon cycle science. The latest version (B8) has the lowest biases and highest throughput of any version yet, though regionally coherent biases still remain at a significant level (∼1 ppm). A number of choices and assumptions go into the algorithm, and due to its complexity in terms of the number of variables it must accommodate, further research is needed to improve it. These assumptions relate to a number of factors, such as clouds and aerosols, surface pressure, spectroscopy, and potential instrument problems (e.g., scattered light, drifting calibration), to name a few. Advances in these areas will form the basis of future algorithm improvements. These issues affect not only OCO-2, but potentially all current and future sensors relying on this technology to measure XCO2, such as the TanSat (Yang et al.2018), OCO-3 (Eldering et al.2018), GOSAT-2 (Nakajima et al.2012), MicroCarb (Pascal et al.2017), and GeoCarb (Moore et al.2018) missions.

To fully exploit space-based short-wave infrared measurements of reflected sunlight at high spectral resolution for studies of the carbon cycle, improvements must be made in several areas. First, satellite-based XCO2 retrieval biases must be further reduced. Next, in order to make and validate retrieval improvements, we must have validation data that are more accurate than the satellite retrievals in the first place. Satellite retrievals are currently pushing that limit; for instance, the stated station-level calibration accuracy for TCCON is currently 0.4 ppm (Wunch et al.2010). Calculations of OCO-2 station-level differences with TCCON show that the mean absolute bias at all stations with at least five valid overpasses is 0.4 ppm, right at this level. Finally, we must have inversion and data assimilation systems that can make maximum use of these data. This requires, for example, minimizing transport model error, currently an active area of research Basu et al. (2018); Schuh et al. (2018).

Significant progress has been made in the past decade in the retrieval of XCO2 from SCIAMACHY, GOSAT, and OCO-2 radiances. This paper shows that this progress continues. Given the numerous sensors planned for development and launch in the near term, the future of passive remote sensing of CO2 remains bright.

Code and data availability

The OCO-2 L2 Full Physics Code is open source and available on Github https://github.com/nasa/RtRetrievalFramework (last access: 4 December 2018), and the User's Guide, for it is available at http://nasa.github.io/RtRetrievalFrameworkDoc/ (last access: 4 December 2018). All of the OCO-2 data products are publicly available through the NASA Goddard Earth Science Data and Information Services Center (GES DISC) for distribution and archiving (http://disc.sci.gsfc.nasa.gov/OCO-2; last access: 4 December 2018). TCCON data were obtained from the TCCON data archive hosted by CaltechDATA, and are available from https://tccondata.org/.

XCO2 quality flag definitions

The ACOS XCO2 quality flags use a number of variables. Each has an upper and lower threshold. These variables and thresholds are given in Table A1.

Table A1XCO2 quality flag definition for version 8.

* IMAP-DOAS preprocessor.

Download Print Version | Download XLSX

Appendix B: Land surface BRDF parameterization

Since OCO-2 observations outside of target mode contain only single observation geometries, it is unrealistic to attempt to retrieve the BRDF shape on a per-observation basis. This fact, combined with the similar improvement seen in the different trial BRDFs, suggested that a single fixed BRDF shape could be used for all land footprints. The selected BRDF shape is a particular parameter set for the Rahman–Pinty–Verstraete (RPV) kernel (Rahman et al.1993) that has been used as an initial guess for spectral multi-angle polarimetric aerosol remote sensing (Dubovik et al.2011). This fixed BRDF shape is used within the physical forward model, and a similar set of two state variables is applied independently to each band to allow for the BRDF amplitude to have a linear spectral variation across the band. Since the RPV kernel assumes the surface is azimuthally symmetric, the absolute values of the azimuth angles are unimportant and the kernel function can be expressed in terms of the azimuth angle difference. Thus, the BRDF model used in the algorithm is a function of three angular variables, and can be expressed as

(B1) ρ ( θ i , θ r , Δ ϕ ) = [ w + s ( ν - ν 0 ) ] F ( θ i , θ r , Δ ϕ ; C ) ,

where θi and θr are the zenith angles in the incident and reflected directions, Δϕ is the relative zenith angle, w and s are the BRDF “weight” and “weight slope”, F is the fixed BRDF shape (the RPV kernel), and C are the fixed BRDF shape parameter values. The weight w and weight slope s are the retrieved variables, one each per band, with the linear variation computed in wavenumber space relative to per-band reference values (ν0). The RPV kernel function (Rahman et al.1993) has three parameters: ρ0, the hotspot parameter; Θ, the asymmetry parameter; and k, the anisotropy parameter. The functional form, as implemented in the VLIDORT routines used by the OCO-2 forward model, uses the exact form as given in Rahman et al. (1993).

The fixed values used for the parameters are ρ0=0.05, Θ=-0.1, and k=0.75. Figure B1 shows the RPV kernel shape for these parameters.

While the retrieval works with the weight and slope variables, w and s, due to the normalization of the RPV kernel these are not the most convenient or intuitive quantities. Therefore, we evaluate the actual BRDF kernel function for the primary observation geometry (incident direction from the Sun, reflected direction toward the sensor), and then scale by the retrieved weight and weight slope, to obtain the BRDF reflectance and reflectance slope. In the absence of atmospheric scattering, these values will be equal to the retrieved albedo and albedo slope using a Lambertian assumption. Therefore, in much of the high-quality retrieval output from the Version 8 algorithm, the reported BRDF reflectance and reflectance slope values will be similar to the albedo and albedo slope values reported in the Version 7 results. Observations with relatively higher amounts of aerosols or other complicating effects would be expected to have larger differences between the BRDF reflectance and Lambertian albedo.

https://www.atmos-meas-tech.net/11/6539/2018/amt-11-6539-2018-f20

Figure B1The shape of the RPV kernel for all reflection angles, for a 45 solar incidence angle. The incident direction is at 180. (meaning the solar irradiance is directed inwards from the left side).

Download

Author contributions

CO and AE were involved in nearly all aspects of this work. PW provided critical guidance on nearly all aspects of the work, throughout all stages. DC provided guidance on instrument effects on the algorithm and feedback on the algorithm. MG provided project leadership and algorithm guidance. BF designed and implemented many tests and performed substantial data analysis. CF was involved in earlier phases of algorithm development, in particular with the IMAP-DOAS retrieval, SIF retrieval, and EOF development. MK contributed to the bias correction and analyzed TCCON target-mode data. HL provided the updated cloud ice optical properties. LM created the testing data sets and warn levels, and contributed to filtering and bias correction. AM contributed substantial analysis and wrote the BRDF section. VN guided implementation of the BRDF surface model. RN performed data analysis, in particular with regards to aerosol effects. GO led the target-mode operational effort and organized the validation activities. VP led the spectroscopy effort and wrote the spectroscopy section. TT edited early drafts of this paper and led the pre-filtering activities and analysis. DW provided critical analysis of TCCON/OCO-2 comparisons and advice regarding TCCON data use. BD and FO made important contributions to the ABSCO spectroscopy. AC operationalized the code and assisted in daily operations. JM and MS coded the L2 algorithm and processed testing data sets. DB, SB, FC, SC, LF, and PP provided model data used in the filtering, bias-correction, and validation efforts. MD, OG, DG, FH, LI, RK, IM, JN, HO, CP, CR, MKS, KS, RS, YT, OU, and VV provided TCCON data used in the filtering, bias-correction, and validation efforts.

Competing interests

The authors declare that they have no conflict of interest.

Acknowledgements

Part of this work was conducted at the Jet Propulsion Laboratory, California Institute of Technology, under contract with the National Aeronautics and Space Administration (NASA) for the Orbiting Carbon Observatory 2 project. Work at Colorado State University and the Geology and Planetary Sciences Department at the California Institute of Technology was supported by subcontracts from the OCO-2 project. CarbonTracker CT2015 and CT-NRT.v2016-1 results provided by NOAA ESRL, Boulder, Colorado, USA, from the website at https://carbontracker.noaa.gov (last access: 4 December 2018). Jena CarboScope atmospheric inversion results provided by Christian Rödenbeck and the Max Planck Institute for Biogeochemistry, from http://www.bgc-jena.mpg.de/CarboScope/ (last access: 4 December 2018). Special thanks to Geoff Toon for illuminating discussions regarding the TCCON CO2 prior. We also thank Julia Marshall and one anonymous referee for their reviews of the manuscript, which greatly improved its quality.

Edited by: Helen Worden
Reviewed by: Julia Marshall and one anonymous referee

References

Baker, D. F., Bösch, H., Doney, S. C., O'Brien, D., and Schimel, D. S.: Carbon source/sink information provided by column CO2 measurements from the Orbiting Carbon Observatory, Atmos. Chem. Phys., 10, 4145–4165, https://doi.org/10.5194/acp-10-4145-2010, 2010. a

Basu, S., Guerlet, S., Butz, A., Houweling, S., Hasekamp, O., Aben, I., Krummel, P., Steele, P., Langenfelds, R., Torn, M., Biraud, S., Stephens, B., Andrews, A., and Worthy, D.: Global CO2 fluxes estimated from GOSAT retrievals of total column CO2, Atmos. Chem. Phys., 13, 8695–8717, https://doi.org/10.5194/acp-13-8695-2013, 2013. a

Basu, S., Baker, D. F., Chevallier, F., Patra, P. K., Liu, J., and Miller, J. B.: The impact of transport model differences on CO2 surface flux estimates from OCO-2 retrievals of column average CO2, Atmos. Chem. Phys., 18, 7189–7215, https://doi.org/10.5194/acp-18-7189-2018, 2018. a

Baum, B. A., Yang, P., Heymsfield, A. J., Platnick, S., King, M. D., Hu, Y.-X., and Bedka, S. T.: Bulk Scattering Properties for the Remote Sensing of Ice Clouds. Part II: Narrowband Models., J. Appl. Meteorol., 44, 1896–1911, https://doi.org/10.1175/JAM2309.1, 2005. a

Baum, B. A., Yang, P., Heymsfield, A. J., Bansemer, A., Cole, B. H., Merrelli, A., Schmitt, C., and Wang, C.: Ice cloud single-scattering property models with the full phase matrix at wavelengths from 0.2 to 100 μm, J. Quant. Spectrosc. Ra., 146, 123–139, https://doi.org/10.1016/j.jqsrt.2014.02.029, 2014. a

Bègue, N., Vignelles, D., Berthet, G., Portafaix, T., Payen, G., Jégou, F., Benchérif, H., Jumelet, J., Vernier, J.-P., Lurton, T., Renard, J.-B., Clarisse, L., Duverger, V., Posny, F., Metzger, J.-M., and Godin-Beekmann, S.: Long-range transport of stratospheric aerosols in the Southern Hemisphere following the 2015 Calbuco eruption, Atmos. Chem. Phys., 17, 15019–15036, https://doi.org/10.5194/acp-17-15019-2017, 2017. a, b

Benner, D., Rinsland, C., Devi, V., Smith, M., and Atkins, D.: A multispectrum nonlinear least squares fitting technique, J. Quant. Spectrosc. Ra., 53, 705–721, 1995. a

Benner, D. C., Devi, V. M., Sung, K., Brown, L. R., Miller, C. E., Payne, V. H., Drouin, B. J., Yu, S., Crawford, T. J., Mantz, A. W., Smith, M. A. H., and Gamache, R. R.: Line parameters including temperature dependences of air- and self-broadened line shapes of 12C16O2: 2.06-μm region, J. Mol. Spectrosc., 326, 21–47, https://doi.org/10.1016/j.jms.2016.02.012, 2016. a

Blumenstock, T., Hase, F., Schneider, M., Garcia, O. E., and Sepulveda, E.: TCCON data from Izana (ES), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.izana01.R0/1149295, 2014. a

Buchwitz, M., de Beek, R., Noël, S., Burrows, J. P., Bovensmann, H., Bremer, H., Bergamaschi, P., Körner, S., and Heimann, M.: Carbon monoxide, methane and carbon dioxide columns retrieved from SCIAMACHY by WFM-DOAS: year 2003 initial data set, Atmos. Chem. Phys., 5, 3313–3329, https://doi.org/10.5194/acp-5-3313-2005, 2005. a

Butz, A., Hasekamp, O. P., Frankenberg, C., and Aben, I.: Retrievals of atmospheric CO2 from simulated space-borne measurements of backscattered near-infrared sunlight: accounting for aerosol effects, Appl. Opt., 48, 3322–3336, https://doi.org/10.1364/AO.48.003322, 2009. a, b

Butz, A., Guerlet, S., Hasekamp, O. P., Kuze, A., and Suto, H.: Using ocean-glint scattered sunlight as a diagnostic tool for satellite remote sensing of greenhouse gases, Atmos. Meas. Tech., 6, 2509–2520, https://doi.org/10.5194/amt-6-2509-2013, 2013. a

Chatterjee, A., Gierach, M. M., Sutton, A. J., Feely, R. A., Crisp, D., Eldering, A., Gunson, M. R., O'Dell, C. W., Stephens, B. B., and Schimel, D. S.: Influence of El Niño on atmospheric CO2 over the tropical Pacific Ocean: Findings from NASAs OCO-2 mission, Science, 358, eaam5776, https://doi.org/10.1126/science.aam5776, 2017. a

Chevallier, F., Bréon, F.-M., and Rayner, P. J.: Contribution of the Orbiting Carbon Observatory to the estimation of CO2 sources and sinks: Theoretical study in a variational data assimilation framework, J. Geophys. Res., 112, D09307, https://doi.org/10.1029/2006JD007375, 2007. a

Chevallier, F., Ciais, P., Conway, T. J., Aalto, T., Anderson, B. E., Bousquet, P., Brunke, E. G., Ciattaglia, L., Esaki, Y., Fröhlich, M., Gomez, A., Gomez-Pelaez, A. J., Haszpra, L., Krummel, P. B., Langenfelds, R. L., Leuenberger, M., Machida, T., Maignan, F., Matsueda, H., Morguí, J. A., Mukai, H., Nakazawa, T., Peylin, P., Ramonet, M., Rivier, L., Sawa, Y., Schmidt, M., Steele, L. P., Vay, S. A., Vermeulen, A. T., Wofsy, S., and Worthy, D.: CO2 surface fluxes at grid point scale estimated from a global 21 year reanalysis of atmospheric measurements, J. Geophys. Res., 115, D21307, https://doi.org/10.1029/2010JD013887, 2010. a

Chevallier, F., Palmer, P. I., Feng, L., Boesch, H., O'Dell, C. W., and Bousquet, P.: Toward robust and consistent regional CO2 flux estimates from in situ and spaceborne measurements of atmospheric CO2, Geophys. Res. Lett., 41, 1065–1070, https://doi.org/10.1002/2013GL058772, 2014. a

Chevallier, F., Broquet, G., Pierangelo, C., and Crisp, D.: Probabilistic global maps of the CO2 column at daily and monthly scales from sparse satellite measurements, J. Geophys. Res., 122, 7614–7629, 2017. a

Chin, M., Ginoux, P., Kinne, S., Torres, O., Holben, B. N., Duncan, B. N., Martin, R. V., Logan, J. A., Higurashi, A., and Nakajima, T.: Tropospheric Aerosol Optical Thickness from the GOCART Model and Comparisons with Satellite and Sun Photometer Measurements, J. Atmos. Sci., 59, 461–483, https://doi.org/10.1175/1520-0469(2002)059<0461:TAOTFT>2.0.CO;2, 2002. a

Cogan, A. J., Boesch, H., Parker, R. J., Feng, L., Palmer, P. I., Blavier, J.-F. L., Deutscher, N. M., Macatangay, R., Notholt, J., Roehl, C., Warneke, T., and Wunch, D.: Atmospheric carbon dioxide retrieved from the Greenhouse gases Observing SATellite (GOSAT): Comparison with ground-based TCCON observations and GEOS-Chem model calculations, J. Geophys. Res., 117, D21301, https://doi.org/10.1029/2012JD018087, 2012. a, b

Colarco, P., da Silva, A., Chin, M., and Diehl, T.: Online simulations of global aerosol distributions in the NASA GEOS-4 model and comparisons to satellite and ground-based aerosol optical depth, J. Geophys. Res., 115, https://doi.org/10.1029/2009JD012820, 2010. a

Connor, B. J., Bösch, H., Toon, G., Sen, B., Miller, C., and Crisp, D.: Orbiting Carbon Observatory: Inverse method and prospective error analysis, J. Geophys. Res., 113, A05305, https://doi.org/10.1029/2006JD008336, 2008. a, b

Cox, C. and Munk, W. H.: The measurement of the roughness of the sea surface from photographs of the sun's glitter, J. Opt. Soc. Am., 44, 838–850, 1954. a

Crisp, D.: Measuring atmospheric carbon dioxide from space with the orbiting carbon observatory-2 (OCO-2), in: SPIE Optical Engineering+ Applications, International Society for Optics and Photonics, 960702–960702, 2015. a

Crisp, D., Miller, C. E., and DeCola, P. L.: NASA Orbiting Carbon Observatory: measuring the column averaged carbon dioxide mole fraction from space, J. Appl. Remote Sens., 2, 023508, https://doi.org/10.1117/1.2898457, 2008. a

Crisp, D., Bösch, H., Brown, L., Castano, R., Christi, M., Connor, B., Eldering, A., Fisher, B., Frankenberg, C., Gunson, M., Granat, R., McDuffie, J., Miller, C. E., Natraj, V., O'Brien, D., O'Dell, C., Osterman, G., Oyafuso, F., Payne, V., Polonsky, I., Smyth, M., Spurr, R., Thompson, D., and Toon, G.: OCO (Orbiting Carbon Observatory)-2 Level 2 Full Physics Retrieval Algorithm Theoretical Basis, Tech. Rep. OCO D-55207, NASA Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, version 3.0 Rev 0, available at: https://docserver.gesdisc.eosdis.nasa.gov/public/project/OCO/OCO2_L2_ATBD.V8.pdf (last access: 4 December 2018), 2017. a

Crisp, D., Fisher, B. M., O'Dell, C., Frankenberg, C., Basilio, R., Bösch, H., Brown, L. R., Castano, R., Connor, B., Deutscher, N. M., Eldering, A., Griffith, D., Gunson, M., Kuze, A., Mandrake, L., McDuffie, J., Messerschmidt, J., Miller, C. E., Morino, I., Natraj, V., Notholt, J., O'Brien, D. M., Oyafuso, F., Polonsky, I., Robinson, J., Salawitch, R., Sherlock, V., Smyth, M., Suto, H., Taylor, T. E., Thompson, D. R., Wennberg, P. O., Wunch, D., and Yung, Y. L.: The ACOS CO2 retrieval algorithm – Part II: Global XCO2 data characterization, Atmos. Meas. Tech., 5, 687–707, https://doi.org/10.5194/amt-5-687-2012, 2012. a, b, c, d

Crisp, D., Pollock, H. R., Rosenberg, R., Chapsky, L., Lee, R. A. M., Oyafuso, F. A., Frankenberg, C., O'Dell, C. W., Bruegge, C. J., Doran, G. B., Eldering, A., Fisher, B. M., Fu, D., Gunson, M. R., Mandrake, L., Osterman, G. B., Schwandner, F. M., Sun, K., Taylor, T. E., Wennberg, P. O., and Wunch, D.: The on-orbit performance of the Orbiting Carbon Observatory-2 (OCO-2) instrument and its radiometrically calibrated products, Atmos. Meas. Tech., 10, 59–81, https://doi.org/10.5194/amt-10-59-2017, 2017. a, b, c, d

Crowell, S., Baker, D. F., Basu, S., Jacobson, A. R., Chatterjee, A., Chevallier, F., Deng, F., Feng, L., Liu, J., Eldering, A., O'Dell, C. W., Schimel, D., Jones, D., and Palmer, P.: The 2015-2016 Carbon Cycle as seen from OCO-2 and the Global In Situ Network, Atmos. Chem. Phys., submitted, 2018a. a

Crowell, S. M. R., Kawa, R. S., Browell, E. V., Hammerling, D. M., Moore, B., Schaefer, K., and Doney, S. C.: On the Ability of Space-Based Passive and Active Remote Sensing Observations of CO2 to Detect Flux Perturbations to the Carbon Cycle, J. Geophys. Res., 123, 1460–1477, https://doi.org/10.1002/2017JD027836, 2018b. a

De Mazière, M., Sha, M. K., Desmet, F., Hermans, C., Scolas, F., Kumps, N., Metzger, J.-M., Duflot, V., and Cammas, J.-P.: TCCON data from Réunion Island (RE), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.reunion01.R0/1149288, 2014. a

Deutscher, N. M., Notholt, J., Messerschmidt, J., Weinzierl, C., Warneke, T., Petri, C., Grupe, P., and Katrynski, K.: TCCON data from Bialystok (PL), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.bialystok01.R1/1183984, 2015. a

Devi, V. M., Benner, D. C., Brown, L. R., Miller, C. E., and Toth, R. A.: Line mixing and speed dependence in CO2 at 6348cm1: Positions, intensities, and air- and self-broadening derived with constrained multispectrum analysis, J. Mol. Spectrosc., 242, 90–117, https://doi.org/10.1016/j.jms.2007.02.018, 2007. a

Devi, V. M., Benner, D. C., Sung, K., Brown, L. R., Crawford, T. J., Miller, C. E., Drouin, B. J., Payne, V. H., Yu, S., Smith, M. A. H., Mantz, A. W., and Gamache, R. R.: Line parameters including temperature dependences of self- and air-broadened line shapes of 12C16O2: 1.6-μm region, J. Quant. Spectrosc. Ra., 177, 117–144, https://doi.org/10.1016/j.jqsrt.2015.12.020, 2016. a, b

Drouin, B. J., Payne, V., Oyafuso, F., Sung, K., and Mlawer, E.: Pressure broadening of oxygen by water, J. Quant. Spectrosc. Ra., 133, 190–198, https://doi.org/10.1016/j.jqsrt.2013.08.001, 2014. a

Drouin, B. J., Benner, D. C., Brown, L. R., Cich, M. J., Crawford, T. J., Devi, V. M., Guillaume, A., Hodges, J. T., Mlawer, E. J., Robichaud, D. J., Oyafuso, F., Payne, V. H., Sung, K., Wishnow, E. H., and Yu, S.: Multispectrum analysis of the oxygen A-band, J. Quant. Spectrosc. Ra., 186, 118–138, https://doi.org/10.1016/j.jqsrt.2016.03.037, 2017. a, b, c

Dubey, M., Parker, H., Henderson, B., Green, D., Butterfield, Z., Keppel-Aleks, G., Allen, N., Blavier, J.-F., Roehl, C., Wunch, D., and Lindenmaier, R.: TCCON data from Manaus (BR), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.manaus01.R0/1149274, 2014. a

Dubovik, O., Herman, M., Holdak, A., Lapyonok, T., Tanré, D., Deuzé, J. L., Ducos, F., Sinyuk, A., and Lopatin, A.: Statistically optimized inversion algorithm for enhanced retrieval of aerosol properties from spectral multi-angle polarimetric satellite observations, Atmos. Meas. Tech., 4, 975–1018, https://doi.org/10.5194/amt-4-975-2011, 2011. a

Eldering, A., O'Dell, C. W., Wennberg, P. O., Crisp, D., Gunson, M. R., Viatte, C., Avis, C., Braverman, A., Castano, R., Chang, A., Chapsky, L., Cheng, C., Connor, B., Dang, L., Doran, G., Fisher, B., Frankenberg, C., Fu, D., Granat, R., Hobbs, J., Lee, R. A. M., Mandrake, L., McDuffie, J., Miller, C. E., Myers, V., Natraj, V., O'Brien, D., Osterman, G. B., Oyafuso, F., Payne, V. H., Pollock, H. R., Polonsky, I., Roehl, C. M., Rosenberg, R., Schwandner, F., Smyth, M., Tang, V., Taylor, T. E., To, C., Wunch, D., and Yoshimizu, J.: The Orbiting Carbon Observatory-2: first 18 months of science data products, Atmos. Meas. Tech., 10, 549–563, https://doi.org/10.5194/amt-10-549-2017, 2017a. a

Eldering, A., Wennberg, P. O., Crisp, D., Schimel, D. S., Gunson, M. R., Chatterjee, A., Liu, J., Schwandner, F. M., Sun, Y., O'Dell, C. W., Frankenberg, C., Taylor, T., Fisher, B., Osterman, G. B., Wunch, D., Hakkarainen, J., Tamminen, J., and Weir, B.: The Orbiting Carbon Observatory-2 early science investigations of regional carbon dioxide fluxes, Science, 358, eaam5745, https://doi.org/10.1126/science.aam5745, 2017b. a, b

Eldering, A., Taylor, T. E., O'Dell, C. W., and Pavlick, R.: The OCO-3 mission; measurement objectives and expected performance based on one year of simulated data, Atmos. Meas. Tech. Discuss., https://doi.org/10.5194/amt-2018-357, in review, 2018. a

Feist, D. G., Arnold, S. G., John, N., and Geibel, M. C.: TCCON data from Ascension Island (SH), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.ascension01.R0/1149285, 2014. a

Feng, L., Palmer, P. I., Bösch, H., and Dance, S.: Estimating surface CO2 fluxes from space-borne CO2 dry air mole fraction observations using an ensemble Kalman Filter, Atmos. Chem. Phys., 9, 2619–2633, https://doi.org/10.5194/acp-9-2619-2009, 2009. a

Frankenberg, C., O'Dell, C., Guanter, L., and McDuffie, J.: Remote sensing of near-infrared chlorophyll fluorescence from space in scattering atmospheres: implications for its retrieval and interferences with atmospheric CO2 retrievals, Atmos. Meas. Tech., 5, 2081–2094, https://doi.org/10.5194/amt-5-2081-2012, 2012. a

Frankenberg, C., Kulawik, S. S., Wofsy, S. C., Chevallier, F., Daube, B., Kort, E. A., O'Dell, C., Olsen, E. T., and Osterman, G.: Using airborne HIAPER Pole-to-Pole Observations (HIPPO) to evaluate model and remote sensing estimates of atmospheric carbon dioxide, Atmos. Chem. Phys., 16, 7867–7878, https://doi.org/10.5194/acp-16-7867-2016, 2016. a

Goo, T.-Y., Oh, Y.-S., and Velazco, V. A.: TCCON data from Anmeyondo (KR), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.anmeyondo01.R0, 2014. a

Griffith, D. W. T., Deutscher, N. M., Velazco, V. A., Wennberg, P. O., Yavin, Y., Keppel-Aleks, G., Washenfelder, R., Toon, G. C., Blavier, J.-F., Paton-Walsh, C., Jones, N. B., Kettlewell, G. C., Connor, B., Macatangay, R. C., Roehl, C., Ryczek, M., Glowacki, J., Culgan, T., and Bryant, G.: TCCON data from Darwin (AU), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.darwin01.R0/1149290, 2014a. a

Griffith, D. W. T., Velazco, V. A., Deutscher, N. M., Paton-Walsh, C., Jones, N. B., Wilson, S. R., Macatangay, R. C., Kettlewell, G. C., Buchholz, R. R., and Riggenbach, M.: TCCON data from Wollongong (AU), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.wollongong01.R0, 2014b. a, b

Guerlet, S., Butz, A., Schepers, D., Basu, S., Hasekamp, O. P., Kuze, A., Yokota, T., Blavier, J.-F., Deutscher, N. M., Griffith, D. W., Hase, F., Kyro, E., Morino, I., Sherlock, V., Sussmann, R., Galli, A., and Aben, I.: Impact of aerosol and thin cirrus on retrieving and validating XCO2 from GOSAT shortwave infrared measurements, J. Geophys. Res., 118, 4887–4905, https://doi.org/10.1002/jgrd.50332, 2013. a, b

Gunson, M. and Eldering, A.: OCO-2 Level 2 bias-corrected XCO2 and other select fields from the full-physics retrieval aggregated as daily files, Retrospective processing V8r Greenbelt, MD, USA, Goddard Earth Sciences Data and Information Services Center (GES DISC), https://doi.org/10.5067/XR7ZWYSKP7D0, 2017. a

Hakkarainen, J., Ialongo, I., and Tamminen, J.: Direct space-based observations of anthropogenic CO2 emission areas from OCO-2, Geophys. Res. Lett., 43, 11400–11406, https://doi.org/10.1002/2016GL070885, 2016. a

Hase, F., Blumenstock, T., Dohe, S., Gross, J., and Kiel, M.: TCCON data from Karlsruhe (DE), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.karlsruhe01.R1, 2015. a

Hedelius, J. K., Parker, H., Wunch, D., Roehl, C. M., Viatte, C., Newman, S., Toon, G. C., Podolske, J. R., Hillyard, P. W., Iraci, L. T., Dubey, M. K., and Wennberg, P. O.: Intercomparability of XCO2 and XCH4 from the United States TCCON sites, Atmos. Meas. Tech., 10, 1481–1493, https://doi.org/10.5194/amt-10-1481-2017, 2017. a

Inoue, M., Morino, I., Uchino, O., Miyamoto, Y., Yoshida, Y., Yokota, T., Machida, T., Sawa, Y., Matsueda, H., Sweeney, C., Tans, P. P., Andrews, A. E., Biraud, S. C., Tanaka, T., Kawakami, S., and Patra, P. K.: Validation of XCO2 derived from SWIR spectra of GOSAT TANSO-FTS with aircraft measurement data, Atmos. Chem. Phys., 13, 9771–9788, https://doi.org/10.5194/acp-13-9771-2013, 2013. a, b

Iraci, L. T., Podolske, J., Hillyard, P. W., Roehl, C., Wennberg, P. O., Blavier, J.-F., Allen, N., Wunch, D., Osterman, G., and Albertson, R.: TCCON data from Edwards (US), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.edwards01.R1/1255068, 2016. a

Jucks, K. W., Neeck, S., Abshire, J. B., Baker, D. F., Browell, E. V., Chatterjee, A., Crisp, D., Crowell, S. M., Denning, S., Hammerling, D., Harrison, F., Hyon, J. J., Kawa, S. R., Lin, B., Meadows, B. L., Menzies, R. T., Michalak, A., Moore, B., Murray, K. E., Ott., L. E., Rayner, P., Rodriguez, O. I., Schuh, A., Shiga, Y., Spiers, G. D., Wang, J. S., and Zaccheo, T. S.: Active Sensing of CO2 Emissions over Nights, Days, and Seasons (ASCENDS) mission: Science mission definition study, available at: https://cce.nasa.gov/ascends_2015/ASCENDSFinalDraft81915.pdf (last access: 4 December 2018), 2015. a

Kahn, R., Banerjee, P., and McDonald, D.: Sensitivity of multiangle imaging to natural mixtures of aerosols over ocean, J. Geophys. Res., 106, 18219–18238, https://doi.org/10.1029/2000JD900497, 2001. a

Kawakami, S., Ohyama, H., Arai, K., Okumura, H., Taura, C., Fukamachi, T., and Sakashita, M.: TCCON data from Saga (JP), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.saga01.R0/1149283, 2014. a

Keppel-Aleks, G., Wennberg, P. O., and Schneider, T.: Sources of variations in total column carbon dioxide, Atmos. Chem. Phys., 11, 3581–3593, https://doi.org/10.5194/acp-11-3581-2011, 2011. a

Kiel, M., O'Dell, C. W., Fisher, B., Eldering, A., Nassar, R., MacDonald, C. G., and Wennberg, P. O.: How bias correction goes wrong: Measurement of XCO2 affected by erroneous surface pressure estimates, Atmos. Meas. Tech. Discuss., https://doi.org/10.5194/amt-2018-353, in review, 2018. a, b

Kivi, R. and Heikkinen, P.: Fourier transform spectrometer measurements of column CO2 at Sodankylä, Finland, Geosci. Instrum. Method. Data Syst., 5, 271–279, https://doi.org/10.5194/gi-5-271-2016, 2016. a

Kulawik, S., Wunch, D., O'Dell, C., Frankenberg, C., Reuter, M., Oda, T., Chevallier, F., Sherlock, V., Buchwitz, M., Osterman, G., Miller, C. E., Wennberg, P. O., Griffith, D., Morino, I., Dubey, M. K., Deutscher, N. M., Notholt, J., Hase, F., Warneke, T., Sussmann, R., Robinson, J., Strong, K., Schneider, M., De Mazière, M., Shiomi, K., Feist, D. G., Iraci, L. T., and Wolf, J.: Consistent evaluation of ACOS-GOSAT, BESD-SCIAMACHY, CarbonTracker, and MACC through comparisons to TCCON, Atmos. Meas. Tech., 9, 683–709, https://doi.org/10.5194/amt-9-683-2016, 2016. a, b

Kulawik, S. S., O'Dell, C. W., Osterman, G. B., Wennberg, P. O., Wunch, D., Roehl, C. M., Deutscher, N. M., Kiel, M., Griffith, D. W. T., Velazco, V. A., Notholt, J., Warneke, T., Petri, C., De Maziere, M., Sha, M. K., Sussman, R., Rettinger, M., Pollard, D., Morino, I., Uchino, O., Hase, F., Feist, D. G., Strong, K., Kivi, R., Iraci, L., Shuji, K., Dubey, M. K., Sepulveda, E., García, O. E., Te, Y., Jeseck, P., Heikkinen, P., Schneider, M., Wofsy, S. C., McKain, K., Sweeney, C., Baker, D. F., and Liu, J.: Characterization of OCO-2 biases and errors for flux estimates, in preparation, 2018. a

Lee, R. A. M., O'Dell, C. W., Wunch, D., Roehl, C. M., Osterman, G. B., Blavier, J.-F., Rosenberg, R., Chapsky, L., Frankenberg, C., Hunyadi-Lay, S. L., Fisher, B. M., Rider, D. M., Crisp, D., and Pollock, R.: Preflight Spectral Calibration of the Orbiting Carbon Observatory 2, IEEE T. Geosci. Remote, 55, 2499–2508, https://doi.org/10.1109/TGRS.2016.2645614, 2017. a

Lindqvist, H., O'Dell, C. W., Basu, S., Boesch, H., Chevallier, F., Deutscher, N., Feng, L., Fisher, B., Hase, F., Inoue, M., Kivi, R., Morino, I., Palmer, P. I., Parker, R., Schneider, M., Sussmann, R., and Yoshida, Y.: Does GOSAT capture the true seasonal cycle of carbon dioxide?, Atmos. Chem. Phys., 15, 13023–13040, https://doi.org/10.5194/acp-15-13023-2015, 2015. a, b

Liu, J., Bowman, K. W., Schimel, D. S., Parazoo, N. C., Jiang, Z., Lee, M., Bloom, A. A., Wunch, D., Frankenberg, C., Sun, Y., O'Dell, C. W., Gurney, K. R., Menemenlis, D., Gierach, M., Crisp, D., and Eldering, A.: Contrasting carbon cycle responses of the tropical continents to the 2015–2016 El Niño, Science, 358, eaam5690, https://doi.org/10.1126/science.aam5690, 2017. a

Lucchesi, R.: File Specification for GEOS-5 FP-IT (Forward Processing for Instrument Teams), Tech. rep., NASA Goddard Spaceflight Center, Greenbelt, MD, USA, available at: https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20150001438.pdf (last access: 4 December 2018), 2013. a

Mandrake, L., Frankenberg, C., O'Dell, C. W., Osterman, G., Wennberg, P., and Wunch, D.: Semi-autonomous sounding selection for OCO-2, Atmos. Meas. Tech., 6, 2851–2864, https://doi.org/10.5194/amt-6-2851-2013, 2013. a

Mandrake, L., O'Dell, C. W., Wunch, D., Wennberg, P. O., Fisher, B., Osterman, G. B., and Eldering, A.: Orbiting Carbon Observatory-2 (OCO-2) Warn Level, Bias Correction, and Lite File Product Description, Tech. rep., Tech. rep., Jet Propulsion Laboratory, California Institute of Technology, Pasasdena, available at: https://disc.sci.gsfc.nasa.gov/OCO-2/documentation/oco-2-v7/OCO2_XCO2_Lite_Files_and_Bias_Correction_0915_sm.pdf (last access: 16 October 2015), Pasadena, CA, 2015. a

Massie, S. T., Schmidt, S. K., Eldering, A., and Crisp, D.: Observational evidence of 3-D cloud effects in OCO-2 CO2 retrievals, J. Geophys. Res., 122, 7064–7085, https://doi.org/10.1002/2016JD026111, 2016. a

Merrelli, A., Bennartz, R., O'Dell, C. W., and Taylor, T. E.: Estimating bias in the OCO-2 retrieval algorithm caused by 3-D radiation scattering from unresolved boundary layer clouds, Atmos. Meas. Tech., 8, 1641–1656, https://doi.org/10.5194/amt-8-1641-2015, 2015. a

Miller, C. E., Crisp, D., DeCola, P. L., Olsen, S. C., Randerson, J. T., Michalak, A. M., Alkhaled, A., Rayner, P., Jacob, D. J., Suntharalingam, P., Jones, D. B. A., Denning, A. S., Nicholls, M. E., Doney, S. C., Pawson, S., Bösch, H., Connor, B. J., Fung, I. Y., O'Brien, D., Salawitch, R. J., Sander, S. P., Sen, B., Tans, P., Toon, G. C., Wennberg, P. O., Wofsy, S. C., Yung, Y. L., and Law, R. M.: Precision requirements for space-based XCO2 data, J. Geophys. Res., 112, D10314, https://doi.org/10.1029/2006JD007659, 2007. a

Mlawer, E. J., Payne, V. H., Moncet, J.-L., Delamere, J. S., Alvarado, M. J., and Tobin, D. C.: Development and recent evaluation of the MT_CKD model of continuum absorption, Philos. T. R. Soc. A, 370, 2520–2556, https://doi.org/10.1098/rsta.2011.0295, 2012. a

Mondelain, D., Aradj, A., Kassi, S., and Campargue, A.: The water vapour self-continuum by CRDS at room temperature in the 1.6 µm transparency window, J. Quant. Spectrosc. Ra., 130, 381–391, https://doi.org/10.1016/j.jqsrt.2013.07.006, 2013. a

Moore, B., Crowell, S. M. R., Rayner, P. J., Kumer, J., O'Dell, C. W., O'Brien, D., Utembe, S., Polonsky, I., Schimel, D., and Lemen, J.: The Potential of the Geostationary Carbon Cycle Ob- servatory (GeoCarb) to Provide Multi-scale Constraints on the Carbon Cycle in the Americas, Front. Environ. Sci., 6, https://doi.org/10.3389/fenvs.2018.00109, 2018. a

Morino, I., Matsuzaki, T., and Horikawa, M.: TCCON data from Tsukuba (JP), 125HR, Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.tsukuba02.R1/1241486, 2016a. a

Morino, I., Yokozeki, N., Matsuzaki, T., and Horikawa, M.: TCCON data from Rikubetsu (JP), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.rikubetsu01.R1, 2016b. a

Nakajima, M., Kuze, A., and Suto, H.: The current status of GOSAT and the concept of GOSAT-2, in: Sensors, Systems, and Next-Generation Satellites XVI, vol. 8533 of Proc. SPIE, p. 853306, https://doi.org/10.1117/12.974954, 2012. a

Nassar, R., Hill, T. G., McLinden, C. A., Wunch, D., Jones, D. B. A., and Crisp, D.: Quantifying CO2 Emissions From Individual Power Plants From Space, Geophys. Res. Lett., 44, 10045–10053, https://doi.org/10.1002/2017GL074702, 2017. a

Nguyen, H., Osterman, G., Wunch, D., O'Dell, C., Mandrake, L., Wennberg, P., Fisher, B., and Castano, R.: A method for colocating satellite XCO2 data to ground-based data and its application to ACOS-GOSAT and TCCON, Atmos. Meas. Tech., 7, 2631–2644, https://doi.org/10.5194/amt-7-2631-2014, 2014. a, b

Notholt, J., Petri, C., Warneke, T., Deutscher, N. M., Buschmann, M., Weinzierl, C., Macatangay, R. C., and Grupe, P.: TCCON data from Bremen (DE), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.bremen01.R0/1149275, 2014. a

Notholt, J., Warneke, T., Petri, C., Deutscher, N. M., Weinzierl, C., Palm, M., and Buschmann, M.: TCCON data from Ny Ålesund, Spitsbergen (NO), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.nyalesund01.R0/1149278, 2017. a

Oda, T. and Maksyutov, S.: A very high-resolution (1 km × 1 km) global fossil fuel CO2 emission inventory derived using a point source database and satellite observations of nighttime lights, Atmos. Chem. Phys., 11, 543–556, https://doi.org/10.5194/acp-11-543-2011, 2011. a

O'Dell, C. W., Connor, B., Bösch, H., O'Brien, D., Frankenberg, C., Castano, R., Christi, M., Eldering, D., Fisher, B., Gunson, M., McDuffie, J., Miller, C. E., Natraj, V., Oyafuso, F., Polonsky, I., Smyth, M., Taylor, T., Toon, G. C., Wennberg, P. O., and Wunch, D.: The ACOS CO2 retrieval algorithm – Part 1: Description and validation against synthetic observations, Atmos. Meas. Tech., 5, 99–121, https://doi.org/10.5194/amt-5-99-2012, 2012. a, b, c, d, e, f, g, h, i, j

Oshchepkov, S., Bril, A., Yokota, T., Wennberg, P. O., Deutscher, N. M., Wunch, D., Toon, G. C., Yoshida, Y., O'Dell, C. W., Crisp, D., Miller, C. E., Frankenberg, C., Butz, A., Aben, I., Guerlet, S., Hasekamp, O., Boesch, H., Cogan, A., Parker, R., Griffith, D., Macatangay, R., Notholt, J., Sussmann, R., Rettinger, M., Sherlock, V., Robinson, J., Kyrö, E., Heikkinen, P., Feist, D. G., Morino, I., Kadygrov, N., Belikov, D., Maksyutov, S., Matsunaga, T., Uchino, O., and Watanabe, H.: Effects of atmospheric light scattering on spectroscopic observations of greenhouse gases from space. Part 2: Algorithm intercomparison in the GOSAT data processing for CO2 retrievals over TCCON sites, J. Geophys. Res.-Atmos., 118, 1493–1512, https://doi.org/10.1002/jgrd.50146, 2013. a

Oyafuso, F., Payne, V. H., Drouin, B. J., Devi, V. M., Benner, D. C., Sung, K., Yu, S., Gordon, I. E., Kochanov, R., Tan, Y., Crisp, D., Mlawer, E. J., and Guillaume, A.: High accuracy absorption coefficients for the Orbiting Carbon Observatory-2 (OCO-2) mission: Validation of updated carbon dioxide cross-sections using atmospheric spectra, J. Quant. Spectrosc. Ra., 203, 213–223, https://doi.org/10.1016/j.jqsrt.2017.06.012, 2017. a, b, c, d

Pascal, V., Buil, C., Loesel, J., Tauziede, L., Jouglet, D., and Buisson, F.: An improved microcarb dispersive instrumental concept for the measurement of greenhouse gases concentration in the atmosphere, Proc. SPIE,, 10563, 10563K-1–10563K-9, https://doi.org/10.1117/12.2304219, 2017. a

Peters, W., Jacobson, A. R., Sweeney, C., Andrews, A. E., Conway, T. J., Masarie, K., Miller, J. B., Bruhwiler, L. M. P., Petron, G., Hirsch, A. I., Worthy, D. E. J., van der Werf, G. R., Randerson, J. T., Wennberg, P. O., Krol, M. C., and Tans, P. P.: An atmospheric perspective on North American carbon dioxide exchange: CarbonTracker, P. Natl. Acad. Sci. USA, 104, 18925–18930, https://doi.org/10.1073/pnas.0708986104, 2007. a

Polyansky, O. L., Bielska, K., Ghysels, M., Lodi, L., Zobov, N. F., Hodges, J. T., and Tennyson, J.: High-Accuracy CO2 Line Intensities Determined from Theory and Experiment, Phys. Rev. Lett., 114, 243001, https://doi.org/10.1103/PhysRevLett.114.243001, 2015. a

Ptashnik, I. V., McPheat, R. A., Shine, K. P., Smith, K. M., and Williams, R. G.: Water vapor self-continuum absorption in near-infrared windows derived from laboratory measurements, J. Geophys. Res., 116, D16305, https://doi.org/10.1029/2011JD015603, 2011. a

Rahman, H., Pinty, B., and Verstraete, M. M.: Coupled surface-atmosphere reflectance (CSAR) model: 2. Semiempirical surface model usable with NOAA advanced very high resolution radiometer data, J. Geophys. Res.-Atmos., 98, 20791–20801, https://doi.org/10.1029/93JD02072, 1993. a, b, c

Rayner, P. J. and O'Brien, D. M.: The utility of remotely sensed CO2 concentration data in surface source inversions, Geophys. Res. Lett., 28, 175–178, https://doi.org/10.1029/2000GL011912, 2001. a

Reuter, M., Bovensmann, H., Buchwitz, M., Burrows, J. P., Connor, B. J., Deutscher, N. M., Griffith, D. W. T., Heymann, J., Keppel-Aleks, G., Messerschmidt, J., Notholt, J., Petri, C., Robinson, J., Schneising, O., Sherlock, V., Velazco, V., Warneke, T., Wennberg, P. O., and Wunch, D.: Retrieval of atmospheric CO2 with enhanced accuracy and precision from SCIAMACHY: Validation with FTS measurements and comparison with model results, J. Geophys. Res., 116, D04301, https://doi.org/10.1029/2010JD015047, 2011. a

Reuter, M., Buchwitz, M., Schneising, O., Noël, S., Bovensmann, H., and Burrows, J.: A Fast Atmospheric Trace Gas Retrieval for Hyperspectral Instruments Approximating Multiple Scattering – Part 2: Application to XCO2 Retrievals from OCO-2, Remote Sens., 9, 1102, https://doi.org/10.3390/rs9111102, 2017. a

Rienecker, M. M., Suarez, M. J., Gelaro, R., Todling, R., Bacmeister, J., Liu, E., Bosilovich, M. G., Schubert, S. D., Takacs, L., Kim, G.-K., Bloom, S., Chen, J., Collins, D., Conaty, A., da Silva, A., Gu, W., Joiner, J., Koster, R. D., Lucchesi, R., Molod, A., Owens, T., Pawson, S., Pegion, P., Redder, C. R., Reichle, R., Robertson, F. R., Ruddick, A. G., Sienkiewicz, M., and Woollen, J.: MERRA: NASA's modern-era retrospective analysis for research and applications, J. Climate, 24, 3624–3648, 2011. a

Rödenbeck, C.: Estimating CO2 sources and sinks from atmospheric mixing ratio measurements using a global inversion of atmospheric transport, Tech. rep., Max Planck Institute for Biogeochemistry, Jena, Germany, 2005. a

Rodgers, C. D.: Inverse Methods for Atmospheric Sounding: Theory and Practice, World Scientific, Singapore, 2000. a

Rothman, L. S., Gordon, I. E., Babikov, Y., Barbe, A., Chris Benner, D., Bernath, P. F., Birk, M., Bizzocchi, L., Boudon, V., Brown, L. R., Campargue, A., Chance, K., Cohen, E. A., Coudert, L. H., Devi, V. M., Drouin, B. J., Fayt, A., Flaud, J.-M., Gamache, R. R., Harrison, J. J., Hartmann, J.-M., Hill, C., Hodges, J. T., Jacquemart, D., Jolly, A., Lamouroux, J., Le Roy, R. J., Li, G., Long, D. A., Lyulin, O. M., Mackie, C. J., Massie, S. T., Mikhailenko, S., Müller, H. S. P., Naumenko, O. V., Nikitin, A. V., Orphal, J., Perevalov, V., Perrin, A., Polovtseva, E. R., Richard, C., Smith, M. A. H., Starikova, E., Sung, K., Tashkun, S., Tennyson, J., Toon, G. C., Tyuterev, V. G., and Wagner, G.: The HITRAN2012 molecular spectroscopic database, J. Quant. Spectrosc. Ra., 130, 4–50, https://doi.org/10.1016/j.jqsrt.2013.07.002, 2013. a

Salstein, D. A., Ponte, R. M., and Cady-Pereira, K.: Uncertainties in atmospheric surface pressure fields from global analyses, J. Geophys. Res., 113, D14107, https://doi.org/10.1029/2007JD009531, 2008. a

Schaepman-Strub, G., Schaepman, M., Painter, T., Dangel, S., and Martonchik, J.: Reflectance quantities in optical remote sensing – definitions and case studies, Remote Sens. Environ., 103, 27–42, https://doi.org/10.1016/j.rse.2006.03.002, 2006. a

Schuh, A., Jacobson, A. R., Basu, S., Weir, B., Baker, D. F., Bowman, K., Chevallier, F., Crowell, S., Davis, K., Deng, F., Denning, S., Feng, L., Jones, D., Liu, J., and Palmer, P.: Quantifying the Impact of Atmospheric Transport Uncertainty on CO2 Surface Flux Estimates, Global Biogeochem. Cy., under review, 2018. a

Schwandner, F. M., Gunson, M. R., Miller, C. E., Carn, S. A., Eldering, A., Krings, T., Verhulst, K. R., Schimel, D. S., Nguyen, H. M., Crisp, D., O'Dell, C. W., Osterman, G. B., Iraci, L. T., and Podolske, J. R.: Spaceborne detection of localized carbon dioxide sources, Science, 358, eaam5782, https://doi.org/10.1126/science.aam5782, 2017. a

Sherlock, V., Connor, B., Robinson, J., Shiona, H., Smale, D., and Pollard, D.: TCCON data from Lauder (NZ), 125HR, Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.lauder02.R0/1149298, 2014. a

Strong, K., Mendonca, J., Weaver, D., Fogal, P., Drummond, J. R., Batchelor, R., and Lindenmaier, R.: TCCON data from Eureka (CA), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.eureka01.R1/1325515, 2016. a

Suarez, M. J., Rienecker, M. M., Todling, R., Bacmeister, J., Takacs, L., Liu, H. C., Gu, W., Sienkiewicz, M., Koster, R. D., and Gelaro, R.: The GEOS-5 Data Assimilation System-Documentation of Versions 5.0.1, 5.1.0, and 5.2.0, Tech. rep., NASA Goddard Spaceflight Center, Greenbelt, MD, USA, available at: https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20120011955.pdf (last access: 4 December 2018), 2008. a

Sun, Y., Frankenberg, C., Jung, M., Joiner, J., Guanter, L., Köhler, P., and Magney, T.: Overview of Solar-Induced chlorophyll Fluorescence (SIF) from the Orbiting Carbon Observatory-2: Retrieval, cross-mission comparison, and global monitoring for GPP, Remote Sens. Environ., 209, 808–823, https://doi.org/10.1016/j.rse.2018.02.016, 2018. a, b

Sung, K., Brown, L. R., Toth, R. A., and Crawford, T. J.: Fourier transform infrared spectroscopy measurements of H2O-broadened half-widths of CO2at 4.3 μ, Can. J. Phys., 87, 469–484, https://doi.org/10.1139/P08-130, 2009. a

Sussmann, R. and Rettinger, M.: TCCON data from Garmisch (DE), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.garmisch01.R0/1149299, 2014. a

Taylor, T. E., O'Dell, C. W., Frankenberg, C., Partain, P. T., Cronk, H. Q., Savtchenko, A., Nelson, R. R., Rosenthal, E. J., Chang, A. Y., Fisher, B., Osterman, G. B., Pollock, R. H., Crisp, D., Eldering, A., and Gunson, M. R.: Orbiting Carbon Observatory-2 (OCO-2) cloud screening algorithms: validation against collocated MODIS and CALIOP data, Atmos. Meas. Tech., 9, 973–989, https://doi.org/10.5194/amt-9-973-2016, 2016. a, b, c

Te, Y., Jeseck, P., and Janssen, C.: TCCON data from Paris (FR), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.paris01.R0/1149279, 2014. a

Thompson, D., Chris Benner, D., Brown, L., Crisp, D., Malathy Devi, V., Jiang, Y., Natraj, V., Oyafuso, F., Sung, K., Wunch, D., Castano, R., and Miller, C.: Atmospheric validation of high accuracy CO2 absorption coefficients for the OCO-2 mission, J. Quant. Spectrosc. Ra., 113, 2265–2276, 2012. a, b, c

Toon, G. C.: Solar line list for GGG2014, https://doi.org/10.14291/tccon.ggg2014.solar.R0/1221658, 2014. a

Toon, G. C. and Wunch, D.: A stand-alone a priori profile generation tool for GGG2014, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.priors.R0/1221661, 2014. a

Velazco, V., Morino, I., Uchino, O., Hori, A., Kiel, M., Bukosa, B., Deutscher, N., Sakai, T., Nagai, T., Bagtasa, G., Izumi, T., Yoshida, Y., and Griffith, D.: TCCON Philippines: First Measurement Results, Satellite Data and Model Comparisons in Southeast Asia, Remote Sens., 9, 1228, https://doi.org/10.3390/rs9121228, 2017. a

Warneke, T., Messerschmidt, J., Notholt, J., Weinzierl, C., Deutscher, N. M., Petri, C., Grupe, P., Vuillemin, C., Truong, F., Schmidt, M., Ramonet, M., and Parmentier, E.: TCCON data from Orléans (FR), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.orleans01.R0/1149276, 2014. a

Wennberg, P. O., Roehl, C., Wunch, D., Toon, G. C., Blavier, J.-F., Washenfelder, R., Keppel-Aleks, G., Allen, N., and Ayers, J.: TCCON data from Park Falls (US), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.parkfalls01.R0/1149161, 2014. a

Wennberg, P. O., Wunch, D., Roehl, C., Blavier, J.-F., Toon, G. C., and Allen, N.: TCCON data from Caltech (US), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.pasadena01.R1, 2015. a

Wennberg, P. O., Wunch, D., Roehl, C., Blavier, J.-F., Toon, G. C., and Allen, N.: TCCON data from Lamont (US), Release GGG2014.R1, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.lamont01.R1/1255070, 2016. a

Worden, J. R., Doran, G., Kulawik, S., Eldering, A., Crisp, D., Frankenberg, C., O'Dell, C., and Bowman, K.: Evaluation and attribution of OCO-2 XCO2 uncertainties, Atmos. Meas. Tech., 10, 2759–2771, https://doi.org/10.5194/amt-10-2759-2017, 2017. a

Wu, L., Hasekamp, O., Hu, H., Landgraf, J., Butz, A., aan de Brugh, J., Aben, I., Pollard, D. F., Griffith, D. W. T., Feist, D. G., Koshelev, D., Hase, F., Toon, G. C., Ohyama, H., Morino, I., Notholt, J., Shiomi, K., Iraci, L., Schneider, M., de Mazière, M., Sussmann, R., Kivi, R., Warneke, T., Goo, T.-Y., and Té, Y.: Carbon dioxide retrieval from OCO-2 satellite observations using the RemoTeC algorithm and validation with TCCON measurements, Atmos. Meas. Tech., 11, 3111–3130, https://doi.org/10.5194/amt-11-3111-2018, 2018. a

Wunch, D., Toon, G. C., Wennberg, P. O., Wofsy, S. C., Stephens, B. B., Fischer, M. L., Uchino, O., Abshire, J. B., Bernath, P., Biraud, S. C., Blavier, J.-F. L., Boone, C., Bowman, K. P., Browell, E. V., Campos, T., Connor, B. J., Daube, B. C., Deutscher, N. M., Diao, M., Elkins, J. W., Gerbig, C., Gottlieb, E., Griffith, D. W. T., Hurst, D. F., Jiménez, R., Keppel-Aleks, G., Kort, E. A., Macatangay, R., Machida, T., Matsueda, H., Moore, F., Morino, I., Park, S., Robinson, J., Roehl, C. M., Sawa, Y., Sherlock, V., Sweeney, C., Tanaka, T., and Zondlo, M. A.: Calibration of the Total Carbon Column Observing Network using aircraft profile data, Atmos. Meas. Tech., 3, 1351–1362, https://doi.org/10.5194/amt-3-1351-2010, 2010. a, b

Wunch, D., Toon, G. C., Blavier, J. F., Washenfelder, R. A., Notholt, J., Connor, B. J., Griffith, D. W. T., Sherlock, V., and Wennberg, P. O.: The Total Carbon Column Observing Network, Philos. T. R. Soc. A, 369, 2087–2112, https://doi.org/10.1098/rsta.2010.0240, 2011a. a, b, c, d, e, f, g, h, i, j

Wunch, D., Wennberg, P. O., Toon, G. C., Connor, B. J., Fisher, B., Osterman, G. B., Frankenberg, C., Mandrake, L., O'Dell, C., Ahonen, P., Biraud, S. C., Castano, R., Cressie, N., Crisp, D., Deutscher, N. M., Eldering, A., Fisher, M. L., Griffith, D. W. T., Gunson, M., Heikkinen, P., Keppel-Aleks, G., Kyrö, E., Lindenmaier, R., Macatangay, R., Mendonca, J., Messerschmidt, J., Miller, C. E., Morino, I., Notholt, J., Oyafuso, F. A., Rettinger, M., Robinson, J., Roehl, C. M., Salawitch, R. J., Sherlock, V., Strong, K., Sussmann, R., Tanaka, T., Thompson, D. R., Uchino, O., Warneke, T., and Wofsy, S. C.: A method for evaluating bias in global measurements of CO2 total columns from space, Atmos. Chem. Phys., 11, 12317–12337, https://doi.org/10.5194/acp-11-12317-2011, 2011b. a

Wunch, D., Toon, G. C., Sherlock, V., Deutscher, N. M., Liu, C., Feist, D. G., and Wennberg, P. O.: The Total Carbon Column Observing Network's GGG2014 Data Version, Tech. rep., Carbon Dioxide Information Analysis Center, Oak Ridge National Laboratory, Oak Ridge, Tennessee, USA, https://doi.org/10.14291/tccon.ggg2014.documentation.R0, 2015. a

Wunch, D., Mendonca, J., Colebatch, O., Allen, N. T., Blavier, J.-F., Springett, S., Neufeld, G., Strong, K., Kessler, R., and Worthy, D.: TCCON data from East Trout Lake, SK (CA), Release GGG2014.R0, TCCON Data Archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.easttroutlake01.R0, 2016. a

Wunch, D., Wennberg, P. O., Osterman, G., Fisher, B., Naylor, B., Roehl, C. M., O'Dell, C., Mandrake, L., Viatte, C., Kiel, M., Griffith, D. W. T., Deutscher, N. M., Velazco, V. A., Notholt, J., Warneke, T., Petri, C., De Maziere, M., Sha, M. K., Sussmann, R., Rettinger, M., Pollard, D., Robinson, J., Morino, I., Uchino, O., Hase, F., Blumenstock, T., Feist, D. G., Arnold, S. G., Strong, K., Mendonca, J., Kivi, R., Heikkinen, P., Iraci, L., Podolske, J., Hillyard, P. W., Kawakami, S., Dubey, M. K., Parker, H. A., Sepulveda, E., García, O. E., Te, Y., Jeseck, P., Gunson, M. R., Crisp, D., and Eldering, A.: Comparisons of the Orbiting Carbon Observatory-2 (OCO-2) XCO2 measurements with TCCON, Atmos. Meas. Tech., 10, 2209–2238, https://doi.org/10.5194/amt-10-2209-2017, 2017. a, b, c, d, e, f, g, h, i

Yang, D., Liu, Y., Cai, Z., Chen, X., Yao, L., and Lu, D.: First Global Carbon Dioxide Maps Produced from TanSat Measurements, Adv. Atmos. Sci., 35, 621–623, https://doi.org/10.1007/s00376-018-7312-6, 2018. a

Yang, P., Bi, L., Baum, B. A., Liou, K.-N., Kattawar, G. W., Mishchenko, M. I., and Cole, B.: Spectrally Consistent Scattering, Absorption, and Polarization Properties of Atmospheric Ice Crystals at Wavelengths from 0.2 to 100μm, J. Atmos. Sci., 70, 330–347, https://doi.org/10.1175/JAS-D-12-039.1, 2013.  a

Yokota, T., Yoshida, Y., Eguchi, N., Ota, Y., Tanaka, T., Watanabe, H., and Maksyutov, S.: Global Concentrations of CO2 and CH4 Retrieved from GOSAT: First Preliminary Results, SOLA, 5, 160–163, 2009.  a

York, D., Evensen, N. M., Martínez, M. L., and De Basabe Delgado, J.: Unified equations for the slope, intercept, and standard errors of the best straight line, Am. J. Phys., 72, 367–375, https://doi.org/10.1119/1.1632486, 2004. a

1

This excludes parameters in our state vector with prior uncertainties close to zero, such as cloud and aerosol layer widths.

2

Not to be confused with the South Atlantic Anomaly.

3

The units of the albedo slope are in per unit wavenumber, increasing with wavenumber.

4

Note that these passing rates are lower than those in Figs. 10 and 11, which were based on a smaller training data set that included more successful and clear-sky soundings, with fewer soundings in difficult regions such as over heavy clouds or snow and ice-covered surfaces.