A scientific algorithm to simultaneously retrieve carbon monoxide and methane from TROPOMI onboard Sentinel-5 Precursor
Carbon monoxide (CO) is an important atmospheric constituent affecting air quality, and methane (CH4) is the second most important greenhouse gas contributing to human-induced climate change. Detailed and continuous observations of these gases are necessary to better assess their impact on climate and atmospheric pollution. While surface and airborne measurements are able to accurately determine atmospheric abundances on local scales, global coverage can only be achieved using satellite instruments.
The TROPOspheric Monitoring Instrument (TROPOMI) onboard the Sentinel-5 Precursor satellite, which was successfully launched in October 2017, is a spaceborne nadir-viewing imaging spectrometer measuring solar radiation reflected by the Earth in a push-broom configuration. It has a wide swath on the terrestrial surface and covers wavelength bands between the ultraviolet (UV) and the shortwave infrared (SWIR), combining a high spatial resolution with daily global coverage. These characteristics enable the determination of both gases with an unprecedented level of detail on a global scale, introducing new areas of application.
Abundances of the atmospheric column-averaged dry air mole fractions XCO and XCH4 are simultaneously retrieved from TROPOMI's radiance measurements in the 2.3 µm spectral range of the SWIR part of the solar spectrum using the scientific retrieval algorithm Weighting Function Modified Differential Optical Absorption Spectroscopy (WFM-DOAS). This algorithm is intended to be used with the operational algorithms for mutual verification and to provide new geophysical insights. We introduce the algorithm in detail, including expected error characteristics based on synthetic data, a machine-learning-based quality filter, and a shallow learning calibration procedure applied in the post-processing of the XCH4 data. The quality of the results based on real TROPOMI data is assessed by validation with ground-based Fourier transform spectrometer (FTS) measurements providing realistic error estimates of the satellite data: the XCO data set is characterised by a random error of 5.1 ppb (5.8 %) and a systematic error of 1.9 ppb (2.1 %); the XCH4 data set exhibits a random error of 14.0 ppb (0.8 %) and a systematic error of 4.3 ppb (0.2 %). The natural XCO and XCH4 variations are well-captured by the satellite retrievals, which is demonstrated by a high correlation with the validation data (R=0.97 for XCO and R=0.91 for XCH4 based on daily averages).
We also present selected results from the mission start until the end of 2018, including a first comparison to the operational products and examples of the detection of emission sources in a single satellite overpass, such as CO emissions from the steel industry and CH4 emissions from the energy sector, which potentially allows for the advance of emission monitoring and air quality assessments to an entirely new level.
Carbon monoxide (CO) is an atmospheric pollutant compromising air quality. It is a colourless, odourless, and tasteless gas that can disrupt the transport of oxygen by haemoglobin in the red blood cells after inhalation of high doses, thus having the ability to cause severe health problems (Omaye, 2002). Its lifetime of about 1 to 2 months allows it to be used as a tracer for the long-range transport of pollution. CO plays a central role in tropospheric chemistry by acting as a precursor to tropospheric ozone (The Royal Society, 2008), which is another pollutant considered harmful to public health and a greenhouse gas. Moreover, CO is the largest direct sink of the hydroxyl radical (OH) affecting the self-cleansing capacity of the atmosphere, as the consumed OH cannot deplete other atmospheric constituents such as methane anymore. Hence, CO can be interpreted as an indirect agent of climate change because it is affecting concentrations of direct greenhouse gases.
Methane (CH4) is an important long-lived anthropogenically released greenhouse gas. It is second only to carbon dioxide (CO2), which accounts for the largest share of radiative forcing caused by human activities since 1750. CH4 is less abundant in the atmosphere than CO2, but it has a considerably higher global warming potential per unit mass. An accurate understanding of the sources and sinks of CH4 is indispensable to reliably predict future climate. Due to its relatively long atmospheric perturbation lifetime (budget lifetime multiplied by feedback factor) of about 12 years (Prather et al., 2012; Holmes et al., 2013), CH4 is well-mixed in the atmosphere and the signals in question are typically only small variations on top of large background concentrations. Therefore, requirements for the precision and accuracy of atmospheric CH4 measurements are demanding (Meirink et al., 2006; Bergamaschi et al., 2009; World Meteorological Organization, 2006, 2011).
Detailed and continuous observations with global coverage of both gases are needed to improve our understanding of the climate system, tropospheric chemistry, and atmospheric transport processes. This objective can only be achieved using satellite instruments. Several spaceborne instruments have been measuring CO and CH4 on a global scale up to now, including the Atmospheric Infrared Sounder (AIRS) (McMillan et al., 2005; Xiong et al., 2008), the Tropospheric Emission Spectrometer (TES) (Luo et al., 2015; Worden et al., 2012), and the Infrared Atmospheric Sounding Interferometer (IASI) (Clerbaux et al., 2009), which observe emissions in the thermal infrared (TIR) and are mainly sensitive to mid- to upper-tropospheric abundances. For CO this category is expanded by the Measurement of Pollution in the Troposphere (MOPITT) instrument (Drummond et al., 2010), which combines observations of spectral features in the TIR and in the shortwave infrared (SWIR), increasing surface-level sensitivity in some scenes (Worden et al., 2010).
Nearly equal sensitivity to all altitude levels, including the boundary layer, can be achieved from radiance measurements of reflected solar radiation in the SWIR part of the spectrum. This was first demonstrated by retrievals from the SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (SCIAMACHY) instrument (Burrows et al., 1995; Bovensmann et al., 1999) onboard ENVISAT for CO (Buchwitz et al., 2004; de Laat et al., 2010) and CH4 (Buchwitz et al., 2005; Frankenberg et al., 2006) in the 2.3 or 1.6 µm spectral range. ENVISAT was launched in 2002 and the end of the mission was declared after 10 years in orbit due to unexpected loss of contact with the satellite in 2012. The Thermal And Near infrared Sensor for carbon Observations Fourier-Transform Spectrometer (TANSO-FTS) onboard the Greenhouse gases Observing SATellite (GOSAT) (Kuze et al., 2009), which was launched in 2009, also yields atmospheric CH4 with high near-surface sensitivity but with a fairly sparse spatial sampling interval of about 160 km in five-point across-track mode between its 10 km diameter circular footprints. Its successor GOSAT-2 (launched in 2018) has an extended spectral range and is designed to additionally measure CO.
The launch of the Sentinel-5 Precursor (Sentinel-5P) satellite in October 2017 with the TROPOspheric Monitoring Instrument (TROPOMI) onboard (Veefkind et al., 2012) can be considered a game changer for the determination of atmospheric composition from space. TROPOMI is a spaceborne nadir-viewing imaging spectrometer measuring solar radiation reflected by the Earth in a push-broom configuration. It has a swath width of 2600 km and allows for the analysis of several atmospheric species with an unprecedented level of detail by combining high precision and spatial resolution with daily global coverage. TROPOMI measures radiances between the ultraviolet (UV) and the shortwave infrared (SWIR) in eight bands. The characteristics of the TROPOMI NIR and SWIR bands are summarised in Table 1.
CO and CH4 can be retrieved from radiance measurements in TROPOMI's SWIR bands. For these bands, the spatial resolution of the nadir measurements is typically 7 km × 7 km, which is almost 40 times finer than for SCIAMACHY. In contrast to TANSO, the imaging capabilities of TROPOMI provide 3 orders of magnitude more measurements without gaps, thus facilitating real global maps of CO and CH4 in a short time. The unique combination of high precision, spatiotemporal resolution, and coverage enables new fields of application. As large sources are readily detected in a single overpass, emission monitoring and air quality assessments are only two examples of the new prospects TROPOMI offers. The first applications concerning CO and CH4 have already been highlighted and demonstrated in recent publications (Hu et al., 2018; Borsdorff et al., 2018, 2019; Schneising et al., 2019).
As in the fields of weather and climate modelling, ensemble approaches have recently acquired an increased importance in the context of satellite observations, aiming at benefitting from a larger range of possible realisations of different physical aspects (Reuter et al., 2013) or to analyse to what extent specific geophysical findings depend on the particular characteristics of an algorithm or instrument (Buchwitz et al., 2017). Along these lines, it is worthwhile to have a set of distinct retrieval algorithms for each analysed atmospheric constituent at hand.
Here we introduce a scientific algorithm to retrieve CO and CH4 simultaneously from TROPOMI that has the objective of complementing the operational algorithms in the sense described above and to provide new geophysical insights, whilst performing within the mission requirements concerning random and systematic errors at the same time. The presented scientific algorithm differs from the operational algorithms in several respects (Landgraf et al., 2016; Hu et al., 2016) (see also Sect. 4.1 for a summary of the differences), and the corresponding products are thus predestined to be used together with the operational products in an ensemble approach. After a thorough description of the algorithm, including error characteristics based on synthetic data and validation with independent reference data, we present the first results of our new algorithm for both trace gases, demonstrating broad consistency with the operational products for example cases and the potential to advance the new application fields, for which TROPOMI's groundbreaking features pave the way.
The Weighting Function Modified Differential Optical Absorption Spectroscopy (WFM-DOAS) algorithm (Buchwitz et al., 2006, 2007; Schneising et al., 2011, 2014) is a linear least-squares method based on scaling (or shifting) preselected atmospheric vertical profiles. The vertical columns of the desired gases are determined from the measured sun-normalised radiance by fitting a linearised radiative transfer model to it. A concise mathematical algorithm description and the key settings and adjustments for the simultaneous CO and CH4 retrieval from TROPOMI's radiance measurements are summarised in the following subsections. The data products are based on TROPOMI Level 1b V01.00.00 files comprising spectra from the nominal operational mode, which started at the end of April 2018, and reprocessed spectra from the previous 6-month commissioning phase. The corresponding version is referred to as TROPOMI/WFMD (or WFMD in abbreviated form) v1.2.
2.1 Forward model
The forward model is derived from the radiative transfer model SCIATRAN (Rozanov et al., 2002, 2014) in pseudo-spherical atmosphere mode. To enable a fast retrieval, a lookup table scheme for the radiances and their derivatives has been implemented, containing 17 280 reference spectra for varying solar zenith angle, altitude, albedo, water vapour, and temperature. The reference spectra are computed with high spectral resolution in line-by-line mode and subsequently convolved to the TROPOMI spectral resolution of the SWIR bands using an instrument-specific fixed spectral response function extracted from the TROPOMI ISRF Calibration Key Data v1.0.0 for nadir at 2338 nm. The auxiliary input data include US Standard Atmosphere profiles with methane scaled to 1850 ppb, the SCIATRAN aerosol model using the background scenario described in Schneising et al. (2008, 2009), and HITRAN 2016 spectroscopic parameters (Gordon et al., 2017).
2.2 Inversion procedure
The linearised radiative transfer model (appropriately chosen from the lookup table according to the relevant parameters) plus a low-order polynomial is linear least-squares fitted to the logarithm of the measured sun-normalised radiance. The trace gas vertical profiles (CH4, CO, H2O) are scaled for the fit (i.e. the profile shape is not varied). Additional fit parameters are the shift of a preselected temperature profile, a scaling factor for the pressure profile, and parameters for a 2nd-order polynomial.
Let m∈ℕ be the number of spectral points in the fitting window and n∈ℕ the number of state vector elements (fit parameters) with m≫n. The modelled radiance at wavelength λ is given by
with state vector v, linearisation point , and polynomial coefficients a of 2nd-order polynomial P. A derivative with respect to a vertical column thereby refers to the change in the top-of-atmosphere radiance caused by a scaling of a preselected absorber concentration vertical profile. There are m equations of this type, one for each detector pixel in the fitting window. The objective is to find the optimal state so that the linear model best fits the observed radiance. This problem can be rewritten as
with (log-)radiance difference y∈ℝm of the measurement and linearised model due to a deviation x∈ℝn of the state vector from the multidimensional linearisation point, weighting function (Jacobian) matrix (with derivatives at the linearisation point and polynomial basis functions as columns) and the sum of forward model error and (normally distributed log-transformed) instrument noise ϵ∈ℝm.
The covariance matrix associated with measurement noise is given by . To give larger weight to spectral points with smaller error variances and to obtain error estimates of the retrieval parameters via error propagation from the uncorrelated measurement errors σi, a weighted least-squares approach is applied with a matrix of weights defined by . With the posterior probability p(x∣y) of x given y, the most probable inference of the inversion is obtained by minimising
with respect to x, where T is the matrix transpose. Hence,
provides the solution of the inverse problem, where is the covariance matrix of solution . The errors of the retrieval parameters are estimated by
Due to the potential non-linear dependencies of the radiances with respect to water vapour and temperature within their natural variability, the algorithm treats both parameters iteratively. The algorithm starts with lookup table elements representing US Standard Atmosphere water vapour amount and temperature. If the retrieved parameter pair after the fit is closer to another lookup table element, the process is repeated with the corresponding reference spectrum. Usually convergence is achieved after one iteration step.
As the lookup table only covers direct nadir conditions to limit its dimension to a reasonable size, a geometric path length correction has been implemented to remove the path extension and associated enhancement of the retrieved vertical columns for off-nadir conditions with a non-vanishing viewing zenith angle.
The spectral fitting windows in TROPOMI band 7 were optimised to retrieve CO and CH4 simultaneously as accurately as possible (determined by an error analysis based on simulated measurements). They are shown in Fig. 1 together with the absorption features of the relevant trace gases. Note that CO is a much weaker absorber compared to CH4 and H2O. The apparent albedo is retrieved in the preprocessing by comparison of the measured continuum radiance with precalculated values from a lookup table. Cloud information is obtained from strong H2O absorption lines in band 8 (see Fig. 1) by comparing the measured radiances to reference radiances for cloud-free conditions. As the absorption in these lines is strong, the measured radiance is small in the clear-sky case. In the presence of clouds, most of the atmospheric H2O is shielded and the measured backscattered radiance coherently increases (Heymann et al., 2012). The corresponding ratio rcld of measured to reference radiance for the selected strong absorption lines is thus an indicator of cloud contamination.
2.3 Sensitivity and error analysis using synthetic data
The sensitivity of the retrievals to different atmospheric layers is demonstrated by the vertical column averaging kernels (Fig. 2). Compared to measurements in the thermal infrared spectral region, which are primarily sensitive to mid- or upper-tropospheric gas abundances in the absence of high thermal contrast, the advantage of the shortwave infrared spectral region is the sensitivity to all altitude levels, including the boundary layer, which is important to analyse emissions originating from the Earth's surface.
As described in the previous subsection, the retrieval noise is determined via error propagation from the measurement noise. To assess the theoretical precision performance, we assume a simple shot noise-limited noise model, which is defined in the following way: the reference signal-to-noise ratio is SNref=100 in the continuum (radiance phot s−1 cm−2 nm−1 sr−1) for a dark scene (albedo=0.05) with low sun (solar zenith angle of 70∘) and is scaled according to
for other radiances. The resulting absolute precision is widely independent of the current concentrations. For US Standard Atmosphere values, the corresponding relative retrieval noise for different albedos and solar zenith angles is shown in Fig. 3. It is below 1 % for solar zenith angles smaller than 75∘ and albedos larger than 0.03 in the case of CH4. As the CO absorption is considerably weaker than the CH4 absorption, the CO retrieval exhibits larger relative noise, which is below 8 % for albedos larger than 0.03.
The analysis of systematic errors is performed using simulated measurements. That means that for different scenarios defined by specific atmospheric conditions, radiances and irradiances are calculated with the radiative transfer model, which are subsequently used as measurement input in the retrieval. The errors are then defined as the deviation of the retrieved from the true quantities. The corresponding results for several scenarios are summarised in Table 2. All scenarios already include interpolation between different wavelength grids (for measured and reference spectra) unless otherwise stated.
The analysis includes basic scenarios testing if perturbations of the state vector elements can be retrieved, quantifying lookup table interpolation errors, and analysing errors caused by off-nadir conditions. In order to examine the sensitivity to vertical profile variations, the scenario class of profiles includes several realistic model atmospheres based on measurements and theoretical predictions (Anderson et al., 1986), with all methane profiles scaled to have surface values of 1850 ppb in each case to better represent current atmospheric conditions. The respective atmospheres differ from the US Standard Atmosphere with respect to temperature, pressure, water vapour, carbon monoxide, and methane profiles (see Appendix A of Anderson et al. (1986) for a visualisation of the different vertical profiles). These scenarios are more difficult to deal with than the basic ones because the perturbations are not consistent with the scaling assumption; i.e. they include proper variations of the profile shape.
Also examined is the sensitivity to the spectral albedo of the natural surface types shown in Fig. 4 taken from the Advanced Spaceborne Thermal Emission Reflection Radiometer (ASTER) and United States Geological Survey (USGS) spectral libraries. The analysed aerosol scenarios are largely described in Schneising et al. (2008, 2009), with aerosol type definitions in the different atmospheric layers based on Optical Properties of Aerosols and Clouds (OPAC) (Hess et al., 1998). The retrieval errors due to undetected subvisual clouds are also investigated for different ice and water clouds.
This gives an impression of the magnitude of errors one can expect, assuming that thick clouds can be filtered out by cloud screening in the preprocessing or post-processing: typical systematic retrieval errors are below 1 % for methane and below 2 % for carbon monoxide, even for challenging scenarios.
Larger systematic errors in the case of thick clouds are expected because clouds are not explicitly considered in the forward model of the retrieval algorithm to retain the high processing speed. Therefore, the systematic biases due to clouds are further analysed in more detail. The results for water and ice clouds at different heights are summarised in Fig. 5. Thereby, clouds are modelled as a layer of 1 km vertical extent consisting of water droplets with an effective radius of 10 µm or fractal ice crystals with an edge length of 100 µm. The analysis is performed for three different cloud types: two water clouds with cloud-top heights (CTH) of 2 and 4 km and an ice cloud with CTH of 10 km.
As expected, the absolute value of systematic errors typically increases with increasing cloud optical thickness, increasing cloud-top height, increasing solar zenith angle, and decreasing albedo. In most cases, there is a considerable underestimation of the vertical column in the case of thick clouds. However, there are also conditions under which the absolute value of the error is small even at a cloud optical thickness of τ=1 or occasionally turns to an overestimation for measurements over bright surfaces. Overall the systematic errors due to clouds are qualitatively similar for CO and CH4.
The error analysis based on synthetic data has shown that perturbations of the state vector elements can be clearly retrieved and that the algorithm is theoretically suitable to successfully retrieve carbon monoxide and methane from real TROPOMI data for cloud-free scenes. In the case of thick clouds, systematic errors can become rather large, confirming that an efficient cloud-screening algorithm is necessary, in particular to meet the demanding requirements for the precision and accuracy of atmospheric CH4 measurements. An appropriate quality filter is implemented in the post-processing and described in Sect. 2.5.2. For CO it may be possible to relax the filter due to the less stringent requirements, but for now we employ a joint quality filter for both simultaneously retrieved trace gases.
2.4 High-resolution auxiliary data
As a consequence of the high spatial resolution of the TROPOMI SWIR measurements, a digital elevation model required for the selection and interpolation of suitable precalculated reference spectra and a land cover characterisation data set necessary to provide land fraction and surface type as additional information have to be implemented in high resolution. For this purpose, the Global Multi-resolution Terrain Elevation Data 2010 (GMTED2010) and the Global Land Cover Characterization (GLCC) of the United States Geological Survey (USGS) (United States Geological Survey, 2018a, b) are used with a resampled resolution of 0.05∘ (about 5 km at the Equator) to compute surface elevation, land fraction, and dominating surface type (Biosphere Atmosphere Transfer Scheme Legend) for every sounding of the satellite.
Some incorrect values of zero elevation in the GMTED2010 data set over the Caspian Sea and Lake Superior have been replaced with corresponding Global 30 Arc-Second Elevation (GTOPO30) values (United States Geological Survey, 2018c). Figure 6 demonstrates the resolution of the implemented elevation and surface type data sets using the example of Europe.
2.5.1 Column-averaged dry air mole fractions
In order to convert the retrieved vertical columns into column-averaged dry air mole fractions (denoted XCO and XCH4), the columns are divided by the dry air column obtained from the European Centre for Medium-Range Weather Forecasts (ECMWF) analysis. Thereby, the ECMWF dry columns are corrected for the actual surface elevation of the individual TROPOMI measurements (based on the deviation from the mean altitude of the coarser model grid), inheriting the high spatial resolution of the satellite data.
An analysis based on simulated measurements has indicated that this approach is superior to a normalisation by simultaneously retrieved oxygen (O2 A band) from TROPOMI band 6 for off-nadir conditions and/or in the presence of strong scatterers in the atmosphere (aerosol, clouds) as a consequence of the spectral distance in combination with the albedo differences of natural surface types between NIR band 6 and SWIR band 7 (see Fig. 4). For these reasons, O2 is a barely sufficient proxy for the light path in the 2.3 µm spectral range in a scattering atmosphere. For example, the O2 errors for the scattering scenarios aerosols (extreme in boundary layer) and clouds (cirrus) from Table 2 are −5.40 % and −7.54 %, respectively. Hence, the O2 underestimations are considerably larger than the corresponding errors for CH4 and CO, which would lead to distinct overestimations of mole fractions obtained from the O2-proxy approach in the presence of strong scatterers.
In addition to the better accuracy of the ECMWF-based mole fraction computation, this approach is also faster because the oxygen fit and the interband coregistration mapping can be omitted. As a consequence, the fitting procedure is about twice as fast without the normalisation by O2. The out-of-spectral-band stray light issue of the TROPOMI band 6 (Kleipool et al., 2018) would potentially further hamper the O2-proxy approach.
2.5.2 Quality filter
To enable a fast processing speed to handle the huge amount of TROPOMI data, the lookup table is limited to rather simple physical conditions (e.g. cloud-free scenes). Thus, a quality-screening algorithm excluding measurements not sufficiently characterised by the forward model had to be implemented. First of all, challenging conditions with solar zenith angles larger than 75∘, which are increasingly prone to scattering and saturation-related issues due to the weakening signal and lengthening of the light path, are cut off. To be independent of other data sets and their ongoing availability, it was aimed at filtering based on parameters directly included in the retrieval output. This was achieved by using a machine-learning approach based on a random forest classifier, which is a meta estimator growing many independent decision trees on different subsamples of the data set that uses averaging to improve the predictive accuracy and prevent overfitting. Thereby, each tree of the ensemble is grown in the following way (Breiman, 2001).
Randomly draw N samples from the training set of size N with replacement (bootstrap sample). For large N, a fraction of about 63.2 % unique samples is expected, the remainder being duplicates.
From the F input variables, f≪F features are randomly chosen out of F, and the best split according to the minimisation of Gini impurity on these f features is used to split the node (Breiman, 1996a). The value of f is held constant during the forest growing.
There is no pruning of the decision trees; i.e. each tree is grown to the largest possible extent.
To classify a new previously unseen measurement after growing the forest with the training data, each decision tree gives a classification according to the input features of the measurement, and the forest chooses the majority vote over all trees in the forest. The combination of the tree results, each based on different bootstrap replicates of the learning set, is called bootstrap aggregating or bagging (Breiman, 1996b). The forest error rate depends on the correlation between the trees in the forest and the strength of the individual trees. The forest error rate decreases with decreasing correlation and increasing strength of the trees. Reducing f reduces both the correlation and the strength, while increasing f increases both. Hence, there is an optimal range of f that minimises the forest error rate.
We use a forest size of 200 trees and the well-recognised standard choice of . The training data set comprises 16 randomly chosen days, namely 25 November 2017 and 25 February, 21 April, 27 April, 22 May, 28 May, 16 June, 26 June, 16 July, 24 July, 3 August, 22 August, 18 September, 4 October, 21 October, and 16 November 2018. For each day, 5 million measurements are randomly selected. Thus, the training subset consists of 80 million measurements, which are classified based on cloud information from the Visible Infrared Imaging Radiometer Suite (VIIRS) onboard Suomi NPP (Hutchison and Cracknell, 2005), which flies in loose formation configuration with Sentinel-5 Precursor (S5P trails behind by 3.5 min). This classification is augmented by additionally flagging distinct XCH4 deviations relative to a climatology consisting of averages on a 6∘ × 4∘ grid for the years 2003–2005 based on the MACC-II flux inversion system (Bergamaschi et al., 2013) and adjusted by an accumulated increase until the time of the measurement based on globally averaged marine NOAA surface data (Dlugokencky, 2018), identifying scenes obviously not well-characterised by the forward model, in particular conspicuously decreased methane abundances in the presence of clouds due to shielding of the underlying atmosphere or in the case of very low surface reflectances.
To train the forest, a set F of 25 feature variables is selected by feature ranking with recursive feature elimination and cross-validated selection of the best features. As widely used, 20 % of the training data is randomly drawn and retained as test data (e.g. Suthaharan, 2016; Hino et al., 2018). The corresponding predictive accuracy is shown in Fig. 7 as a function of the selected features, confirming that the random forest does not overfit because the accuracy has its global maximum when using all 25 features as listed below. The selected variables in order of importance are (1) H2O column difference to the ECMWF, (2) cloud parameter rcld, (3) simplified surface type (water, coastal, land, desert, ice), (4) linear polynomial coefficient p1, (5) pressure difference to the ECMWF, (6) altitude, (7) latitude, (8) CO fit error, (9) temperature, (10) root mean square of fit residual, (11) temperature difference to the ECMWF, (12) H2O fit error, (13) pressure fit error, (14) H2O column, (15) longitude, (16) solar zenith angle, (17) pressure, (18) quadratic polynomial coefficient p2, (19) radiance ratio of strong H2O absorption to continuum, (20) dry air column from the ECMWF, (21) retrieved apparent albedo, (22) continuum radiance, (23) relative azimuth angle, (24) across-track dimension index, and (25) strong H2O absorption radiance. The predictive accuracy when using all 25 features amounts to 0.983, which means that 98.3 % of all scenes are correctly classified.
A more detailed analysis of the predictive power of the random forest can be obtained from the confusion matrix of the test data set (also shown in Fig. 7). As can be seen, the data set is unbalanced, with barely 10 % belonging to class 0, denoting the good measurements. This is primarily due to the large amount of cloudy scenes in combination with the issue that mainly sun glint and glitter scenes are classified as good over the ocean and inland waters as a consequence of the weak signal ascribed to the low reflectances of these dark surfaces (see Fig. 4). For land scenes the fraction of good observations accordingly increases to about 20 %. The percentage of all good measurements that are incorrectly excluded (false negative rate of class 0) amounts to about 13 % (9 % for land scenes). For these cases the filter is too strict, but the quality of the data passing the filter is not compromised. The percentage of all the measurements predicted to be good that are incorrectly classified and should actually be excluded (false discovery rate of class 0) amounts to about 11 %. For these cases the filter appears not stringent enough. However, as the training classification is quite strict, that does not necessarily mean that all these measurements are actually of low quality. The rate can rather be interpreted as an upper bound of potentially remaining challenging retrievals on the verge of sufficient characterisation by the forward model, e.g. observations near cloud edges. The effective diagnostic performance of the quality filter will emerge from the validation.
Adding additional parameters to F does not significantly improve the predictive accuracy further. It is important to note that the resulting classification is independent of the absolute abundances of the primary retrieval parameters CH4 and CO. The performance of the classification algorithm is demonstrated in Fig. 8, confirming that cloudy scenes are reliably excluded in general and that the quality filter is usually stricter than the VIIRS classification, in particular over the weakly reflecting ocean. Measurements classified as cloudy by VIIRS but still passing the quality filter are rare and not associated with conspicuous methane abundances.
2.5.3 Shallow learning calibration for methane
The implemented machine-learning-based quality filter described in the previous subsection removes observations not sufficiently characterised by the forward model. Although this procedure typically excludes scenes exhibiting large systematic errors, smaller systematic errors may remain in the residual data set. In particular, there seems to be a systematic albedo dependence of unknown origin of retrieved methane abundances with an underestimation over dark surfaces. As a consequence of the fairly stringent quality requirements for methane, a random forest regressor algorithm was implemented to reduce the remaining systematic methane errors after the retrieval by calibrating against an assumed standard defined below, which is deemed insensitive to surface reflectance variations.
Like the classification algorithm described in the previous subsection, the random forest regressor (Criminisi and Shotton, 2013) grows an ensemble of decision trees, training each tree on a different data sample by applying the bootstrap aggregating technique. From the f randomly chosen parameters the optimal split maximising the variance reduction in the child nodes is used to split the nodes. To focus on the most prominent features (shallow learning of systematic errors caused by surface albedo variations), the tree growing is limited to 500 leaf nodes. Again, a forest size of 200 trees and is used, where F consists of five feature variables, which are in the following order of importance: retrieved apparent albedo, solar zenith angle, cloud parameter rcld, strong H2O absorption radiance, and across-track dimension index.
To compute the correction for a new measurement after growing the forest with the training data, each decision tree provides a regression according to the input features of the measurement, and the random forest uses the average over all tree regressions as a final calibration value for this observation. In other words, the random forest regressor uses averaging in the bagging procedure to combine the individual tree results (in contrast to voting used in the classification case).
The calibration data set consists of the XCH4 climatology introduced in the previous subsection evaluated for selected regions spanning a wide range of albedos and solar zenith angles. For individual regions, the climatology is roughly corrected for potential systematic overall biases by adding up a single region-specific correction value based on a comparison to nearby sites of the Total Carbon Column Observing Network (TCCON) (Wunch et al., 2011a) for the year 2017. In any case, the seasonal and intra-regional spatial variations are solely determined by the climatology. The training regions and corresponding climatology correction values are shown in Fig. 9.
The standard deviation of the resulting XCH4 correction when considering global yearly averages of gridded data (on a 0.1∘ × 0.1∘ grid) amounts to 13 ppb, which is well below the natural variability. The XCO data set is not corrected.
TCCON is a network of ground-based Fourier transform spectrometers recording direct solar spectra in the NIR–SWIR spectral region to retrieve accurate and precise column-averaged abundances of several atmospheric constituents, including XCO and XCH4, thus providing a validation resource for satellite data (Wunch et al., 2011a). To ensure comparability, all TCCON sites use similar instrumentation (Bruker IFS 125HR) and a common retrieval algorithm. The TCCON data are tied to the WMO trace gas scale using airborne in situ measurements by applying individual scaling factors for each species. The estimated accuracy (1σ) is about 2 ppb for XCO and 3.5 ppb for XCH4 (Wunch et al., 2010).
To compare the satellite data with TCCON quantitatively, it has to be taken into account that the sensitivities of the instruments differ from each other and that individual a priori profiles are used to determine the best estimate of the true atmospheric state, respectively. The first step is to correct for the a priori contribution to the smoothing equation by adjusting the measurements for a common a priori profile (Rodgers, 2000; Schneising et al., 2012; Dils et al., 2014). Here we use the TCCON prior as the common a priori profile for all measurements:
In this equation, represents the originally retrieved TROPOMI column-averaged dry air mole fraction, l is the index of the vertical layer, Al the corresponding column averaging kernel of the TROPOMI algorithm, and xa and xa,T the TROPOMI and TCCON a priori dry air mole fraction profiles; ml is the mass of dry air determined from the dry air pressure difference between the upper and lower boundary of layer l via with gravitational acceleration gl and is the total mass of dry air. To minimise the smoothing error introduced by the averaging kernels we do not compare directly with the retrieved TCCON mole fractions but rather with the adjusted expression (Rodgers and Connor, 2003; Wunch et al., 2011b):
Thereby, ca,T represents the TCCON a priori column-averaged dry air mole fraction associated with the a priori profile xa,T. However, using instead of has only a marginal impact on the validation results presented here because the satellite averaging kernels are close to 1 in the lower atmosphere (see Fig. 2), implying .
The validation is performed at the TCCON sites listed in Table 3 (see also Fig. 9). For the comparison a set of collocation criteria has to be specified. Ideally, the representativity is maximised by criteria that are as strict as possible while concurrently ensuring sufficient data for a sound and stable comparison. This trade-off is resolved by the following selection. The spatial collocation criterion requires the satellite measurements to lie within a radius of 100 km around the TCCON site and the altitude difference to be smaller than 250 m. The temporal collocation criterion is set to ±2 h. As a consequence of the altitude representativity criterion, there are not enough collocations for a robust comparison at the mountain sites Zugspitze (Sussmann and Rettinger, 2018b) and Izaña (Blumenstock et al., 2017).Strong et al. (2019)Notholt et al. (2017)Kivi et al. (2014); Kivi and Heikkinen (2016)Wunch et al. (2018)Deutscher et al. (2015)Messerschmidt et al. (2012)Hase et al. (2015)Warneke et al. (2014)Sussmann and Rettinger (2018a)Wennberg et al. (2017)Washenfelder et al. (2006)Wennberg et al. (2016b)Morino et al. (2018a)Iraci et al. (2016)Wennberg et al. (2016a)Wennberg et al. (2015)Shiomi et al. (2014)Morino et al. (2018b)Velazco et al. (2017)Feist et al. (2014)Griffith et al. (2014a)Deutscher et al. (2010)De Mazière et al. (2017)Griffith et al. (2014b)Sherlock et al. (2014)Pollard et al. (2017)
The validation results are summarised in Figs. 10 and 11, including the mean bias μ and the scatter σ relative to TCCON for each site. The parameter σ is estimated from Huber's Proposal-2 M-estimator (Huber, 1981), which is a well-established estimator of location and scale that is robust against outliers of a normal distribution. This is an appropriate choice and preferred over the standard deviation because one is interested in the actual single-measurement precision without distortion of the results by a few outliers, which are rather attributed to systematic errors, e.g. due to residual clouds. As a consequence, outliers are fully included in the computation of the systematic error but get lower weight in the robust determination of the random error, which is interpreted as a measure of the repeatability of measurements.
It is also checked whether the respective site biases are sensitive to the selection of the spatial collocation radius, which is an indication of sources within the satellite collocation area with only a marginal influence on the TCCON measurements themselves. A considerable sensitivity was found for XCH4 at Edwards. The collocation region intersects oil production areas in California's Central Valley (in contrast to Caltech and JPL; see also the results in Sect. 4 and Fig. 23) and the South Coast Air Basin (SoCAB), which has a well-known methane enhancement (Wunch et al., 2016). As such nearby sources limit the representativity of affected satellite measurements, the collocation radius is reduced to 50 km for Edwards.
The altitude representativity criterion separates the well-isolated air masses of the SoCAB, where Caltech and JPL are located, from the Mojave desert with the Edwards site to the north. Hence, different air masses are analysed in the validation at Caltech/JPL and Edwards, although the corresponding collocation circles overlap. This also explains the insensitivity to the spatial collocation radius at Caltech/JPL and why no additional constraints on the coincidence criteria are necessary for these sites to ensure representativity. As Caltech and JPL are both exposed to SoCAB air masses, the permissible altitude collocation tolerance of Caltech is equally assumed for JPL despite slightly differing surface elevation.
The results for the individual sites are condensed to the following parameters for the overall quality assessment of the satellite data: the global offset is defined as the mean of the local offsets at the individual sites, the random error is the global scatter (analogously estimated to the single-site case) of the differences to TCCON after subtraction of the respective regional biases, and the systematic error is the standard deviation of the local offsets relative to TCCON at the individual sites as a measure of the station-to-station biases. For XCO the global offset amounts to 4.49 ppb, the random error is estimated to be 5.14 ppb (6.12 ppb when using the standard deviation instead of Huber's Proposal-2 M-estimator), and the systematic error is 1.90 ppb, which is on the order of the estimated (station-to-station) accuracy of the TCCON of about 2 ppb. For XCH4 the global offset aggregates to −1.30 ppb, the random error is 14.04 ppb (15.77 ppb when using the standard deviation), and the systematic error is given by 4.31 ppb, which is again similar to the TCCON accuracy of about 3.5 ppb.
To further analyse how well the real temporal and spatial variations are captured by the TROPOMI data, Fig. 12 shows a comparison to TCCON based on daily means for days with more than three collocations. The obvious linear relationship with a high correlation for both gases (R=0.97 for XCO and R=0.91 for XCH4) underlines the typically good agreement of the satellite and validation data. The linear regression yields a fit close to the 1:1 line for both gases.
In the case of XCH4, there are a few outliers for which the satellite values are considerably lower than the TCCON values. These occasional instances are not site-specific and can probably be ascribed to days with residual or partial cloud cover interfering with the satellite retrievals. Outliers with higher values compared to TCCON are more rare and dominated by a handful of collocations at East Trout Lake. This exceptional lack of XCH4 agreement occurs on four days in the time period 10–21 February as well as on 29 March and may be attributable to Arctic polar vortex air above East Trout Lake potentially causing the following related issues: associated fronts of different air masses may complicate the identification of collocations near the vortex edge, and/or the stratospheric part of the methane profile may be largely affected by the polar vortex, leading to a considerable deviation from the assumed a priori profile shapes (Tukiainen et al., 2016). It is verified that the impact of outliers on the regression is marginal by repeating the fit with the Huber linear regression model (Huber and Ronchetti, 2009), which is robust to outliers and provides similar results to the standard linear regression here.
In summary, the natural XCH4 and XCO variations are well-captured by the satellite data. We find a single-measurement precision of the TROPOMI data of about 0.8 % for XCH4 and 5.8 % for XCO, while the station-to-station accuracy of the satellite data is comparable to the TCCON.
In this section we present the first results from the mission start until the end of 2018. For temporally averaged data we grid the data on a 0.1∘ × 0.1∘ grid instead of showing swath data, which are used for daily data and single satellite overpass detection. Before analysing the data more regionally, we want to provide a global overview.
The global distribution of retrieved XCO and XCH4 for the year 2018 is shown in Figs. 13 and 14, respectively. Clearly visible is the interhemispheric gradient with larger values on the Northern Hemisphere, where the majority of sources is located, for both data sets superimposed by enhancements over prominent source regions like anthropogenic emissions in China, India, and Southeast Asia.
Other visible XCO source regions include human-initiated biomass burning in Africa and South America for land clearing and land use change, as well as wildfire emissions in North America, which were exceptionally pronounced in 2018. The anthropogenic emissions of congested urban areas like Mexico City and Tehran are already unambiguously detected on such a global map without zooming in.
In the case of XCH4 additional visible source regions apart from the anthropogenic sources in Asia, like fossil fuels or rice cultivation, include tropical wetlands and anthropogenic emissions from California and the Padan Plain in Italy. There is also a distinct signal from Etosha National Park in the north of Namibia containing significant areas of wetland like the Etosha pan, an endorheic salt pan that exhibits intermittent shallow inundation.
4.1 Comparison to operational products
The operational TROPOMI CO product is retrieved using the Shortwave Infrared CO Retrieval (SICOR) algorithm (Landgraf et al., 2016), and the operational CH4 product is based on RemoTeC (Hu et al., 2016), which is a physics-based approach originally developed for CO2 and CH4 retrievals from OCO and GOSAT. Although the operational algorithms and the scientific algorithm presented here use similar spectral bands, there are many differences concerning the details of each approach. For example, TROPOMI/WFMD is a weighted least-squares approach, whereas SICOR and RemoTec are based on a Philips–Tikhonov regularisation scheme. There are also differences in the radiative transfer model, the quality filter, the spectroscopy used, and the state vector elements, in particular in the treatment of aerosols and clouds.
While WFMD and the operational CH4 algorithm are mainly applicable to cloud-free scenes, the operational CO algorithm is designed to also handle cloudy observations under specific conditions. Both methane algorithms include a post-processing correction to improve the systematic albedo dependence. However, the details of this correction are again quite different: while the correction for the operational algorithm is based on linear regression relative to GOSAT retrievals, which are in turn bias-corrected against TCCON, the scientific WFMD algorithm uses a random forest regressor relative to a climatology as described in Sect. 2.5.3.
The comparisons are performed on a monthly basis with the latest version (V01.02.02) of the operational products. Figure 15 shows the corresponding CO results for December 2018. The comparison of the global distribution of all quality-filtered data for the respective algorithm illustrates that the spatial CO patterns are very similar for both algorithms. The operational CO algorithm exhibits better coverage as it can handle a larger amount of cloudiness. For common scenes passing the quality filters of both algorithms the data sets are highly correlated, with a correlation coefficient of R=0.98, and the regression slope is also close to the 1:1 line, confirming the good agreement. The mean bias between the two data sets is about 1 %, and the standard deviation of the difference is comparable to the noise level. For the occasionally very high CO abundances the results of the operational algorithm are a few percent larger than for WFMD, which is also reflected in a regression slope somewhat smaller than 1.
The corresponding comparison of the CH4 results is shown in Figs. 16 and 17 for December and June 2018, respectively. WFMD exhibits somewhat better coverage and also includes some retrievals over the ocean in contrast to the operational algorithm. Although the prominent features, like the interhemispheric gradient and source regions in Asia, are similar and the correlation coefficients are close to 0.9, the differences down to the last detail are more pronounced than for CO. This is reflected in both the global maps and the scatter plots for common scenes. The global offset between the two data sets amounts to a few parts per billion, and the standard deviation of the difference is again comparable to the noise level.
In December 2018 the methane abundances over the Bohai Economic Rim, including the cities of Beijing and Tianjin, are larger than in southern China to the west of the Pearl River Delta for WFMD, whereas it is the other way round for the operational product, but this may be due to the different sampling. The XCH4 distribution over the Sahara is more uniform for WFMD, and the corresponding patterns of the operational product seem to vaguely resemble some albedo features, with higher values over brighter parts of the Sahara. There is an obvious clustering of the common measurements around the 1:1 line, even for the largest values. Nevertheless, the linear regression line is somewhat distorted from the 1:1 line due to a slight shift of the two dominating densely populated sub-clusters.
In June 2018 there is a sharper XCH4 gradient in the operational product when transitioning from the temperate into the low albedo boreal zone, and the values over the boreal ecosystem are lower than for WFMD. In addition, there are enhanced methane abundances in the operational product over the Canadian province Nunavut in contrast to WFMD. Some occasionally high values in the WFMD methane data over South America possibly attributable to surface roughness contribute to the rare outliers in the comparison scatter plot, which exhibits a clear linear relation close to the 1:1 line apart from that.
Overall, we find good agreement of our scientific CO product with the operational product based on the presented concise comparison. For CH4 we find good agreement of the prominent features with some interesting differences in detail, including potential indications of residual albedo issues in the operational XCH4 product. Further future analysis and understanding of the differences is expected to advance greenhouse gas retrievals from wide-swath imaging satellites like TROPOMI under challenging conditions such as scenes with low surface reflectance or residual cloudiness.
4.2 Detection of emission sources
4.2.1 Carbon monoxide
Intense CO emissions from agglomeration areas, cities, and industrial facilities are clearly detected by TROPOMI. This is demonstrated using the example of China, India, and Southeast Asia in Fig. 18. The 2-month average was chosen to get an overview of the complete region. Typically, larger emissions can even be detected in a single satellite overpass. The tracked facilities mainly belong to the Chinese and Indian iron and steel industry.
For comparison, Fig. 18 also shows the operational product in addition to the TROPOMI/WFMD results. As the operational product is available as total CO columns, the corresponding mole fractions XCO were generated in the same way as for the scientific product by division of the total CO columns by the dry air columns obtained from the ECMWF. The comparison demonstrates that the enhancements due to the analysed emission sources can be typically identified in both data sets. However, as a consequence of the different spatiotemporal sampling, the enhancement over some point sources is somewhat more pronounced in the WFMD product. A possible reason for this is the additional utilisation of cloudy observations in the operational SICOR product, which may be associated with reduced surface sensitivity under certain conditions reflected in the averaging kernels of the corresponding measurements.
In steelmaking CO is formed during two processes. Firstly, it is an essential constituent of blast furnace gas, which emerges when iron ore is reduced with coke to metallic pig iron. As the resulting pig iron has a relatively high carbon content, further processing is necessary to harden the metal. Therefore, the carbon-rich molten pig iron is converted to steel by lowering its carbon content via oxidation in the oxygen converter process (Linz–Donawitz steelmaking). The resulting converter gas predominantly consists of CO (≈70 %) (Ishioka et al., 1992; CarbonNext, 2017).
The detected factories include the following steel plants: Baotou Iron & Steel Group (Baogang), Wuhan Iron & Steel Co. (WISCO), Panzhihua Iron & Steel Group (Pangang), Fujian Sangang Group (Sangang), Liuzhou Iron & Steel Co. (Liu Steel), Jiuquan Iron & Steel Co. (JISCO), Xining Special Steel, Shaanxi Hanzhong Iron & Steel Co., Tonghua Iron & Steel Group (Tonggang), Steel Authority of India Limited (SAIL), and TATA Steel. Further emitters include other metal processing industries such as the National Aluminium Company (NALCO), the Tang Loong Industrial Park in Vietnam, and the cement production plants of the Arco Group and Khyber Industries in the Kashmir Valley, where CO accumulates between the mountain ranges.
CO emissions from the steel industry can also be observed in other regions of the world, for example in Turkey. Figure 19 shows that two of the largest steel plants in the country are detected in a single satellite overpass. The plants are operated by the Turkish steel producers Ereğli Demir ve Çelik Fabrikaları (Erdemir) and Karabük Demir Çelik Fabrikaları (Kardemir), with yearly production capacities of about 3 million tonnes of crude steel each. It can also be seen that the CO product exhibits striping in flight direction for single overpasses, similar to the operational product (Borsdorff et al., 2018).
There are also examples of detected CO emissions from steel works in Europe. Figure 20 illustrates such a case and shows that CO emissions from the largest steel plant in Poland, operated by ArcelorMittal in the industrial city Dąbrowa Górnicza in the Upper Silesian metropolitan area, are detected in a single overpass. As can be seen, the corresponding pronounced plume coincides with the boundary layer wind direction, and the striping is observable as well.
Another prominent source of CO is fire. In September 2018 a peat bog in the military training area WTD 91 in the Emsland region was accidentally set on fire by the German army and burnt for several weeks. The corresponding CO plume is clearly detected and aligns well with the wind direction (Fig. 21). The scenes right above the origin of the fire are automatically excluded by the quality filter because of the strong formation of smoke potentially shielding the subjacent partial columns, similar to thick clouds.
The difference between smoke and clouds is the particle size distribution. While clouds consist of water droplets with an effective radius of about 10 µm, the mass distribution of smoke plumes shows a prominent peak at about 0.3 µm (Stith et al., 1981) but is nevertheless dominated by a small number of supermicron-sized particles (Radke et al., 1990). The submicron particles reduce visibility and lead to an extended smoke plume over large distances in the true colour reflectances from VIIRS shown in Fig. 21. However, these small particles are not a major issue for the satellite measurements taken at 2.3 µm. The satellite retrievals near the origin of the fire are rather affected by the large supermicron-sized particles, which become more and more negligible when departing from the source of the fire due to their rapid fallout. This is the reason that at a sufficient distance from the fire the corresponding measurements pass the quality filter despite efficient scattering in the visible spectral range manifesting in an extensive plume in the VIIRS image. On the other hand, even very small clouds, which are barely visible in the VIIRS image at this resolution, are rigorously filtered out. This indicates that the algorithm implicitly distinguishes between smoke and clouds according to their particle sizes and that a reliable CO retrieval is possible in smoke plumes in the far field of the fire origin. A thorough discussion of the sensitivity of CO measurements in conjunction with smoke from fires can be found in the revised version of Schneising et al. (2019).
The total column enhancement E relative to background values allows us to roughly estimate the emitted mass flux Φ of CO from the mean boundary layer wind speed v and the plume width x⟂ perpendicular to the wind direction only using measurements passing the quality filter:
The plume width is on the same order of magnitude as the instrument's spatial resolution, and the enhancement is thus calculated for the plume scene passing the quality filter which is nearest to the fire origin. As the wind direction is approximately perpendicular to one of the scene diagonals, the corresponding plume width x⟂ is estimated by , assuming a quadratic scene with a side length a of about 7 km. With molec cm−2, m s−1, and km, the emission on 18 September amounts to about ktCO. According to Kohlenberg et al. (2018), a CO : CO2 emission factor of 16±3 % for boreal peat fires is assumed, implying an associated CO2 emission of approximately 10.5±4.0 ktCO2 on that day. Compared to the German yearly total budget of about 800 MtCO2 yr−1, the emissions from the Emsland peat fire are small even if one assumes that the fire burnt for several weeks at this strength.
One integral component of anthropogenic methane sources is emissions from the energy sector. As an example of methane leakage from natural gas production, Fig. 22 shows that the emissions of the world's second-largest natural gas field, Galkynysh in Turkmenistan, which is operated by Türkmengaz, can be clearly detected in a single satellite overpass. Also visible are XCH4 enhancements over the productive South Caspian oil and gas basins, the oil and gas infrastructure at the Turkmen coast of the Caspian Sea, and smaller oil and gas fields south of Galkynysh.
Emissions from oil and gas production are important to monitor because methane leaks offset the climate change benefits of natural gas or oil over coal if the leakage exceeds a certain threshold (Alvarez et al., 2012; Farquharson et al., 2016). There are several studies suggesting that the oil and gas industry leaks more methane than assumed in inventories, at least locally or temporally (Brandt et al., 2014; Schneising et al., 2014; Alvarez et al., 2018), and the potential heterogeneity among the sector complicates the specification of typical emission rates.
Another source region is the Central Valley in California, with combined anthropogenic emissions from oil fields and agriculture (see Fig. 23). While one main area of oil production is located in Kern County around Bakersfield, the dairy and cattle industry extends more or less over the whole valley, with the largest livestock density in the counties of San Joaquin, Stanislaus, Merced, Kings, and Tulare (Mauger et al., 2015). A reliable disentanglement of the emissions from the oil and agriculture sectors requires exact knowledge of the meteorology and unmistaken prior knowledge of the distribution of the different source types or methane isotopologue information, which is not yet available from satellite observations. As already mentioned in Sect. 3, the 100 km collocation radius standardly used in the validation intersects the Kern County source region for the Edwards TCCON site. As a consequence, the collocation radius is reduced to 50 km for Edwards to ensure the representativity of the satellite measurements used in the validation.
The two hitherto presented methane source regions of Turkmenistan and the Central Valley in California, which are both detected in a single TROPOMI overpass, were already identified in yearly averages of SCIAMACHY data (Buchwitz et al., 2017).
An additional source of methane from the energy sector is emissions from coal mining. The physical process of coal extraction directly releases methane, which was previously trapped within the coal bed in the form of gas particles adsorbed at coal grains. For safety reasons, the coal mine methane is diluted with air below the explosive range and released through ventilation shafts to the surface.
Poland's primary energy consumption and electrical power generation relies strongly on coal, which helped the country to achieve one of the lowest energy import dependencies in the European Union (European Statistical Office, 2018) as measured by the share of net imports in gross inland energy consumption (the sum of energy produced and net imports). The energy dependence rate of Poland was about 30 % in 2016 compared to an EU-wide average of 54 %, meaning that the majority of the EU's energy needs are met by net imports. Only three EU countries have a lower energy dependence rate than Poland, namely Romania, Denmark, and Estonia.
Poland is the largest coal-mining country in Europe and among the top 10 coal producers in the world (BP, 2018), with huge reserves of hard coal and lignite (Polish Geological Institute, 2018a, b). The major coal basin is the Upper Silesian Coal Basin (USCB), which is larger than 5000 km2 and hosts 80 % of the anticipated domestic hard coal resources. All operating hard coal mines in the country are situated in the USCB except the Bogdanka Mine in the Lublin Coal Basin in the east of Poland. The USCB is shown in Fig. 24, highlighting individual mines. The corresponding methane plume is vaguely perceptible and coincides with the wind direction. This is an example of emissions that are obviously close to the detection limit for a single overpass.
We have introduced a scientific algorithm to retrieve XCO and XCH4 simultaneously from shortwave infrared spectra recorded by the TROPOMI instrument onboard the Sentinel-5 Precursor satellite. The error analysis based on synthetic data and the successful validation with independent reference data from the TCCON have demonstrated that the algorithm is suitable to retrieve XCO and XCH4 from real TROPOMI data well within the mission requirements after quality filtering (see Table 4). The corresponding quality filter is based on a machine-learning approach utilising a random forest classifier. As cloud data from VIIRS onboard Suomi NPP were only used in the preceding supervised learning process and are no longer needed in the actual quality prediction of individual previously unseen measurements after the completion of the training, the quality filter is independent of the continuous availability of external cloud information. The performance of the retrieval algorithm is expected to further improve in the future, for example with respect to striping in flight direction for single overpasses, due to a refined calibration of the TROPOMI instrument and/or dedicated algorithm advancements.
The good global agreement of our scientific products with the operational products for the analysed example cases further underlines the quality of the presented algorithm. The differences in detail for XCH4 can be thought of as a stimulation for further future analysis. The understanding of these differences will likely allow us to symbiotically advance both retrieval algorithms under challenging conditions, such as scenes with low surface reflectance or residual cloudiness. Moreover, the scientific and operational products are predestined to be used together with other products in an ensemble approach to benefit from the large range of respective realisations of different physical aspects in the individual retrieval algorithms.
Nevertheless, the results of the presented scientific algorithm are also valuable in their own right, as TROPOMI enables the determination of XCO and XCH4 with an unprecedented level of detail on a global scale, introducing new areas of application. It was shown that CO emissions from agglomeration areas, industrial facilities, in particular from the steel industry, and fires are readily detected, often even in a single satellite overpass. The same is true for CH4 emissions from the energy sector, including leakage from oil and gas production and coal bed methane from coal mining. The future quantitative reinforcement of these primarily qualitative findings will potentially enable emission monitoring and air quality assessments, ideally on a daily recurrent basis. Furthermore, improved knowledge of the methane cycle, which is essential for better prediction of future climate, can be derived by combining inverse modelling with a comprehensive monitoring system comprising complementary information from accurate ground-based in situ measurements and satellite observations with a unique combination of high precision, spatiotemporal resolution, and global coverage.
The carbon monoxide and methane data sets presented in this publication can be accessed via http://www.iup.uni-bremen.de/carbon_ghg/products/tropomi_wfmd/ (Schneising, 2019, last access: 25 November 2019).
OS designed and operated the TROPOMI/WFMD satellite retrievals, performed the data analysis, interpreted the results, and wrote the paper. MB, MR, HB, and JPB provided significant conceptual input to the design of the TROPOMI/WFMD satellite retrievals, the interpretation, and the improvement of the paper. TB and JL designed and executed the operational TROPOMI CO and CH4 satellite retrievals and supported the interpretation of the results. NMD, DGF, DWTG, FH, CH, LTI, RK, IM, JN, CP, DFP, SR, KeS, KiS, RS, VAV, TW, and DW operated the TCCON retrievals for the various sites and supported the interpretation of the results. All authors discussed the results and commented on the paper.
The authors declare that they have no conflict of interest.
This article is part of the special issue “TROPOMI on Sentinel-5 Precursor: first year in operation (AMT/ACP inter-journal SI)”. It is not associated with a conference.
This publication contains modified Copernicus Sentinel data (2017, 2018). Sentinel-5 Precursor is an ESA mission implemented on behalf of the European Commission. The TROPOMI payload is a joint development by the ESA and the Netherlands Space Office (NSO). The Sentinel-5 Precursor ground-segment development has been funded by the ESA and with national contributions from the Netherlands, Germany, and Belgium. The research leading to the presented results has in part been funded by the ESA projects GHG-CCI, GHG-CCI+, and S5L2PP, the Federal Ministry of Education and Research project AIRSPACE, and by the State and the University of Bremen.
TCCON data were obtained from the TCCON Data Archive, hosted by CaltechDATA, California Institute of Technology (https://tccondata.org/, last access: 9 September 2019), extended by updates for Eureka, Ny-Ålesund, Białystok, Burgos, Darwin, and Wollongong provided by the respective PIs of these sites. We thank Coleen Roehl and Paul Wennberg of Caltech as well as Jean-François Blavier and Geoffrey Toon of JPL for their efforts to operate the TCCON sites at Park Falls, Lamont, JPL, and Caltech and for providing support for the entire TCCON, which has evolved to the primary validation resource for our satellite data sets. The East Trout Lake TCCON station is supported by the Canada Foundation for Innovation, the Ontario Research Fund, Environment and Climate Change Canada (ECCC), and the Canadian Space Agency (CSA). The Eureka TCCON measurements were made at the Polar Environment Atmospheric Research Laboratory (PEARL) by the Canadian Network for the Detection of Atmospheric Change (CANDAC), primarily supported by the Natural Sciences and Engineering Research Council of Canada (NSERC), ECCC, and CSA. The US TCCON sites used in this analysis are supported by the NASA OCO-2 Project and the NASA Carbon Cycle Science Program. The TCCON sites at Tsukuba and Burgos are supported in part by the GOSAT series project. Site support for Burgos is provided by the Energy Development Corporation (EDC, Philippines). The ESA Ariane Tracking Station at North East Bay, Ascension Island, is acknowledged for hosting the Ascension Island TCCON station. The TCCON stations Ascension Island, Garmisch, Karlsruhe, and Ny-Ålesund have been supported by the European Space Agency (ESA) under grant 3-14737 and by the German Bundesministerium für Wirtschaft und Energie (BMWi) via the DLR under grants 50EE1711A to 50EE1711E. KIT/IMK-ASF (Karlsruhe) and KIT/IMK-IFU (Garmisch-Partenkirchen, in cooperation with the University of Augsburg) acknowledge the BMWi for funding data analysis and delivery through DLR projects (contracts 50EE1711A, B, C, D). The Lauder TCCON programme is core-funded by the NIWA through New Zealand's Ministry of Business, Innovation and Employment. JN, CP, and TW acknowledge financial support by the DFG within Transregio (AC)3.
We acknowledge the use of VIIRS imagery from the NASA Worldview application (https://worldview.earthdata.nasa.gov/, last access: 9 September 2019) operated by the NASA/Goddard Space Flight Center Earth Science Data and Information System (ESDIS). We also thank the European Centre for Medium-Range Weather Forecasts (ECMWF) for providing the meteorological analysis and Peter Bergamaschi for providing the MACC-II project flux inversion system methane mole fractions used to generate the utilised XCH4 climatology.
The research leading to the presented results has in part been funded by the ESA projects GHG-CCI, GHG-CCI+, and S5L2PP, the Federal Ministry of Education and Research project AIRSPACE, and by the State and the University of Bremen.
The article processing charges for this open-access publication were covered by the University of Bremen.
This paper was edited by Helen Worden and reviewed by two anonymous referees.
Alvarez, R. A., Pacala, S. W., Winebrake, J. J., Chameides, W. L., and Hamburg, S. P.: Greater focus needed on methane leakage from natural gas infrastructure, P. Natl. Acad. Sci. USA, 109, 6435–6440, https://doi.org/10.1073/pnas.1202407109, 2012. a
Alvarez, R. A., Zavala-Araiza, D., Lyon, D. R., Allen, D. T., Barkley, Z. R., Brandt, A. R., Davis, K. J., Herndon, S. C., Jacob, D. J., Karion, A., Kort, E. A., Lamb, B. K., Lauvaux, T., Maasakkers, J. D., Marchese, A. J., Omara, M., Pacala, S. W., Peischl, J., Robinson, A. L., Shepson, P. B., Sweeney, C., Townsend-Small, A., Wofsy, S. C., and Hamburg, S. P.: Assessment of methane emissions from the U.S. oil and gas supply chain, Science, 361, 186–188, https://doi.org/10.1126/science.aar7204, 2018. a
Anderson, G. P., Clough, S. A., Kneizys, F. X., Chetwynd, J. H., and Shettle, E. P.: AFGL Atmospheric Constituent Profiles (0–120 km), Environmental Research Papers, NO. 954, AFGL-TR-86-0110, available at: https://apps.dtic.mil/dtic/tr/fulltext/u2/a175173.pdf, last access: 12 August 2019, 1986. a, b
Bergamaschi, P., Frankenberg, C., Meirink, J. F., Krol, M., Villani, M. G., Houweling, S., Dentener, F., Dlugokencky, E. J., Miller, J. B., Gatti, L. V., Engel, A., and Levin, I.: Inverse modeling of global and regional CH4 emissions using SCIAMACHY satellite retrievals, J. Geophys. Res., 114, D22301, https://doi.org/10.1029/2009JD012287, 2009. a
Bergamaschi, P., Houweling, S., Segers, A., Krol, M., Frankenberg, C., Scheepmaker, R. A., Dlugokencky, E., Wofsy, S. C., Kort, E. A., Sweeney, C., Schuck, T., Brenninkmeijer, C., Chen, H., Beck, V., and Gerbig, C.: Atmospheric CH4 in the first decade of the 21st century: Inverse modeling analysis using SCIAMACHY satellite retrievals and NOAA surface measurements, J. Geophys. Res., 118, 7350–7369, https://doi.org/10.1002/jgrd.50480, 2013. a
Blumenstock, T., Hase, F., Schneider, M., Garcia, O. E., and Sepulveda, E.: TCCON data from Izana, Tenerife, Spain, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.izana01.r1, 2017. a
Borsdorff, T., aan de Brugh, J., Hu, H., Hasekamp, O., Sussmann, R., Rettinger, M., Hase, F., Gross, J., Schneider, M., Garcia, O., Stremme, W., Grutter, M., Feist, D. G., Arnold, S. G., De Mazière, M., Kumar Sha, M., Pollard, D. F., Kiel, M., Roehl, C., Wennberg, P. O., Toon, G. C., and Landgraf, J.: Mapping carbon monoxide pollution from space down to city scales with daily global coverage, Atmos. Meas. Tech., 11, 5507–5518, https://doi.org/10.5194/amt-11-5507-2018, 2018. a, b
Borsdorff, T., aan de Brugh, J., Pandey, S., Hasekamp, O., Aben, I., Houweling, S., and Landgraf, J.: Carbon monoxide air pollution on sub-city scales and along arterial roads detected by the Tropospheric Monitoring Instrument, Atmos. Chem. Phys., 19, 3579–3588, https://doi.org/10.5194/acp-19-3579-2019, 2019. a
Bovensmann, H., Burrows, J. P., Buchwitz, M., Frerick, J., Noël, S., Rozanov, V. V., Chance, K. V., and Goede, A. P. H.: SCIAMACHY – Mission Objectives and Measurement Modes, J. Atmos. Sci., 56, 127–150, https://doi.org/10.1175/1520-0469(1999)056<0127:SMOAMM>2.0.CO;2, 1999. a
BP: Statistical Review of World Energy, 67th edition, available at: https://www.bp.com/content/dam/bp/business-sites/en/global/corporate/pdfs/energy-economics/statistical-review/bp-stats-review-2018-full-report.pdf, (last access: 23 April 2019), 2018. a
Brandt, A. R., Heath, G. A., Kort, E. A., O'Sullivan, F., Pétron, G., Jordaan, S. M., Tans, P., Wilcox, J., Gopstein, A. M., Arent, D., Wofsy, S., Brown, N. J., Bradley, R., Stucky, G. D., Eardley, D., and Harriss, R.: Methane Leaks from North American Natural Gas Systems, Science, 343, 733–735, https://doi.org/10.1126/science.1247045, 2014. a
Buchwitz, M., de Beek, R., Bramstedt, K., Noël, S., Bovensmann, H., and Burrows, J. P.: Global carbon monoxide as retrieved from SCIAMACHY by WFM-DOAS, Atmos. Chem. Phys., 4, 1945–1960, https://doi.org/10.5194/acp-4-1945-2004, 2004. a
Buchwitz, M., de Beek, R., Burrows, J. P., Bovensmann, H., Warneke, T., Notholt, J., Meirink, J. F., Goede, A. P. H., Bergamaschi, P., Körner, S., Heimann, M., and Schulz, A.: Atmospheric methane and carbon dioxide from SCIAMACHY satellite data: initial comparison with chemistry and transport models, Atmos. Chem. Phys., 5, 941–962, https://doi.org/10.5194/acp-5-941-2005, 2005. a
Buchwitz, M., de Beek, R., Noël, S., Burrows, J. P., Bovensmann, H., Schneising, O., Khlystova, I., Bruns, M., Bremer, H., Bergamaschi, P., Körner, S., and Heimann, M.: Atmospheric carbon gases retrieved from SCIAMACHY by WFM-DOAS: version 0.5 CO and CH4 and impact of calibration improvements on CO2 retrieval, Atmos. Chem. Phys., 6, 2727–2751, https://doi.org/10.5194/acp-6-2727-2006, 2006. a
Buchwitz, M., Khlystova, I., Bovensmann, H., and Burrows, J. P.: Three years of global carbon monoxide from SCIAMACHY: comparison with MOPITT and first results related to the detection of enhanced CO over cities, Atmos. Chem. Phys., 7, 2399–2411, https://doi.org/10.5194/acp-7-2399-2007, 2007. a
Buchwitz, M., Schneising, O., Reuter, M., Heymann, J., Krautwurst, S., Bovensmann, H., Burrows, J. P., Boesch, H., Parker, R. J., Somkuti, P., Detmers, R. G., Hasekamp, O. P., Aben, I., Butz, A., Frankenberg, C., and Turner, A. J.: Satellite-derived methane hotspot emission estimates using a fast data-driven method, Atmos. Chem. Phys., 17, 5751–5774, https://doi.org/10.5194/acp-17-5751-2017, 2017. a, b
Burrows, J. P., Hölzle, E., Goede, A. P. H., Visser, H., and Fricke, W.: SCIAMACHY – Scanning Imaging Absorption Spectrometer for Atmospheric Chartography, Acta Astronaut., 35, 445–451, https://doi.org/10.1016/0094-5765(94)00278-T, 1995. a
Clerbaux, C., Boynard, A., Clarisse, L., George, M., Hadji-Lazaro, J., Herbin, H., Hurtmans, D., Pommier, M., Razavi, A., Turquety, S., Wespes, C., and Coheur, P.-F.: Monitoring of atmospheric composition using the thermal infrared IASI/MetOp sounder, Atmos. Chem. Phys., 9, 6041–6054, https://doi.org/10.5194/acp-9-6041-2009, 2009. a
Criminisi, A. and Shotton, J.: Decision Forests for Computer Vision and Medical Image Analysis, Advances in Computer Vision and Pattern Recognition, Springer, London, 2013. a
de Laat, A. T. J., Gloudemans, A. M. S., Aben, I., and Schrijver, H.: Global evaluation of SCIAMACHY and MOPITT carbon monoxide column differences for 2004–2005, J. Geophys. Res., 115, D06307, https://doi.org/10.1029/2009JD012698, 2010. a
De Mazière, M., Sha, M. K., Desmet, F., Hermans, C., Scolas, F., Kumps, N., Metzger, J.-M., Duflot, V., and Cammas, J.-P.: TCCON data from Réunion Island (La Réunion), France, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.reunion01.r1, 2017. a
Deutscher, N. M., Griffith, D. W. T., Bryant, G. W., Wennberg, P. O., Toon, G. C., Washenfelder, R. A., Keppel-Aleks, G., Wunch, D., Yavin, Y., Allen, N. T., Blavier, J.-F., Jiménez, R., Daube, B. C., Bright, A. V., Matross, D. M., Wofsy, S. C., and Park, S.: Total column CO2 measurements at Darwin, Australia – site description and calibration against in situ aircraft profiles, Atmos. Meas. Tech., 3, 947–958, https://doi.org/10.5194/amt-3-947-2010, 2010. a
Deutscher, N. M., Notholt, J., Messerschmidt, J., Weinzierl, C., Warneke, T., Petri, C., and Grupe, P.: TCCON data from Białystok, Poland, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.bialystok01.r1/1183984, 2015. a
Dils, B., Buchwitz, M., Reuter, M., Schneising, O., Boesch, H., Parker, R., Guerlet, S., Aben, I., Blumenstock, T., Burrows, J. P., Butz, A., Deutscher, N. M., Frankenberg, C., Hase, F., Hasekamp, O. P., Heymann, J., De Mazière, M., Notholt, J., Sussmann, R., Warneke, T., Griffith, D., Sherlock, V., and Wunch, D.: The Greenhouse Gas Climate Change Initiative (GHG-CCI): comparative validation of GHG-CCI SCIAMACHY/ENVISAT and TANSO-FTS/GOSAT CO2 and CH4 retrieval algorithm products with measurements from the TCCON, Atmos. Meas. Tech., 7, 1723–1744, https://doi.org/10.5194/amt-7-1723-2014, 2014. a
Drummond, J. R., Zou, J., Nichitiu, F., Kar, J., Deschambaut, R., and Hackett, J.: A review of 9-year performance and operation of the MOPITT instrument, Adv. Space Res., 45, 760–774, https://doi.org/10.1016/j.asr.2009.11.019, 2010. a
ESA: Sentinel-5 Precursor Calibration and Validation Plan for the Operational Phase, Reference: ESA-EOPG-CSCOP-PL-0073, available at: https://sentinel.esa.int/documents/247904/2474724/Sentinel-5P-Calibration-and-Validation-Plan.pdf (last access: 23 April 2019), 2017. a
European Statistical Office: Shedding light on energy in the EU – A guided tour of energy statistics, available at: https://ec.europa.eu/eurostat/cache/infographs/energy/index.html (last access: 23 April 2019), 2018. a
Farquharson, D., Jaramillo, P., Schivley, G., Klima, K., Carlson, D., and Samaras, C.: Beyond Global Warming Potential: A Comparative Application of Climate Impact Metrics for the Life Cycle Assessment of Coal and Natural Gas Based Electricity, J. Ind. Ecol., 21, 857–873, https://doi.org/10.1111/jiec.12475, 2016. a
Feist, D. G., Arnold, S. G., John, N., and Geibel, M. C.: TCCON data from Ascension Island, Saint Helena, Ascension and Tristan da Cunha, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.ascension01.r0/1149285, 2014. a
Frankenberg, C., Meirink, J. F., Bergamaschi, P., Goede, A. P. H., Heimann, M., Körner, S., Platt, U., van Weele, M., and Wagner, T.: Satellite chartography of atmospheric methane from SCIAMACHY onboard ENVISAT: Analysis of the years 2003 and 2004, J. Geophys. Res., 111, D07303, https://doi.org/10.1029/2005JD006235, 2006. a
Gordon, I. E., Rothman, L. S., Hill, C., Kochanov, R. V., Tan, Y., Bernath, P. F., Birk, M., Boudon, V., Campargue, A., Chance, K. V., Drouin, B. J., Flaud, J.-M., Gamache, R. R., Hodges, J. T., Jacquemart, D., Perevalov, V. I., Perrin, A., Shine, K. P., Smith, M.-A., Tennyson, J., Toon, G. C., Tran, H., Tyuterev, V. G., Barbe, A., Császár, A. G., Devi, V. M., Furtenbacher, T., Harrison, J. J., Hartmann, J.-M., Jolly, A., Johnson, T., Karman, T., Kleiner, I., Kyuberis, A., Loos, J., Lyulin, O. M., Massie, S. T., Mikhailenko, S. N., Moazzen-Ahmadi, N., Müller, H. S. P., Naumenko, O. V., Nikitin, A. V., Polyansky, O. L., Rey, M., Rotger, M., Sharpe, S., Sung, K., Starikova, E., Tashkun, S. A., Vander Auwera, J., Wagner, G., Wilzewski, J., Wcisło, P., Yu, S., and Zak, E. J.: The HITRAN2016 molecular spectroscopic database, J. Quant. Spectrosc. Ra., 203, 3–69, https://doi.org/10.1016/j.jqsrt.2017.06.038, 2017. a
Griffith, D. W., Deutscher, N. M., Velazco, V. A., Wennberg, P. O., Yavin, Y., Keppel-Aleks, G., Washenfelder, R. A., Toon, G. C., Blavier, J.-F., Paton-Walsh, C., Jones, N. B., Kettlewell, G. C., Connor, B. J., Macatangay, R. C., Roehl, C., Ryczek, M., Glowacki, J., Culgan, T., and Bryant, G. W.: TCCON data from Darwin, Australia, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.darwin01.r0/1149290, 2014a. a
Griffith, D. W., Velazco, V. A., Deutscher, N. M., Paton-Walsh, C., Jones, N. B., Wilson, S. R., Macatangay, R. C., Kettlewell, G. C., Buchholz, R. R., and Riggenbach, M. O.: TCCON data from Wollongong, Australia, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.wollongong01.r0/1149291, 2014b. a
Hase, F., Blumenstock, T., Dohe, S., Groß, J., and Kiel, M.: TCCON data from Karlsruhe, Germany, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.karlsruhe01.r1/1182416, 2015. a
Hess, M., Koepke, P., and Schult, I.: Optical Properties of Aerosols and Clouds: The Software Package OPAC, B. Am. Meteor. Soc., 79, 831–844, 1998. a
Heymann, J., Bovensmann, H., Buchwitz, M., Burrows, J. P., Deutscher, N. M., Notholt, J., Rettinger, M., Reuter, M., Schneising, O., Sussmann, R., and Warneke, T.: SCIAMACHY WFM-DOAS XCO2: reduction of scattering related errors, Atmos. Meas. Tech., 5, 2375–2390, https://doi.org/10.5194/amt-5-2375-2012, 2012. a
Holmes, C. D., Prather, M. J., Søvde, O. A., and Myhre, G.: Future methane, hydroxyl, and their uncertainties: key climate and emission parameters for future predictions, Atmos. Chem. Phys., 13, 285–302, https://doi.org/10.5194/acp-13-285-2013, 2013. a
Hu, H., Hasekamp, O., Butz, A., Galli, A., Landgraf, J., Aan de Brugh, J., Borsdorff, T., Scheepmaker, R., and Aben, I.: The operational methane retrieval algorithm for TROPOMI, Atmos. Meas. Tech., 9, 5423–5440, https://doi.org/10.5194/amt-9-5423-2016, 2016. a, b
Hu, H., Landgraf, J., Detmers, R., Borsdorff, T., Aan de Brugh, J., Aben, I., Butz, A., and Hasekamp, O.: Toward Global Mapping of Methane With TROPOMI: First Results and Intersatellite Comparison to GOSAT, Geophys. Res. Lett., 45, 3682–3689, https://doi.org/10.1002/2018GL077259, 2018. a
Huber, P. J.: Robust statistics, Wiley, New York, 1981. a
Huber, P. J. and Ronchetti, E. M.: Robust statistics, Wiley, New York, 2009. a
Hutchison, K. D. and Cracknell, A. P.: Visible Infrared Imager Radiometer Suite: A New Operational Cloud Imager, CRC Press of Taylor and Francis, London, 2005. a
Iraci, L. T., Podolske, J. R., Hillyard, P. W., Roehl, C., Wennberg, P. O., Blavier, J.-F., Landeros, J., Allen, N., Wunch, D., Zavaleta, J., Quigley, E., Osterman, G. B., Albertson, R., Dunwoody, K., and Boyden, H.: TCCON data from Edwards, California, USA, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.edwards01.r1/1255068, 2016. a
Ishioka, M., Okada, T., and Matsubara, K.: Formation and characteristics of vapor grown carbon fibers prepared in Linz-Donawitz converter gas, Carbon, 30, 975–979, https://doi.org/10.1016/0008-6223(92)90124-F, 1992. a
Kivi, R., Heikkinen, P., and Kyrö, E.: TCCON data from Sodankylä, Finland, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.sodankyla01.r0/1149280, 2014. a
Kleipool, Q., Ludewig, A., Babić, L., Bartstra, R., Braak, R., Dierssen, W., Dewitte, P.-J., Kenter, P., Landzaat, R., Leloux, J., Loots, E., Meijering, P., van der Plas, E., Rozemeijer, N., Schepers, D., Schiavini, D., Smeets, J., Vacanti, G., Vonk, F., and Veefkind, P.: Pre-launch calibration results of the TROPOMI payload on-board the Sentinel-5 Precursor satellite, Atmos. Meas. Tech., 11, 6439–6479, https://doi.org/10.5194/amt-11-6439-2018, 2018. a
Kohlenberg, A. J., Turetsky, M. R., Thompson, D. K., Branfireun, B. A., and Mitchell, C. P. J.: Controls on boreal peat combustion and resulting emissions of carbon and mercury, Environ. Res. Lett., 13, 035005, https://doi.org/10.1088/1748-9326/aa9ea8, 2018. a
Kuze, A., Suto, H., Nakajima, M., and Hamasaki, T.: Thermal and near infrared sensor for carbon observation Fourier-transform spectrometer on the Greenhouse Gases Observing Satellite for greenhouse gases monitoring, Appl. Opt., 48, 6716–6733, https://doi.org/10.1364/AO.48.006716, 2009. a
Landgraf, J., aan de Brugh, J., Scheepmaker, R., Borsdorff, T., Hu, H., Houweling, S., Butz, A., Aben, I., and Hasekamp, O.: Carbon monoxide total column retrievals from TROPOMI shortwave infrared measurements, Atmos. Meas. Tech., 9, 4955–4975, https://doi.org/10.5194/amt-9-4955-2016, 2016. a, b
Luo, M., Shephard, M. W., Cady-Pereira, K. E., Henze, D. K., Zhu, L., Bash, J. O., Pinder, R. W., Capps, S. L., Walker, J. T., and Jones, M. R.: Satellite observations of tropospheric ammonia and carbon monoxide: Global distributions, regional correlations and comparisons to model simulations, Atmos. Environ., 106, 262–277, https://doi.org/10.1016/j.atmosenv.2015.02.007, 2015. a
Mauger, G., Bauman, Y., Nennich, T., and Salathé, E.: Impacts of Climate Change on Milk Production in the United States, Prof. Geogr., 67, 121–131, https://doi.org/10.1080/00330124.2014.921017, 2015. a
McMillan, W. W., Barnet, C., Strow, L., Chahine, M. T., McCourt, M. L., Warner, J. X., Novelli, P. C., Korontzi, S., Maddy, E. S., and Datta, S.: Daily global maps of carbon monoxide from NASA's Atmospheric Infrared Sounder, Geophys. Res. Lett., 32, L11801, https://doi.org/10.1029/2004GL021821, 2005. a
Meirink, J. F., Eskes, H. J., and Goede, A. P. H.: Sensitivity analysis of methane emissions derived from SCIAMACHY observations through inverse modelling, Atmos. Chem. Phys., 6, 1275–1292, https://doi.org/10.5194/acp-6-1275-2006, 2006. a
Messerschmidt, J., Chen, H., Deutscher, N. M., Gerbig, C., Grupe, P., Katrynski, K., Koch, F.-T., Lavrič, J. V., Notholt, J., Rödenbeck, C., Ruhe, W., Warneke, T., and Weinzierl, C.: Automated ground-based remote sensing measurements of greenhouse gases at the Białystok site in comparison with collocated in situ measurements and model data, Atmos. Chem. Phys., 12, 6741–6755, https://doi.org/10.5194/acp-12-6741-2012, 2012. a
Morino, I., Matsuzaki, T., and Horikawa, M.: TCCON data from Tsukuba, Ibaraki, Japan, 125HR, Release GGG2014.R2. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.tsukuba02.r2, 2018a. a
Morino, I., Velazco, V. A., Hori, A., Uchino, O., and Griffith, D. W. T.: TCCON data from Burgos, Philippines, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.burgos01.r0, 2018b. a
Notholt, J., Warneke, T., Petri, C., Deutscher, N. M., Weinzierl, C., Palm, M., and Buschmann, M.: TCCON data from Ny-Ålesund, Spitzbergen, Norway, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.nyalesund01.r0/1149278, 2017. a
Polish Geological Institute: List of hard coal deposits, available at: http://geoportal.pgi.gov.pl/css/surowce/images/2017/pdf/hard_coal_2017.pdf (last access: 23 April 2019), 2018a. a
Polish Geological Institute: List of lignite deposits, available at: http://geoportal.pgi.gov.pl/css/surowce/images/2017/pdf/brown_coal_2017.pdf (last access: 23 April 2019), 2018b. a
Pollard, D. F., Sherlock, V., Robinson, J., Deutscher, N. M., Connor, B., and Shiona, H.: The Total Carbon Column Observing Network site description for Lauder, New Zealand, Earth Syst. Sci. Data, 9, 977–992, https://doi.org/10.5194/essd-9-977-2017, 2017. a
Prather, M. J., Holmes, C. D., and Hsu, J.: Reactive greenhouse gas scenarios: Systematic exploration of uncertainties and the role of atmospheric chemistry, Geophys. Res. Lett., 39, L09803, https://doi.org/10.1029/2012GL051440, 2012. a
Radke, L. F., Lyons, J. H., Hobbs, P. V., Hegg, D. A., Sandberg, D. V., and Ward, D. E.: Airborne Monitoring and Smoke Characterization of Prescribed Fires on Forest Lands in Western Washington and Oregon: Final Report, United States Department of Agriculture, Forest Service, General Technical Report PNW-GTR-251, available at: https://www.fs.fed.us/pnw/pubs/gtr251.pdf (last access: 3 April 2019), 1990. a
Reuter, M., Bösch, H., Bovensmann, H., Bril, A., Buchwitz, M., Butz, A., Burrows, J. P., O'Dell, C. W., Guerlet, S., Hasekamp, O., Heymann, J., Kikuchi, N., Oshchepkov, S., Parker, R., Pfeifer, S., Schneising, O., Yokota, T., and Yoshida, Y.: A joint effort to deliver satellite retrieved atmospheric CO2 concentrations for surface flux inversions: the ensemble median algorithm EMMA, Atmos. Chem. Phys., 13, 1771–1780, https://doi.org/10.5194/acp-13-1771-2013, 2013. a
Rodgers, C. D.: Inverse Methods for Atmospheric Sounding: Theory and Practice, World Scientific Publishing, 2000. a
Rozanov, V. V., Buchwitz, M., Eichmann, K.-U., de Beek, R., and Burrows, J. P.: SCIATRAN – a new radiative transfer model for geophysical applications in the 240–2400 nm spectral region: The pseudo-spherical version, Adv. Space Res., 29, 1831–1835, 2002. a
Rozanov, V. V., Rozanov, A. V., Kokhanovsky, A. A., and Burrows, J. P.: Radiative transfer through terrestrial atmosphere and ocean: Software package SCIATRAN, J. Quant. Spectrosc. Ra., 133, 13–71, https://doi.org/10.1016/j.jqsrt.2013.07.004, 2014. a
Rozemeijer, N. C. and Kleipool, Q.: S5P Mission Performance Centre Level 1b Readme, Reference: S5P-MPC-KNMI-PRF-L1B, Issue: 1.0.0, Product Version: V01.00.00, https://sentinel.esa.int/documents/247904/3541451/Sentinel-5P-Level-1b-Product-Readme-File (last access: 13 May 2019), 2018. a
Schneising, O.: TROPOMI/WFMD XCH4 and XCO v1.2, http://www.iup.uni-bremen.de/carbon_ghg/products/tropomi_wfmd/ (last access: 25 November 2019), 2019. a
Schneising, O., Buchwitz, M., Burrows, J. P., Bovensmann, H., Reuter, M., Notholt, J., Macatangay, R., and Warneke, T.: Three years of greenhouse gas column-averaged dry air mole fractions retrieved from satellite – Part 1: Carbon dioxide, Atmos. Chem. Phys., 8, 3827-3853, https://doi.org/10.5194/acp-8-3827-2008, 2008. a, b
Schneising, O., Buchwitz, M., Burrows, J. P., Bovensmann, H., Bergamaschi, P., and Peters, W.: Three years of greenhouse gas column-averaged dry air mole fractions retrieved from satellite – Part 2: Methane, Atmos. Chem. Phys., 9, 443-465, https://doi.org/10.5194/acp-9-443-2009, 2009. a, b
Schneising, O., Buchwitz, M., Reuter, M., Heymann, J., Bovensmann, H., and Burrows, J. P.: Long-term analysis of carbon dioxide and methane column-averaged mole fractions retrieved from SCIAMACHY, Atmos. Chem. Phys., 11, 2863–2880, https://doi.org/10.5194/acp-11-2863-2011, 2011. a
Schneising, O., Bergamaschi, P., Bovensmann, H., Buchwitz, M., Burrows, J. P., Deutscher, N. M., Griffith, D. W. T., Heymann, J., Macatangay, R., Messerschmidt, J., Notholt, J., Rettinger, M., Reuter, M., Sussmann, R., Velazco, V. A., Warneke, T., Wennberg, P. O., and Wunch, D.: Atmospheric greenhouse gases retrieved from SCIAMACHY: comparison to ground-based FTS measurements and model results, Atmos. Chem. Phys., 12, 1527–1540, https://doi.org/10.5194/acp-12-1527-2012, 2012. a
Schneising, O., Burrows, J. P., Dickerson, R. R., Buchwitz, M., Reuter, M., and Bovensmann, H.: Remote sensing of fugitive methane emissions from oil and gas production in North American tight geologic formations, Earth Future, 2, 548–558, https://doi.org/10.1002/2014EF000265, 2014. a, b
Schneising, O., Buchwitz, M., Reuter, M., Bovensmann, H., and Burrows, J. P.: Devastating Californian wildfires in November 2018 observed from space: the carbon monoxide perspective, Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2019-5, in review, 2019. a, b
Sherlock, V., Connor, B., Robinson, J., Shiona, H., Smale, D., and Pollard, D. F.: TCCON data from Lauder, New Zealand, 125HR, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.lauder02.r0/1149298, 2014. a
Shiomi, K., Kawakami, S., Ohyama, H., Arai, K., Okumura, H., Taura, C., Fukamachi, T., and Sakashita, M.: TCCON data from Saga, Japan, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.saga01.r0/1149283, 2014. a
Stith, J. L., Radke, L. F., and Hobbs, P. V.: Particle emissions and the production of ozone and nitrogen oxides from the burning of forest slash, Atmos. Environ., 15, 73–82, https://doi.org/10.1016/0004-6981(81)90127-X, 1981. a
Strong, K., Roche, S., Franklin, J. E., Mendonca, J., Lutsch, E., Weaver, D., Fogal, P. F., Drummond, J. R., Batchelor, R., and Lindenmaier, R.: TCCON data from Eureka, Canada, Release GGG2014.R3. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.eureka01.r3, 2019. a
Sussmann, R. and Rettinger, M.: TCCON data from Garmisch, Germany, Release GGG2014.R2. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.garmisch01.r2, 2018a. a
Sussmann, R. and Rettinger, M.: TCCON data from Zugspitze, Germany, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.zugspitze01.r1, 2018b. a
Suthaharan, S.: Machine Learning Models and Algorithms for Big Data Classification, Springer, New York, 2016. a
The Royal Society: Ground-level ozone in the 21st century: future trends, impacts and policy implications, Science Policy Report 15/08, available at: https://royalsociety.org/~/media/Royal_Society_Content/policy/publications/2008/7925.pdf (last access: 29 November 2018), 2008. a
Tukiainen, S., Railo, J., Laine, M., Hakkarainen, J., Kivi, R., Heikkinen, P., Chen, H., and Tamminen, J.: Retrieval of atmospheric CH4 profiles from Fourier transform infrared data using dimension reduction and MCMC, J. Geophys. Res., 121, 10312–10327, https://doi.org/10.1002/2015JD024657, 2016. a
Veefkind, J. P., Aben, I., McMullan, K., Förster, H., de Vries, J., Otter, G., Claas, J., Eskes, H. J., de Haan, J. F., Kleipool, Q., van Weele, M., Hasekamp, O., Hoogeveen, R., Landgraf, J., Snel, R., Tol, P., Ingmann, P., Voors, R., Kruizinga, B., Vink, R., Visser, H., and Levelt, P. F.: TROPOMI on the ESA Sentinel-5 Precursor: A GMES mission for global observations of the atmospheric composition for climate, air quality and ozone layer applications, Remote Sens. Environ., 120, 70–83, https://doi.org/10.1016/j.rse.2011.09.027, 2012. a
Velazco, V. A., Morino, I., Uchino, O., Hori, A., Kiel, M., Bukosa, B., Deutscher, N. M., Sakai, T., Nagai, T., Bagtasa, G., Izumi, T., Yoshida, Y., and Griffith, D. W. T.: TCCON Philippines: First Measurement Results, Satellite Data and Model Comparisons in Southeast Asia, Remote Sensing, 9, 1228, https://doi.org/10.3390/rs9121228, 2017. a
Warneke, T., Messerschmidt, J., Notholt, J., Weinzierl, C., Deutscher, N. M., Petri, C., and Grupe, P.: TCCON data from Orléans, France, Release GGG2014.R0. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.orleans01.r0/1149276, 2014. a
Washenfelder, R. A., Toon, G. C., Blavier, J.-F., Yang, Z., Allen, N. T., Wennberg, P. O., Vay, S. A., Matross, D. M., and Daube, B. C.: Carbon dioxide column abundances at the Wisconsin Tall Tower site, J. Geophys. Res., 111, D22305, https://doi.org/10.1029/2006JD007154, 2006. a
Wennberg, P. O., Wunch, D., Roehl, C. M., Blavier, J.-F., Toon, G. C., and Allen, N. T.: TCCON data from California Institute of Technology, Pasadena, California, USA, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.pasadena01.r1/1182415, 2015. a
Wennberg, P. O., Roehl, C. M., Blavier, J.-F., Wunch, D., Landeros, J., and Allen, N. T.: TCCON data from Jet Propulsion Laboratory, Pasadena, California, USA, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.jpl02.r1/1330096, 2016a. a
Wennberg, P. O., Wunch, D., Roehl, C. M., Blavier, J.-F., Toon, G. C., and Allen, N. T.: TCCON data from Lamont, Oklahoma, USA, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.lamont01.r1/1255070, 2016b. a
Wennberg, P. O., Roehl, C. M., Wunch, D., Toon, G. C., Blavier, J.-F., Washenfelder, R., Keppel-Aleks, G., Allen, N. T., and Ayers, J.: TCCON data from Park Falls, Wisconsin, USA, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.parkfalls01.r1, 2017. a
Worden, H. M., Deeter, M. N., Edwards, D. P., Gille, J. C., Drummond, J. R., and Nédélec, P.: Observations of near-surface carbon monoxide from space using MOPITT multispectral retrievals, J. Geophys. Res., 115, D18314, https://doi.org/10.1029/2010JD014242, 2010. a
Worden, J., Kulawik, S., Frankenberg, C., Payne, V., Bowman, K., Cady-Peirara, K., Wecht, K., Lee, J.-E., and Noone, D.: Profiles of CH4, HDO, H2O, and N2O with improved lower tropospheric vertical resolution from Aura TES radiances, Atmos. Meas. Tech., 5, 397–411, https://doi.org/10.5194/amt-5-397-2012, 2012. a
World Meteorological Organization: Systematic Observation Requirements for Satellite-based Products for Climate: Supplemental details to the satellite-based component of the Implementation Plan for the Global Observing System for Climate in Support of the UNFCCC, GCOS-107, available at: https://library.wmo.int/doc_num.php?explnum_id=3813 (last access: 11 April 2019), 2006. a
World Meteorological Organization: Systematic Observation Requirements for Satellite-based Products for Climate (2011 Update): Supplemental details to the satellite-based component of the Implementation Plan for the Global Observing System for Climate in Support of the UNFCCC, GCOS-154, https://library.wmo.int/doc_num.php?explnum_id=3710 (last access: 11 April 2019), 2011. a
Wunch, D., Toon, G. C., Wennberg, P. O., Wofsy, S. C., Stephens, B. B., Fischer, M. L., Uchino, O., Abshire, J. B., Bernath, P., Biraud, S. C., Blavier, J.-F. L., Boone, C., Bowman, K. P., Browell, E. V., Campos, T., Connor, B. J., Daube, B. C., Deutscher, N. M., Diao, M., Elkins, J. W., Gerbig, C., Gottlieb, E., Griffith, D. W. T., Hurst, D. F., Jiménez, R., Keppel-Aleks, G., Kort, E. A., Macatangay, R., Machida, T., Matsueda, H., Moore, F., Morino, I., Park, S., Robinson, J., Roehl, C. M., Sawa, Y., Sherlock, V., Sweeney, C., Tanaka, T., and Zondlo, M. A.: Calibration of the Total Carbon Column Observing Network using aircraft profile data, Atmos. Meas. Tech., 3, 1351–1362, https://doi.org/10.5194/amt-3-1351-2010, 2010. a
Wunch, D., Toon, G. C., Blavier, J.-F. L., Washenfelder, R. A., Notholt, J., Connor, B. J., Griffith, D. W. T., Sherlock, V., and Wennberg, P. O.: The Total Carbon Column Observing Network, Phil. Trans. R. Soc. A, 369, 2087–2112, https://doi.org/10.1098/rsta.2010.0240, 2011a. a, b
Wunch, D., Wennberg, P. O., Toon, G. C., Connor, B. J., Fisher, B., Osterman, G. B., Frankenberg, C., Mandrake, L., O'Dell, C., Ahonen, P., Biraud, S. C., Castano, R., Cressie, N., Crisp, D., Deutscher, N. M., Eldering, A., Fisher, M. L., Griffith, D. W. T., Gunson, M., Heikkinen, P., Keppel-Aleks, G., Kyrö, E., Lindenmaier, R., Macatangay, R., Mendonca, J., Messerschmidt, J., Miller, C. E., Morino, I., Notholt, J., Oyafuso, F. A., Rettinger, M., Robinson, J., Roehl, C. M., Salawitch, R. J., Sherlock, V., Strong, K., Sussmann, R., Tanaka, T., Thompson, D. R., Uchino, O., Warneke, T., and Wofsy, S. C.: A method for evaluating bias in global measurements of CO2 total columns from space, Atmos. Chem. Phys., 11, 12317–12337, https://doi.org/10.5194/acp-11-12317-2011, 2011b. a
Wunch, D., Toon, G. C., Hedelius, J. K., Vizenor, N., Roehl, C. M., Saad, K. M., Blavier, J.-F. L., Blake, D. R., and Wennberg, P. O.: Quantifying the loss of processed natural gas within California's South Coast Air Basin using long-term measurements of ethane and methane, Atmos. Chem. Phys., 16, 14091–14105, https://doi.org/10.5194/acp-16-14091-2016, 2016. a
Wunch, D., Mendonca, J., Colebatch, O., Allen, N. T., Blavier, J.-F., Roche, S., Hedelius, J., Neufeld, G., Springett, S., Worthy, D., Kessler, R., and Strong, K.: TCCON data from East Trout Lake, Canada, Release GGG2014.R1. TCCON data archive, hosted by CaltechDATA, California Institute of Technology, https://doi.org/10.14291/tccon.ggg2014.easttroutlake01.r1, 2018. a
Xiong, X., Barnet, C., Maddy, E., Sweeney, C., Liu, X., Zhou, L., and Goldberg, M.: Characterization and validation of methane products from the Atmospheric Infrared Sounder (AIRS), J. Geophys. Res., 113, G00A01, https://doi.org/10.1029/2007JG000500, 2008. a