the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
The IASI NH_{3} version 4 product: averaging kernels and improved consistency
Bruno Franco
Martin Van Damme
Tommaso Di Gioacchino
Juliette HadjiLazaro
Simon Whitburn
Lara Noppen
Daniel Hurtmans
Cathy Clerbaux
Pierre Coheur
Satellite measurements play an increasingly important role in the study of atmospheric ammonia (NH_{3}). Here, we present version 4 of the Artificial Neural Network for IASI (ANNI; IASI: Infrared Atmospheric Sounding Interferometer) retrieval of NH_{3}. The main change is the introduction of total column averaging kernels (AVKs), which can be used to undo the effect of the vertical profile shape assumption of the retrieval. While the main equations can be matched term for term with analogous ones used in UV/Vis retrievals for other minor absorbers, we derive the formalism from the ground up, as its applicability to thermal infrared measurements is nontrivial. A large number of other smaller changes were introduced in ANNI v4, most of which improve the consistency of the measurements across time and across the series of IASI instruments. This includes a more robust way of calculating the hyperspectral range index (HRI), explicitly accounting for longterm changes in CO_{2} in the HRI calculation and the use of a reprocessed cloud product that was specifically developed for climate applications. The NH_{3} distributions derived with ANNI v4 are very similar to the ones derived with v3, although values are about 10 %–20 % larger due to the improved setup of the HRI. We exclude further large biases of the same nature by showing the consistency between ANNI v4 derived NH_{3} columns with columns obtained with an optimal estimation approach. Finally, with v4, we revised the uncertainty budget and now report systematic uncertainty estimates alongside random uncertainties, allowing realistic mean uncertainties to be estimated.
 Article
(8343 KB)  Fulltext XML
 BibTeX
 EndNote
Atmospheric ammonia (NH_{3}) primarily originates from agriculture and related activities. Its presence in the atmosphere leads to a reduction of life quality and to millions of premature deaths via its contribution to particulate matter (Pozzer et al., 2017). As one of the main forms of reactive nitrogen (Galloway et al., 2021), NH_{3} is also a key element in the global nitrogen cycle with devastating effects on the environment when deposited in excess (Sutton et al., 2014).
Satellite measurements of NH_{3} abundances have in the past decade contributed to our understanding of its global distribution, spatiotemporal variations, emission sources, concentration trends, transport patterns, chemistry and deposition levels. Currently, the two most widely used satellite datasets are those derived from observations of the Crosstrack Infrared Sounder (CrIS) (Shephard et al., 2020) and the three Infrared Atmospheric Sounding Interferometers (IASI) (Van Damme et al., 2021). The CrIS product relies on optimal estimation, while the IASI product is based on the conversion of a spectral NH_{3} index to a total column.
The first version of the IASINH_{3} product (Van Damme et al., 2014) used lookuptables (LUT) for the conversion. The LUTs were replaced with a more flexible neural network (NN) in Whitburn et al. (2016). Since then, the Artificial Neural Network for IASI (ANNI) retrieval approach underwent a series of incremental improvements that are documented in Van Damme et al. (2017), Franco et al. (2018) and Van Damme et al. (2021). In Franco et al. (2018, 2019, 2020, 2022) and Rosanka et al. (2021) the ANNI retrieval framework was expanded for the retrieval of other minor trace gases from IASI observations. A similar retrieval approach was also recently adopted for isoprene retrievals from CrIS (Wells et al., 2022).
Returning to ANNINH_{3}, in Van Damme et al. (2017), a reanalysis product was introduced. This product differs in the origin of the input parameters that are used for the NN. Whereas the baseline product (also called nearrealtime (NRT) product) uses operational IASI Level 2 (L2) information on the pressure, humidity and temperature profiles, and a climatology characterizing the boundary layer height, the reanalysed product uses ERA5 model output for these parameters (Hersbach et al., 2020), interpolated in time and space to match the observations. The resulting product is temporally more consistent as it removes the effect of the several changes that occurred in the L2 products throughout the years. Both NH_{3} products include several empirical corrections to counter small differences observed between the three IASI instruments and small biases that occurred as a result of sporadic changes to the IASI instrument or in the L0 to L1c processing of the spectra.
The IASI NH_{3} product is widely used by the scientific community. However, the absence of averaging kernels (AVKs) has in the past hampered model comparison and assimilation. This paper presents version 4 of the ANNI retrieval framework, with the most important change being the introduction of AVKs. After a brief recapitulation of the retrieval algorithm in Sect. 2, the AVK framework is presented in Sect. 3. This includes its theoretical basis, practicalities related to how the AVKs are calculated within ANNI and a discussion on how they can be used in measurementmodel comparison and assimilation. Other changes that were introduced in ANNI v4 are detailed in Sect. 4 (for those related to temporal consistency) and Sect. 5 (for all other changes). In Sect. 6, an evaluation of the NH_{3} product is presented, comparing the v3 with the v4 product and the neural network output with retrievals based on optimal estimation. In the final part of this paper, we present the revised uncertainty budget of the ANNI retrieval.
Here, we give a brief overview of the ANNI algorithm and refer to the previously cited papers on the NH_{3} product for a detailed description and the rationale behind the different retrieval choices. Table 1 summarizes the most important quantities and symbols used in this paper.
The retrieval consists of two independent computational steps. The first one characterizes the NH_{3} signal strength in a spectrum L, via the socalled hyperspectral range index (HRI), which relies on a mean spectrum $\stackrel{\mathrm{\u203e}}{\mathit{L}}$ and associated covariance matrix S constructed from a set of spectra with no observable NH_{3} spectral signatures. It is defined as
with N a normalization constant and K an NH_{3} Jacobian. By construction, the HRI has a mean of zero on the spectra from which $\stackrel{\mathrm{\u203e}}{\mathit{L}}$ and S are constructed. The normalization factor guarantees that the HRI has a standard deviation of 1 spectra containing only background levels of NH_{3}.
The second part of the algorithm relies on a neural network to link the measured HRIs to estimates ${\widehat{X}}^{a}$ of the true NH_{3} total columns X, via a scaling factor SF^{a}:
with B an NH_{3} background column corresponding to $\stackrel{\mathrm{\u203e}}{\mathit{L}}$. As in previous versions of ANNI, we will assume a zero background column for NH_{3} for ANNI v4. However, in what follows, we develop the theory for an arbitrary background column B, so that the recipe can be applied to the other tracers retrieved from IASI with ANNI (e.g. CH_{3}OH or PAN). Retrieved quantities will be indicated with a hat, as in $\widehat{X}$. Superscripts refer to the assumed or modelled vertical profile shape. In the ANNI retrieval framework, the scaling factor SF^{a} is the quantity that is calculated with an NN, for each individual observation, based on the state of the atmosphere (temperature and water vapour profile, surface pressure), the surface temperature and emissivity, the zenith angle, the HRI and an assumed vertical profile shape. For NH_{3}, the volume mixing ratio (VMR) vertical profile is modelled as a Gaussian,
with z the altitude about ground level, z_{0} the peak altitude and σ the width of the profile. Over land, the peak altitude is set at the surface, with a width σ equal to the boundary layer height. Over ocean, the peak altitude is set to 1.4 km with a σ of 0.9 km. In general, ${\widehat{X}}^{a}\ne X$ because of instrumental noise, errors in the assumed vertical profile, imperfect knowledge of one of the other input parameters and errors in the spectroscopic parameters or forward model. The NN is trained from a large set of forward modelled spectra. Appropriate pre and postretrieval flags accompany the retrieval. The prefilter removes respectively measurements with erroneous L1 or excess cloud coverage. The postfilter flags retrievals with limited or no sensitivity to the measured quantity, satisfying
and retrievals whose HRIs are either too noisy or for which the assumed vertical profile is incompatible with the measured HRI, satisfying
Note that this filter only removes a fraction of the negative columns (see Clarisse et al., 2019; Whitburn et al., 2016 for a discussion on why it is important to keep these). Via propagation of uncertainty, a total retrieval uncertainty is calculated for each individual measurement alongside the retrieved column.
The general AVK framework that we introduce below bears a lot of similarity to the total column AVK formalism (Eskes and Boersma, 2003) developed for the DOAS retrieval approach of weakly absorbing species (see also Palmer et al., 2001; Rodgers and Connor, 2003; Boersma et al., 2004, 2016; Cooper et al., 2020). In the DOAS retrieval approach, the total column X is retrieved as
with SCD the slant column density and AMF the air mass factor which accounts for the atmospheric conditions and assumed vertical profile. Equation (6) has the same functional form as the main formula (Eq. 2) of the ANNI retrieval formalism, with the SCD corresponding to the HRI and the AMF to the SF provided by an NN.
One key element on which the total column AVK formalism of Eskes and Boersma (2003) relies is linearity and additivity of the spectrum with respect to changes in the trace gas amount. Linearity is a consequence of the curve of growth of spectral lines for low optical depths (Thorne et al., 1999) and in the DOAS approach also implies that the SCD is proportional to the trace gas abundance. Additivity represents the fact that the effect of different atmospheric layers can be summed up independently from each other. Given the definition of the HRI and the effects of thermal emission of the atmosphere, it is not obvious that these hold in the infrared spectral domain, and for this reason, we derive both properties below.
3.1 On the linearity and additivity of the HRI
Let ${L}_{\mathit{\nu}}^{B}$ be the radiance at the sensor for a scene with climatological background levels B of the target trace gas and a corresponding HRI of zero. Dividing the atmosphere in n appropriately spaced layers z, we denote by B_{z} the corresponding partial columns ($B={\sum}_{z}{B}_{z}$). We can then calculate ${L}_{\mathit{\nu}}^{B}$ from the following sequence of equations: (Rodgers, 2000; Petty, 2006)
Forward substitution of the above relations yields ${L}_{\mathit{\nu}}^{B}$ as a function of the surface term L_{0ν}. Here t_{zν} are the layer transmittances that account for the absorption of all atmospheric species. The z dependence of this parameter is related to vertical variations in the atmospheric constituents and the pressure and temperature dependence of the line intensities. B_{zν}=B_{ν}(T_{z}) corresponds to the Planck's blackbody function for an averaged layer temperature T_{z}.
For this scene, we now introduce an additional trace amount X−B and write the corresponding observed radiance as L_{ν}. In each layer, the transmittance will decrease by a factor ${t}_{z\mathit{\nu}}^{{X}_{z}{B}_{z}}={e}^{{\mathit{\tau}}_{z\mathit{\nu}}}\approx \mathrm{1}{\mathit{\tau}}_{z\mathit{\nu}}$, with τ_{zν} the small optical depth caused by the excess X_{z}−B_{z}. With this, the sequence of equations becomes
For optical thicknesses of the target trace gas τ_{zν} well below one, the second (τ_{iν}τ_{jν}) and higher order terms in optical depth can be neglected. Combining both sets of equations, one can verify that
Each of the terms in the sum expresses the effect of the absorption in one layer due to the excess X_{z}−B_{z} and the attenuation by the layers above. Note that the absorptions are proportional to both the optical depth and the local thermal contrast $\left({L}_{(z\mathrm{1})\mathit{\nu}}^{B}{B}_{z\mathit{\nu}}\right)$, which are two parameters that drive the measurement sensitivity in the infrared (Bauduin et al., 2017). The optical thickness in turn is proportional to the partial column of the target species ${\mathit{\tau}}_{z\mathit{\nu}}\propto ({X}_{z}{B}_{z})$ and thus
The constants c_{zν} depend on the state of the atmosphere at level z and above, but are independent of the excess trace gas amount X−B.
The HRI is by definition a linear combination of spectral channels ν, from Eq. (1),
with C and w_{ν} numerical constants. Using Eq. (16) and the fact that the HRI is zero on the background ($\text{HRI}={\sum}_{\mathit{\nu}}{w}_{\mathit{\nu}}{L}_{\mathit{\nu}}^{B}+C=\mathrm{0}$), we find
This equation implies that for optically thin absorbers, the HRI can be written as a weighted sum of the partial column enhancements. This linearity and additivity of the NH_{3} HRI as a function of partial columns is illustrated in Fig. 1 by means of simulations with a radiative transfer code. The blue line illustrates the nearly linear increase in HRI for increasing NH_{3} columns in the first atmospheric layer of the model. Starting from about 7×10^{16} molec. cm^{−2}, slow departure from linearity is observed. The green line shows the same for the second atmospheric layer. The overall larger HRI in this second layer results from higher thermal contrast (TC) higher up in the atmosphere. Finally, the red line represents the HRI when NH_{3} is increased simultaneously in both layers. The dashdotted line is the sum of the blue and green curve and for low columns is almost indiscernible from the simulated HRI, illustrating additivity in the optically thin limit.
To make the link with Eq. (2), Eq. (19) can be rewritten as
with SF_{z} local scaling factors and
total scaling factors that depend on the scene conditions (e.g. surface temperature, atmospheric temperature and pressure profiles, vertical profile of the target species). We note that whereas SF depends on the normalized vertical profile shape $\frac{{X}_{z}{B}_{z}}{XB}$, both SF_{z} and SF are independent of the total column for a fixed profile shape.
Finally, introducing
we see from Eq. (20) that the HRI can be decomposed in different partial HRI_{z}:
These HRI_{z} quantify how much each layer contributes to the total HRI and they are, again in the optically thin limit, independent from each other.
3.2 Total column averaging kernels
Equation (22) motivates the NN retrieval formula,
with SF^{a} an estimated scaling factor which depends on the best estimates of all the dependencies of SF, including the vertical profile of the target species. As we have just shown, in the optically thin limit SF^{a} is independent of the total column amount. This is no longer the case for strong absorptions when nonlinear effects become increasingly important. In the ANNI retrieval framework this is taken care of by including the HRI as an input parameter in the calculation of the SF. In what follows, we will first derive the AVK formalism in the optically thin limit, assuming both linearity and additivity (and therefore SF that are independent of the (partial) column). In Sect. 3.5 we will then show how to correct for small errors that arise when these conditions are not met.
The quantities ${\widehat{X}}_{z}{B}_{z}$ express the local enhancement of the trace gas column at an altitude z, and it is their relative proportions that are constrained in the retrieval by the use of an a priori profile shape. We write
for the normalized a priori vertical partial column profile, or partial column profile shape, with ${\widehat{X}}_{z}^{a}$ the partial columns corresponding to the retrieved ${\widehat{X}}^{a}$ and ${\sum}_{z}{a}_{z}=\mathrm{1}$. In the previous section we demonstrated that in the optically thin limit, the scaling factor SF^{a} equals the weighted sum of the different local scaling factors defined by the profile shape:
Defining the averaging kernel as
we can express ${\widehat{X}}^{a}$ as a function of X_{z} by eliminating the HRI from Eqs. (20) and (26):
As can be seen from this equation, the averaging kernel ${A}_{z}^{a}$ fully characterizes the measurement, and can be used to mathematically map the true profile X_{z} to the measured total column ${\widehat{X}}^{a}$.
Two example AVKs for an NH_{3} retrieval are shown in the middle panel of Fig. 2, for a retrieval over land and over ocean, with a priori profiles shown in the left panel. Both AVKs logically increase with altitude, as the temperature difference between the surface and a given atmospheric layer, and therefore the scaling factor, increases with altitude. Apart from a multiplicative constant $(\mathrm{1}/{\text{SF}}^{a})$, the AVKs are independent from the a priori profiles, which explains why both land and ocean AVKs increase similarly with altitude. The multiplicative constant determines the altitude for which the AVK is one. This altitude can be interpreted as an equivalent effective NH_{3} altitude, where all NH_{3} can be thought to be located. For the ocean and land retrieval, this altitude is located respectively around 1.6 and 0.7 km, consistent with the a priori profiles shown in the left panel.
3.3 Interpretation
It is instructive to compare the total column averaging kernel, as defined above, with the one arising in optimal estimation retrievals (Rodgers, 2000):
Here, we use matrix and vector notation, with X and $\widehat{\mathit{X}}$ respectively the true and retrieved partial columns and A the AVK matrix. I is the identity matrix. Both Eqs. (32) and (33) allow simulating the retrieval process for any hypothetical X (e.g. from a model, or an independent measurement). However, this is largely where their similarity ends, as there are important differences when it comes to interpreting these two types of AVK.
The first difference is the role of the a priori. For the total column retrieval, the a priori fixes only the vertical profile shape, while for the optimal estimation retrieval, the a priori affects both the vertical profile shape and the retrieved value at each altitude separately. Equation (33) expresses that the retrieved profile is a weighted sum of the a priori and the true profile, with the weights provided by the AVK. When the information content of the measurement is low or the retrieval is too heavily constrained, the AVK will tend toward zero and the solution will remain close to the a priori. Conversely, when the information content is high or the retrieval loosely constrained, the AVK will approach the unit matrix. The optimal estimation AVK is therefore a measure of how much information is extracted from the measurement, with its trace commonly denoted “degrees of freedom for signal”. By contrast, the total column averaging kernels introduced above are not a measure of how much information is extracted from the measurement, as they accompany an unconstrained retrieval. A perfect measurement would correspond to an allones vector A_{z}=1 for all z. However, inherent to (infrared) sounding, sensitivity varies as a function of thermal contrast, and thus altitude, so this ideal can never be met.
The second important difference relates to the fact that a vertical profile is retrieved in the optimal estimation type retrievals. The rows of A express the vertical resolution of the retrieval, where the ideal is a narrow function that peaks at its corresponding altitude. As no vertical information is extracted in the total column retrievals, this interpretation also does not apply. A_{z} is a (normalized) vector that shows which layers of the atmosphere offer in principle the greatest sensitivity. It naturally peaks high up in the atmosphere, irrespective of the location of the trace gas. However, combining the total column AVK with the a priori profile does allow extracting a vector which characterizes the vertical sensitivity, as we now show. Starting from Eqs. (26) and (28) we have
where we defined ${\widehat{\text{HRI}}}_{z}^{a}={\text{SF}}_{z}\left({\widehat{X}}_{z}^{a}{B}_{z}\right)$ similarly to Eq. (24) where we defined ${\text{HRI}}_{z}={\text{SF}}_{z}({X}_{z}{B}_{z})$. A retrieval that assumes a given a priori vertical profile a_{z} therefore implicitly assumes that the HRI (the trace gas signal) can be decomposed into partial ${\widehat{\text{HRI}}}_{z}^{a}$ corresponding to spectral change at each altitude. Note that while $\text{HRI}={\sum}_{z}{\widehat{\text{HRI}}}_{z}^{a}={\sum}_{z}{\text{HRI}}_{z}$, the same does not necessarily hold for each individual level ${\widehat{\text{HRI}}}_{z}^{a}\ne {\text{HRI}}_{z}$, as the assumed profile can differ from the actual profile. With this we can define the normalized assumed HRI profile or, equivalently, the probable vertical partitioning ${V}_{z}^{a}$ of the signal:
From the first equality, it follows that ${\sum}_{z}{V}_{z}^{a}=\mathrm{1}$ (and also follows the last term and Eq. 29). The three profiles a_{z}, ${A}_{z}^{a}$ and ${V}_{z}^{a}$ are illustrated in Fig. 2 for a typical NH_{3} retrieval. As can be seen, the maximum of ${V}_{z}^{a}$ is shifted upwards compared with a_{z}, due to the more favourable thermal contrast higher up in the atmosphere.
3.4 AVK application
There are two alternative ways in which averaging kernels can be exploited to remove the impact of the vertical profile assumption of the retrieval (Palmer et al., 2001; Eskes and Boersma, 2003; Cooper et al., 2020).
3.4.1 Method 1: simulating measurements of the modelled columns
Let ${M}_{z}^{m}$ be a modelled profile with corresponding total column M^{m} and normalized profile (enhancement):
We can simulate what would have been retrieved if the modelled profiles were observed using Eq. (32):
This ${\widehat{M}}^{a}$ is directly comparable with ${\widehat{X}}^{a}$ as the same a priori profile shape a_{z} is used for both retrievals. However, in case the a priori profile significantly differs from the truth, both ${\widehat{X}}^{a}$ and ${\widehat{M}}^{a}$ can deviate far from the truth.
3.4.2 Method 2: using modelled vertical profiles as a priori
Rather than altering the modelled column, an attractive alternative is to alter the retrieved column to use instead of the a priori vertical profile, the modelled profile (see Boersma et al., 2016, Appendix D):
The averaging kernel associated with ${\widehat{X}}^{m}$ is
This ${\widehat{X}}^{m}$ can be directly compared with M^{m}, as both employ the same profile m_{z}. Note that ${\widehat{X}}^{m}$ depends only on the shape of the modelled profile, not the total column. This method can be used to obtain an improved retrieval by using a modelled profile that approaches the reality better than a static a priori profile. Since it was first applied to NH_{3} (Whitburn et al., 2016), the ANNI retrieval has been capable of using modelled profiles by adapting the input parameters to the network. However, when the modelled profiles were changed, the entire retrieval process had to be redone. Using Eq. (43) and the provided AVKs, changing the a priori profile can be done a posteriori by the data users. An important practical note is that the postfilter of the retrieval (see Sect. 2) includes a threshold on the scaling factor, and that this filter should be reevaluated for ${\widehat{X}}^{m}$ using SF^{m}.
Both methods can be summarized as
Equations (39), (40) and (43) can be combined as
or
which shows that, when the goal is to compare the ratio between model and retrieved columns, both methods are equivalent (Cooper et al., 2020).
3.5 Practical considerations
In the ANNI retrieval formalism, the total scaling factor SF^{a} is calculated directly by the NN, not via intermediate SF_{z} and application of Eq. (28). However, these SF_{z}, which are required to calculate the AVKs, can be estimated by exploiting the flexibility of the NN. For NH_{3}, the NN is trained for a wide variety of Gaussian profiles, with peak altitudes ranging from 0 to 20 km and σ from 100 m to 3 km. The SF_{z} can be estimated from the network using the input parameters z_{peak}=z and σ=100 m for the Gaussian profile. For this calculation, an HRI input parameter is also required and the choice was made to use the observed HRI. The corresponding column that can be calculated from this satisfies
where ${\widehat{X}}^{\mathrm{}z}$ is the retrieved total column assuming all the trace gas enhancement is situated in the narrow Gaussian band around altitude z. SF^{z} is the corresponding total scaling factor, which is used to approximate the local scaling factor SF_{z}. With this the AVK can be constructed as
The formulas provided above are exact in the linear limit, but for large columns, SF^{a} and SF^{z} have an increasingly high dependence on the value of the HRI. The NN takes into account this dependence so that Eqs. (2) and (50) are always good approximations of the true X, provided that either the assumed a priori profile is correct or that the tracer is confined to a narrow layer. However, there is no guarantee that
or thus that ${\sum}_{z}{A}_{z}^{a}{a}_{z}$ equals one. A consistent AVK can be obtained, however, as
with $N={\sum}_{z}{A}_{z}^{a}{a}_{z}$ a normalization factor. This factor also guarantees that applying the averaging kernels on the a priori vertical profile returns the retrieved column:
The normalization factors are shown in Fig. 3 for 1 day and 1 year of global measurements. The histograms shown in the insets indicate average values around 0.98–0.99 (±0.03–0.04), illustrating the consistency of the approach and the fact that nonlinear effects are modest. The areas where the normalization factors are furthest from 1 are affected by low clouds (e.g. off the west coast of South Africa) or sea ice.
The necessity of using normalization factors follows from the fact that in the nonlinear regime, the SF_{z} are not uniquely defined, depending on the concentration in the layer z (nonlinearity) and the other layers (nonadditivity). However, as we have shown, in the neighbourhood of the solution, a fully consistent AVK can be obtained after renormalization. It is this AVK that is recommended when applying method 1 in model comparisons. However, in case method 2 is employed and when the modelled profile concerns a narrow layer at high altitude (e.g. a pyroconvective fire plume) or significantly deviates from the a priori, it can be better not to renormalize. In particular, when we have a narrow modelled profile layer at an altitude z^{′}, with ${m}_{z}={\mathit{\delta}}_{z{z}^{\prime}}$, the second method, without renormalization, yields the expected
The output files of the ANNI retrieval contain ${\widehat{X}}^{a}$, ${\widehat{X}}^{\mathrm{}z}$, B_{z} and N. With this, ${A}_{z}^{a}$ can be calculated if required from Eq. (51) or renormalized via Eq. (53).
4.1 Pseudoinverse
The generalized error covariance matrix S plays a key role in the calculation of the HRI. As a symmetric matrix, S has real eigenvalues λ_{i} and can be decomposed as
with all s_{i} orthogonal to each other. It follows that its inverse can be written as
This expression leads to an intuitive interpretation of the HRI (Clarisse et al., 2013): it can be seen as a weighted projection of the spectrum onto the Jacobian, with the directions that usually exhibit the most variability carrying the lowest weight.
The distribution of the eigenvalues of the covariance matrix used for the NH_{3} HRI (with a spectral range covering 812–1126 cm^{−1}) is shown in Fig. 4. Three domains can be distinguished: (i) the 30 highest values corresponding to the principal components, (ii) around 1200 values corresponding mainly to instrumental noise and (iii) around 20 very small eigenvalues. These smallest eigenvalues are of the order of the numerical precision at which the covariance matrix is calculated and, in essence, correspond to directions not occurring in IASI spectra. While random instrumental noise would be expected to occur in all directions, apodization and L1 postprocessing remove some. Such directions carry the most weight in S^{−1}, but as they are not found in real spectra they do not contribute much to the total HRI (as can easily be verified numerically).
However, small changes to the instrument calibration or postprocessing can alter the contribution of these directions in the IASI spectra, and because they carry such a large weight in the HRI, they can affect its value considerably. This explains why the HRI in the past has been found to be very sensitive to such changes (Van Damme et al., 2021). It also explains the occurrence of (small) biases between the different instruments. The solution is fortunately simple (Rodgers and Connor, 2003; Eaton, 2007) and is obtained by disregarding the terms corresponding to the very small eigenvalues in Eq. (60). As we will show later, using such a pseudoinverse does not eliminate the effects of L1C changes completely but reduces their magnitude considerably.
After the pseudoinverse was implemented, an unexpected change was observed in the value of the HRIs on spectra from the period on which the covariance matrix was built. It turns out that while the scalar product of observed IASI spectra with the eigenvectors corresponding to the lowest eigenvalues ${\mathit{L}}^{T}{\mathit{s}}_{\mathit{i}}/{\mathit{\lambda}}_{i}$ is near zero, this is not the case for spectra generated with the forward model. This is due to small discrepancies between spectra generated by the forward and actual spectra that are magnified by the $\mathrm{1}/{\mathit{\lambda}}_{i}$ factors. Hence, synthetic HRIs calculated on the training set of the neural network have in the past been overestimated, resulting in low biases in the retrieved columns. As we will show in Sect. 6, the magnitude of this bias was around 18 % in ANNIv3. For the retrieval of other trace gases presented in Franco et al. (2018), especially those operating on a smaller spectral range, the bias has been evaluated to be much smaller.
4.2 Carbon dioxide
As the mean spectrum and covariance matrix that are used for the HRI are calculated from spectra measured within 1 reference year (2013), longterm changes in atmospheric composition that affect the spectral region of interest can have unwanted effects on the HRI. This was first noted in Van Damme et al. (2021), where a spurious trend was seen in the HRI NH_{3} data over remote regions. It was attributed to the increase in global carbon dioxide (CO_{2}) concentrations, because of the presence of a weak CO_{2} absorption band in the 920–990 cm^{−1} spectral region (Whitburn et al., 2021) where NH_{3} has its strongest absorption. A linear correction on the HRI of the order of 0.03 yr^{−1} was introduced to compensate for this effect. However, because of seasonal variations, and possible temperature dependence of the interference an HRI which is less sensitive to CO_{2} changes is preferable. One option is to build the covariance matrix from spectra spanning the entire period of IASI measurements.
An alternative approach is to account directly for the effects of CO_{2} in the calculation of the HRI. The HRI formula is related to generalized least squares estimation and can be expanded to include multiple variables that are simultaneously estimated (Walker et al., 2011; Theys et al., 2022). In our case, the Jacobian vector becomes a twocolumn matrix, one column corresponding to NH_{3} and the other to CO_{2}. The HRI formula Eq. (1) remains formally identical (with only the first component of the twoelement HRI vector of interest). The effect of this change on the longterm trend of the HRI is detailed in Sect. 4.4.
4.3 Cloud clearing
The ERA5 model output replaces satisfactorily the IASI L2 for all input parameters, except for the surface temperature and cloud cover. These are spatially and temporally too variable for model output to be representative for an IASI footprint at a given time. All previous reanalysed ANNINH_{3} products still relied on different versions of the IASI L2 cloud product. Recently, Whitburn et al. (2022) developed an NNbased cloud flag. Trained with data from the latest version (v6.5) of the official L2 cloud product, it inherits all its advantages as a proven and wellvalidated product. The NN utilizes carefully selected IASI channels as input (excluding channels affected by longlived tracers CO_{2}, N_{2}O, CH_{4}, CFC11 and CFC12) and was shown to be temporally consistent, and coherent across the three IASI instruments. The network presented in Whitburn et al. (2022) was trained to distinguish completely clear scenes (0 % cloud cover) from the rest. For the NH_{3} processing, two additional networks were trained to distinguish scenes with a cloud cover below 10 % and 25 % respectively. With this, three cloud flags are available and these have now been integrated in v4 of the reanalysed ANNINH_{3} product. The results presented in the rest of this paper utilize the flag corresponding to the 10 % threshold.
4.4 Residual bias corrections
The stability of the HRI was evaluated over 10 remote regions where only background columns of NH_{3} are expected. Their average monthly HRI is shown in Fig. 5 for the three IASI instruments separately. The top panel shows the average as obtained with the HRI setup as described above, i.e. with pseudoinverse and with a CO_{2} Jacobian. As with previous versions of the product, a spurious linear trend is observed, but thanks to the introduction of the CO_{2} Jacobian, its magnitude is reduced to about 0.01 yr^{−1}, compared with 0.03 yr^{−1} previously. A slightly steeper decrease is observed for Metop B. We correct for these trends by adding a timedependent offset as in Van Damme et al. (2021). The result after correction is shown in the second panel of Fig. 5.
A detailed analysis was made of this time series to detect offsets between the different instruments and shifts that coincide with known changes in the IASI L1C data. The largest of these shifts is the offset of 0.11 seen between IASIC and the two other instruments. Small offsets in the HRI time series of IASIA were found in 2010, 2015 and 2017, and in the HRI of IASIB in 2015. For each of these, offset corrections were calculated in the range of 0.01–0.03. Thanks to the pseudoinverse, their magnitude is drastically reduced. Previously, offsets as large as 0.6 were observed. The resulting corrected time series is shown in the third panel. This time series is temporally stable and shows an excellent consistency between the three instruments, but it exhibits a weak seasonal cycle, likely due to the combined effect of seasonal changes in the concentrations of H_{2}O and volatile organic compounds that absorb in the same spectral range as NH_{3}. To remove this seasonality an offset depending on latitude and month of the year was calculated from 2012 to 2014 IASIA data and applied on all data. The HRI after correction is shown in the bottom panel of Fig. 5. Thanks to the improved setup of the HRI, and the new cloud product, the magnitude and therefore also uncertainty of all these corrections is lower than in the previous product, which results in much improved temporal consistency.
An additional change in the setup of the HRI concerns the choice of the spectra used for determining the mean background spectra and its associated covariance matrix. As before (Franco et al., 2018) we use a random selection of IASI spectra from the year 2013, but now with a proportionally larger number of spectra from selected parts of the Sahara, Arabian, Great Australian and Namib deserts. It was found that this was an efficient way for countering the small negative biases that are seen over these areas and associated with surface emissivity variations. It also leads to a better detection of NH_{3} transport over deserts.
Since ANNI v2 (Van Damme et al., 2017), the reanalysis product relies on a surface temperature retrieved from a custombuilt neural network, rather than the IASI L2 surface temperature. With ANNI v4, this network has been retrained from data that were generated using the latest version (v6.5) of the IASI L2 algorithm. The input parameters of the NN for the retrieval of surface temperature include 60 selected baseline channels (a subset of the channels used in the cloud NN), surface altitude, total water vapour column and the three output values of the cloud NNs. Mean and standard deviation of the difference between the L2 surface temperature and that retrieved from the network are of the order of 0.5 and 1.5 K respectively for cloud fraction up to 25 %.
A final series of changes concern the network architecture and training database. In previous versions, separate neural networks were employed for the retrieval over land and ocean. These networks were trained respectively with Gaussian a priori profiles peaking at the surface, and a more general one, with profiles peaking at different altitudes. However, a careful comparison showed that the more general network performed as well as the network trained specifically for profiles peaking at the surface. For this reason, only one network was trained for version 4, for a priori profiles peaking at altitudes z_{0} from 0 to 20 km, with a width σ in the range of 0.1–3 km. In view of the averaging kernel calculation, 20 % of the profiles of the training database have an NH_{3} profile with a σ of 100 m.
6.1 Comparison with version 3
As outlined before, v4 has an improved temporal consistency compared with v3. In this section, we provide a short assessment of the new NH_{3} spatial distributions and how they compare with previous versions. As an illustration of the new product, a seasonal average over 2007–2022 is presented in Fig. 6. The distributions follow closely the ones of previous versions (Van Damme et al., 2015). Comparisons with version 3 are provided in Figs. 7 and 8. The main differences are: (1) overall larger columns, especially in areas with high columns. As explained in Sect. 4.1, this is due to the more robust way of calculating the HRI, which makes it less sensitive to small errors in the forward model. Comparing individual observations, the new version is about 10 % (for low HRI) to 20 % (for high HRI) larger. (2) A notable improvement over high latitudes thanks to the improved bias correction (see Sect. 4.4). Averaged columns were clearly overestimated in ANNI v3 for such observations, especially over Greenland and Antarctica but also Canada and Russia. (3) Slightly higher concentrations over deserts, partly due to the overall increase in v4 and partly due to the larger weight of deserts in the construction of mean background spectra and associated covariance matrix (see Sect. 5). In v3, negative HRIs were consistently observed over certain deserts, resulting in negative average columns or low biases. This problem is not entirely gone (e.g. the average HRI over parts of the Arabian desert is still negative), but much improved, resulting in more consistent pronounced transport patterns over, for example, the Sahara Desert. (4) Overall larger concentrations over oceans. The improved bias correction (last step of the HRI correction presented in Sect. 4.4) enables removal of practically all negative values on a longterm average. Average columns over remote ocean are now around 7×10^{14} molec. cm^{−2} almost everywhere. An adverse effect of the correction might be overestimated columns over the Red Sea, Persian Gulf and Mediterranean Sea.
The most obvious remaining artefact in the v4 distribution concerns the continuity of the land–sea transitions. While they are reasonable for some regions of outflow (Gulf of Mexico, Mediterranean Sea), off the west coast of Africa, over the Arabian Sea, Gulf of Bengal or Yellow Sea, the transition is too abrupt to be realistic. The origin of this problem is that different NH_{3} profiles are used for land and ocean. With the introduction of the AVKs, this does not constitute a problem in model comparison or assimilation. However, for standalone use of the product, it would be desirable in the future to improve the parametrization of the a priori vertical profile shape.
6.2 Comparison with an optimal estimation retrieval
Given the low bias in ANNI NH_{3} v3, it is important to exclude the presence of other biases related to the HRI calculation. Here, we present the results of an independent intercomparison that was conducted between the ANNI v4 retrieval output and that of an optimal estimation approach which relies on spectral fitting.
For the optimal estimation retrieval, the Atmosphit forward and inverse model was used (Coheur et al., 2005), which is the same tool whose forward model is used for the construction of the ANNI training database. The optimal estimation was set up as follows: the retrieval range was set to 900–975 cm^{−1}. Total columns of NH_{3} were retrieved with a fixed vertical profile, using the same parametrization as in ANNI NRT. The NH_{3} variance was set to 1000 %, corresponding to an almost unconstrained retrieval. Together with NH_{3}, H_{2}O was retrieved in 10 partial columns, with the a priori coming from the IASI L2. Total columns of CO_{2}, O_{3} and CFC12 were retrieved as well as the surface temperature. Spectral emissivity was taken from Zhou et al. (2013). Before presenting the results, it should be emphasized that despite the similarities in both retrieval approaches (same input parameters, vertical profiles, forward model), no perfect agreement is expected because of (1) use of a narrower spectral range in the optimal estimation retrieval, (2) different propagation of instrumental noise to the retrieval result, (3) limitations of the fitting model (e.g. with respect to fitting water vapour or surface emissivity) and (4) errors related to the imperfect training of the neural network.
For the comparison, 2 days were selected, one over Europe and one over North America, with relatively high NH_{3} columns. The results are shown in Fig. 9. Intercepts, mean and median differences are all of the order of 10^{15} molec. cm^{−2} or below. Regression slopes, calculated using iteratively reweighted least squares to remove the impact of outliers, are 0.97 and 1.05. While the scatter around the 1–1 lines is not negligible (with standard deviation of the differences around 3–4 ×10^{15} molec. cm^{−2}), these numbers demonstrate the overall consistency of both retrieval approaches and do not indicate a significant bias. Note that the ANNI retrieval approach has numerous advantages over optimal estimation, as discussed in Whitburn et al. (2016).
The last detailed global validation of the IASI NH_{3} product was based on a comparison of groundbased FTIR measurements of NH_{3} with the LUTbased NH_{3} product, where a low bias around 35 % was found (Dammers et al., 2016). Since then, two independent validation studies have been conducted. One study (Guo et al., 2021) compared IASI ANNI v3 with in situ measurements in Colorado, USA, and found regression slopes ranging from 0.78 to 1.1 and intercepts of the order of 1–2×10^{15} molec. cm^{−2}. A second study (Wang et al., 2020) compared IASI NH_{3} columns with columns obtained from FTIR measurements in Hefei, China. Here, mean differences around 3.5×10^{15} molec. cm^{−2} (IASI being lower) were found and regression slopes close to one. Given the results of the comparison with the optimal estimation method, we do not expect any significant bias in v4 for columns above 1×10^{16} molec. cm^{−2} in comparisons that correct for the vertical profile assumption of the retrieval. A comprehensive validation of the v4 product is foreseen within the framework of ESA's CCI+ precursors for the aerosol and ozone ECV project, which should confirm this, as well as assess the performance of the algorithm on low columns. Apart from validation of the columns in an absolute or relative sense, comparison with FTIR columns will also allow evaluating regional NH_{3} trends derived from IASI data. Such an evaluation could also be made with bottomup inventories or with data derived from in situ measured concentrations. However, in that case, there is the additional difficulty that longterm trends of other inorganic pollutants (NO_{2}, SO_{2}) affect NH_{3} columns differently than emissions or local concentrations (e.g. Lachatre et al., 2019), necessitating the intervention of a (chemistry transport) model.
7.1 Propagation of uncertainty
In previous ANNI versions, an estimated uncertainty ${\mathit{\sigma}}_{\widehat{X}}$ was calculated for each individual measurement $\widehat{X}$ via (Ku, 1966)
with ${\mathit{\sigma}}_{{p}_{i}}$ the uncertainties of the different input parameters p_{i}. This equation assumes uncorrelated uncertainties, but as this cannot always be justified, in ANNI v4, we switch to the more general (Tellinghuisen, 2001)
with S_{p} the error covariance matrix of the input parameters (with covariances ${S}_{p,ij}={\mathit{\sigma}}_{{p}_{i}{p}_{j}}$) and J the Jacobian of the retrieval, with components $\frac{\partial \widehat{X}}{\partial {p}_{i}}$.
In the ANNI retrieval framework, the input parameters include the skin temperature, the surface pressure, the HRI, the surface emissivity, the zenith angle, the width and the peak of the Gaussian vertical NH_{3} profile, the temperature profile (15 levels) and the water vapour profile (7 levels). After some preliminary analysis, it was concluded that only the correlations between the uncertainties in the temperature profile cannot be neglected. We therefore employ a block diagonal covariance matrix, block diagonal for the elements pertaining to the temperature profile, and diagonal for all other input parameters. As for uncertainty on the vertical profile, this source of uncertainty is removed when applying averaging kernels. For this reason, uncertainties are reported with and without the vertical profile uncertainty, to be used according to whether AVKs are applied.
7.2 Random and systematic uncertainties
In total, we report four types of uncertainty for each observation: random or systematic, and with or without the vertical profile uncertainty included. Reporting random and systematic uncertainties separately is a generally recommended practice (Boersma et al., 2004; Merchant et al., 2017; Sayer et al., 2020). Random uncertainties describe errors specific to a single measurement, and assuming a normal distribution, these average out over many repeated measurements. Systematic uncertainties are those that exhibit correlations in time or space, and are thus associated with more than one measurement. This type of error can lead to biases in the measurement dataset. In ANNI v4, both random ${\mathit{\sigma}}_{\mathrm{r}\widehat{X}}$ and systematic ${\mathit{\sigma}}_{\mathrm{s}\widehat{X}}$ uncertainties are calculated using Eq. (62) and estimates of the random and systematic uncertainties and covariances of the input parameters.
Random and systematic uncertainties can be combined and averaged in different ways according to the needs of the user. In particular, for a given measurement $\widehat{X}$, a total uncertainty estimate can be obtained as (GomezPelaez et al., 2013)
An average measurement uncertainty can be associated with an average $\stackrel{\mathrm{\u203e}}{X}$ of a series of n measurements ${\widehat{X}}_{i}$ as
For the special case where all random and systematic uncertainties are the same, we obtain
which tends to the expected ${\mathit{\sigma}}_{\stackrel{\mathrm{\u203e}}{X}}={\mathit{\sigma}}_{\mathrm{s}\stackrel{\mathrm{\u203e}}{X}}$ for large n.
7.3 Uncertainties of the input parameters
As most input parameters come without an uncertainty budget, let alone covariances, we made besteffort estimates of the co(variance) based on the limited information that is available. For now, the same (co)variances were used for the nearreal time as for the reanalysed NH_{3} product. It is also important to note that the systematic uncertainties of the input parameters vary according to the time and space scales that are considered (Boersma et al., 2004; Merchant et al., 2017; Sayer et al., 2020). Temperature profiles, for example, may be more biased monthly than annually. Here, we estimate systematic uncertainties with a typical L3 gridded data product in mind, i.e. for spatial scales of the order of 1^{∘} latitude and longitude or less, and for time periods of the order of 1 month or less.
The (co)variances, summarized in Table 2, were determined as follows:
 HRI

By definition, the random uncertainty on the HRI equals one. We estimate a systematic uncertainty of 0.1 due to potential and residual interferences (e.g. surface emissivity, other species). To account for potential biases in the spectroscopy and generalized error covariance matrix, we add to this an additional 10 % on the calculated HRI value.
 Skin temperature

Random and systematic uncertainties were set to 1.5 and 0.5 K respectively. These values are in line with the difference between the IASI L2 skin temperature product and the dedicated neural network used for the reanalysis product of ANNI (see Sect. 5).
 Emissivity

For emissivity, which originates from the monthly climatology of Zhou et al. (2013), an uncertainty of 0.01 and 0.005 was assumed for respectively the random and systematic components.
 Temperature profile

Variances were set based on validation results of the IASI level 2 (EUMETSAT, 2021): systematic uncertainties of 1 K for the surface level and 0.5 K for the other levels; random uncertainties of 2 K for the surface level and 1 K for the other levels for land observations, and 1 K for the surface level and 0.5 K for the other levels for ocean observations. Covariance matrices were then built by appropriate scaling of correlation matrices. These were built based on a statistical analysis of the differences between collocated ERA5 and IASI L2 profiles. Correlation coefficients were set to 0.5 between neighbouring levels and 0.25 between levels that are two levels apart. Above 10 km, no strong correlations were observed, and the covariance was therefore assumed to be diagonal for these levels.
 Water vapour profiles

Relying again on the IASI level 2 validation report (EUMETSAT, 2021), random uncertainties were set to 10 % below 3 km and 20 % above. Systematic uncertainties were set to half these numbers.
 Surface pressure

A random and systematic uncertainty of 500 and 250 Pa was used.
 NH_{3} profiles

The uncertainties related to the NH_{3} profile arise from uncertainties associated with the width and the peak of the Gaussian shaped vertical profile. Random and systematic uncertainties of 200 and 100 m were used for both parameters. Given the short lifetime of NH_{3} in the atmosphere, these are likely of the right order of magnitude. To obtain better estimates in the future, a thorough analysis using in situ measurements or modelled profiles would be desirable.
7.4 Uncertainty budget of NH_{3}
It is useful, remembering the general form ${\widehat{X}}^{a}=\text{HRI}/{\text{SF}}^{a}+B$ of the retrieval, to rewrite the propagation of uncertainty in terms of the uncertainty of the nominator and denominator (see also Boersma et al., 2004; van Geffen et al., 2022). Neglecting the small dependence of the SF on the HRI, we obtain
Taking into account both random and systematic uncertainties, we see from Table 2 that the uncertainty on the HRI has an absolute (constant) and a relative (proportional to the value of the HRI) component, so that
7.4.1 Absolute uncertainty contribution
The first term is in the optically thin limit independent of the HRI and thus the column, and solely depends on the scene conditions:
It is this term that is used as part of the postfilter to determine whether there is enough intrinsic sensitivity (thermal contrast) to make a valid measurement, i.e. one whose uncertainty is not completely overwhelmed by the instrumental noise. Currently, the postfilter threshold is set to ${\mathit{\sigma}}_{\mathrm{abs}}<\mathrm{1.5}\times {\mathrm{10}}^{\mathrm{16}}$ molec. cm^{−2}. Note also that a scenedependent detection threshold of the measurements (typically taken as HRI >3) is conveniently expressed in terms of the absolute uncertainty as X_{thres}=3σ_{abs}.
The absolute uncertainty contribution is illustrated in the left panels of Fig. 10 for the IASI morning overpass (land observations between 60^{∘} S and 60^{∘} N) as a function of thermal contrast (TC). As before, we define TC as the brightness temperature of the surface minus the temperature at half the boundary layer height. The absolute uncertainty starts from around 1×10^{15} molec. cm^{−2} and increases as expected with decreasing thermal contrast, with a global median of 4×10^{15} molec. cm^{−2}. Observing the inverse proportionality with thermal contrast, the following empirical formula can be used to obtain ballpark estimates of the absolute uncertainty or sensitivity of the IASI NH_{3} retrieval (for positive thermal contrasts):
The constants were determined from a fit of the data shown in Fig. 10. Expressed in terms of Q20 and Q80 quantiles the estimated absolute retrieval uncertainty of IASI (midlatitude, land, morning overpass) can also be summarized as
7.4.2 Relative uncertainty contribution
The term σ_{rel} is proportional to the column and hence expresses a relative uncertainty for fixed atmospheric conditions,
or
This term is illustrated in the right panels of Fig. 10. Again, we observe an inverse proportionality with thermal contrast, which can be approximated as
For typical morning land observations, the relative contribution to the uncertainty starts from around 14 % (corresponding to a TC of 20 K). Expressed in terms of Q20 and Q80 quantiles, the estimated relative retrieval uncertainty of ANNI (midlatitude, land, morning overpass) can be summarized as
In this paper, we presented v4 of the NH_{3} ANNI retrieval. The most important change is the introduction of averaging kernels, which will greatly ease future model assimilation and comparisons with independent measurements or model output. Most other changes to ANNI v4 contribute to the overall consistency of the product. An example is the incorporation of the temporally consistent cloud flag. The improved way of calculating the HRI makes the product more robust across the different IASI instruments and more temporally harmonious. Importantly, the HRI became also less sensitive to small errors in the forward model related to the instrumental line shape function. Previous versions were biased low by some 10 %–20 % due to such errors. Theoretically we can now exclude the existence of large biases of this sort. We also demonstrate this with an optimal estimation experiment. In addition to the AVKs, we revised the uncertainty calculation and now provide better and more comprehensive information on the expected error of the measurement. We also show how the retrieval uncertainty contains a part proportional to the column and a part that is independent of the column. In the near future, the most important changes will gradually be implemented for all the other tracers retrieved with ANNI (AVKs, the use of generalized covariance matrices and the better treatment of uncertainties).
The IASINH_{3} datasets are available from the Aeris data infrastructure (https://doi.org/10.25326/10, AERIS, 2023a; https://doi.org/10.25326/11, AERIS, 2023b; https://doi.org/10.25326/12, AERIS, 2023c; https://doi.org/10.25326/13, AERIS, 2023d; https://doi.org/10.25326/67, AERIS, 2023e; and https://doi.org/10.25326/500, AERIS, 2023f).
LC led the research, conceptualized the ANNI retrieval changes and wrote the first version of the manuscript. BF, LC, JHL, DH, SW and MVD contributed to the code or data processing. LC, MVD, TDG and LN prepared the figures. TDG, MVD and LC implemented the corrections presented in Sect. 4.4. LC, MVD and BF developed the improved treatment of uncertainties. All authors took part in discussions and revised the manuscript.
The contact author has declared that none of the authors has any competing interests.
Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.
Lieven Clarisse is grateful to Tim Hultberg for pointing out the necessity of using a pseudoinverse for the calculation of the HRI.
The research was cofunded by the Belgian State Federal Office for Scientific, Technical and Cultural Affairs (Prodex HIRS), the Air Liquide Foundation (TAPIR), EUMETSAT (ACSAF) and ESA (CCI+ precursors for aerosol and ozone ECV). Lieven Clarisse is a research associate supported by the Belgian F.R.S.FNRS. Lara Noppen acknowledges support from the French Community of Belgium in the framework of a FRIA grant. Martin Van Damme is grateful for the FEDtWIN ARENBERG grant.
This paper was edited by Alyn Lambert and reviewed by Daven Henze and one anonymous referee.
AERIS: Nearreal time daily IASI/MetopA ULBLATMOS ammonia (NH_{3}) L2 product (total column), AERIS [data set], https://doi.org/10.25326/10, 2023a.
AERIS: Nearreal time daily IASI/MetopB ULBLATMOS ammonia (NH_{3}) L2 product (total column), AERIS [data set], https://doi.org/10.25326/11, 2023b.
AERIS: Reanalyzed daily IASI/MetopA ULBLATMOS ammonia (NH_{3}) L2 product (total column), AERIS [data set], https://doi.org/10.25326/12, 2023c.
AERIS: Reanalyzed daily IASI/MetopB ULBLATMOS ammonia (NH_{3}) L2 product (total column), AERIS [data set], https://doi.org/10.25326/13, 2023d.
AERIS: Nearreal time daily IASI/MetopC ULBLATMOS ammonia (NH_{3}) L2 product (total column), AERIS [data set], https://doi.org/10.25326/67, 2023e.
AERIS: Reanalyzed daily IASI/MetopC ULBLATMOS ammonia (NH_{3}) L2 product (total column), AERIS [data set], https://doi.org/10.25326/500, 2023f.
Bauduin, S., Clarisse, L., Theunissen, M., George, M., Hurtmans, D., Clerbaux, C., and Coheur, P.F.: IASI's sensitivity to nearsurface carbon monoxide (CO): Theoretical analyses and retrievals on test cases, J. Quant. Spectrosc. Ra., 189, 428–440, https://doi.org/10.1016/j.jqsrt.2016.12.022, 2017. a
Boersma, K. F., Eskes, H. J., and Brinksma, E. J.: Error analysis for tropospheric NO_{2} retrieval from space, J. Geophys. Res.Atmos., 109, D04311, https://doi.org/10.1029/2003jd003962, 2004. a, b, c, d
Boersma, K. F., Vinken, G. C. M., and Eskes, H. J.: Representativeness errors in comparing chemistry transport and chemistry climate models with satellite UV–Vis tropospheric column retrievals, Geosci. Model Dev., 9, 875–898, https://doi.org/10.5194/gmd98752016, 2016. a, b
Clarisse, L., Coheur, P.F., Prata, F., HadjiLazaro, J., Hurtmans, D., and Clerbaux, C.: A unified approach to infrared aerosol remote sensing and type specification, Atmos. Chem. Phys., 13, 2195–2221, https://doi.org/10.5194/acp1321952013, 2013. a
Clarisse, L., Clerbaux, C., Franco, B., HadjiLazaro, J., Whitburn, S., Kopp, A. K., Hurtmans, D., and Coheur, P.F.: A Decadal Data Set of Global Atmospheric Dust Retrieved From IASI Satellite Measurements, J. Geophys. Res.Atmos., 124, 1618–1647, https://doi.org/10.1029/2018jd029701, 2019. a
Coheur, P.F., Barret, B., Turquety, S., Hurtmans, D., HadjiLazaro, J., and Clerbaux, C.: Retrieval and characterization of ozone vertical profiles from a thermal infrared nadir sounder, J. Geophys. Res., 110, D24303, https://doi.org/10.1029/2005JD005845, 2005. a
Cooper, M. J., Martin, R. V., Henze, D. K., and Jones, D. B. A.: Effects of a priori profile shape assumptions on comparisons between satellite NO_{2} columns and model simulations, Atmos. Chem. Phys., 20, 7231–7241, https://doi.org/10.5194/acp2072312020, 2020. a, b, c
Dammers, E., Palm, M., Van Damme, M., Vigouroux, C., Smale, D., Conway, S., Toon, G. C., Jones, N., Nussbaumer, E., Warneke, T., Petri, C., Clarisse, L., Clerbaux, C., Hermans, C., Lutsch, E., Strong, K., Hannigan, J. W., Nakajima, H., Morino, I., Herrera, B., Stremme, W., Grutter, M., Schaap, M., Wichink Kruit, R. J., Notholt, J., Coheur, P.F., and Erisman, J. W.: An evaluation of IASINH_{3} with groundbased Fourier transform infrared spectroscopy measurements, Atmos. Chem. Phys., 16, 10351–10368, https://doi.org/10.5194/acp16103512016, 2016. a
Eaton, M.: Multivariate Statistics: A Vector Space Approach, Institute of Mathematical Statistics, Beachwood, Ohio, USA, ISBN 9780940600690, 2007. a
Eskes, H. J. and Boersma, K. F.: Averaging kernels for DOAS totalcolumn satellite retrievals, Atmos. Chem. Phys., 3, 1285–1291, https://doi.org/10.5194/acp312852003, 2003. a, b, c
EUMETSAT: Validation, Tech. Rep. EUM/OPS/DOC/19/1091375, EUMETSAT, https://doi.org/10.15770/EUM_SEC_CLM_0027, 2021. a, b
Franco, B., Clarisse, L., Stavrakou, T., Müller, J.F., Van Damme, M., Whitburn, S., HadjiLazaro, J., Hurtmans, D., Taraborrelli, D., Clerbaux, C., and Coheur, P.F.: A General Framework for Global Retrievals of Trace Gases From IASI: Application to Methanol, Formic Acid, and PAN, J. Geophys. Res.Atmos., 123, 13963–13984, https://doi.org/10.1029/2018JD029633, 2018. a, b, c, d
Franco, B., Clarisse, L., Stavrakou, T., Müller, J.F., Pozzer, A., HadjiLazaro, J., Hurtmans, D., Clerbaux, C., and Coheur, P.F.: Acetone Atmospheric Distribution Retrieved From Space, Geophys. Res. Lett., 46, 2884–2893, https://doi.org/10.1029/2019GL082052, 2019. a
Franco, B., Clarisse, L., Stavrakou, T., Müller, J.F., Taraborrelli, D., HadjiLazaro, J., Hannigan, J. W., Hase, F., Hurtmans, D., Jones, N., Lutsch, E., Mahieu, E., Ortega, I., Schneider, M., Strong, K., Vigouroux, C., Clerbaux, C., and Coheur, P.F.: Spaceborne Measurements of Formic and Acetic Acids: A Global View of the Regional Sources, Geophys. Res. Lett., 47, e2019GL086239, https://doi.org/10.1029/2019GL086239, 2020. a
Franco, B., Clarisse, L., Van Damme, M., HadjiLazaro, J., Clerbaux, C., and Coheur, P.F.: Ethylene industrial emitters seen from space, Nat. Commun., 13, 6452, https://doi.org/10.1038/s41467022340988, 2022. a
Galloway, J. N., Bleeker, A., and Erisman, J. W.: The Human Creation and Use of Reactive Nitrogen: A Global and Regional Perspective, Annu. Rev. Environ. Resour., 46, 255–288, https://doi.org/10.1146/annurevenviron012420045120, 2021. a
GomezPelaez, A. J., Ramos, R., GomezTrueba, V., Novelli, P. C., and CampoHernandez, R.: A statistical approach to quantify uncertainty in carbon monoxide measurements at the Izaña global GAW station: 2008–2011, Atmos. Meas. Tech., 6, 787–799, https://doi.org/10.5194/amt67872013, 2013. a
Guo, X., Clarisse, L., Wang, R., Van Damme, M., Whitburn, S., Coheur, P.F., Clerbaux, C., Franco, B., Pan, D., Golston, L. M., Wendt, L., Sun, K., Tao, L., Miller, D., Mikoviny, T., Müller, M., Wisthaler, A., Tevlin, A. G., Murphy, J. G., Nowak, J. B., Roscioli, J. R., Volkamer, R., Kille, N., Neuman, J. A., Eilerman, S. J., Crawford, J. H., Yacovitch, T. I., Barrick, J. D., Scarino, A. J., and Zondlo, M. A.: Validation of IASI satellite ammonia observations at the pixel scale using insitu vertical profiles, J. Geophys. Res. Atmos., 126, e2020JD033475, https://doi.org/10.1029/2020jd033475, 2021. a
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., MuñozSabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M., Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M., Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L., Healy, S., Hogan, R. J., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P., Lopez, P., Lupu, C., Radnoti, G., Rosnay, P., Rozum, I., Vamborg, F., Villaume, S., and Thépaut, J.N.: The ERA5 global reanalysis, Q. J. Roy. Meteor. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020. a
Ku, H.: Notes on the use of propagation of error formulas, J. Res. NBS C Eng. Inst., 70C, 263–273, https://doi.org/10.6028/jres.070c.025, 1966. a
Lachatre, M., FortemsCheiney, A., Foret, G., Siour, G., Dufour, G., Clarisse, L., Clerbaux, C., Coheur, P.F., Van Damme, M., and Beekmann, M.: The unintended consequence of SO_{2} and NO_{2} regulations over China: increase of ammonia levels and impact on PM_{2.5} concentrations, Atmos. Chem. Phys., 19, 6701–6716, https://doi.org/10.5194/acp1967012019, 2019. a
Merchant, C. J., Paul, F., Popp, T., Ablain, M., Bontemps, S., Defourny, P., Hollmann, R., Lavergne, T., Laeng, A., de Leeuw, G., Mittaz, J., Poulsen, C., Povey, A. C., Reuter, M., Sathyendranath, S., Sandven, S., Sofieva, V. F., and Wagner, W.: Uncertainty information in climate data records from Earth observation, Earth Syst. Sci. Data, 9, 511–527, https://doi.org/10.5194/essd95112017, 2017. a, b
Palmer, P. I., Jacob, D. J., Chance, K., Martin, R. V., Spurr, R. J. D., Kurosu, T. P., Bey, I., Yantosca, R., Fiore, A., and Li, Q.: Air mass factor formulation for spectroscopic measurements from satellites: Application to formaldehyde retrievals from the Global Ozone Monitoring Experiment, J. Geophys. Res.Atmos., 106, 14539–14550, https://doi.org/10.1029/2000jd900772, 2001. a, b
Petty, G. W.: A First Course in Atmospheric Radiation, Sundo Publishing, Madison, Wisconsin, ISBN 9780972903318, 2006. a
Pozzer, A., Tsimpidi, A. P., Karydis, V. A., de Meij, A., and Lelieveld, J.: Impact of agricultural emission reductions on fineparticulate matter and public health, Atmos. Chem. Phys., 17, 12813–12826, https://doi.org/10.5194/acp17128132017, 2017. a
Rodgers, C.: Inverse methods for atmospheric sounding: theory and practice, series on atmospheric, oceanic and planetary physics, World Scientific, ISBN 9789810227401, 2000. a, b
Rodgers, C. D. and Connor, B. J.: Intercomparison of remote sounding instruments, J. Geophys. Res., 108, 4116, https://doi.org/10.1029/2002JD002299, 2003. a, b
Rosanka, S., Franco, B., Clarisse, L., Coheur, P.F., Pozzer, A., Wahner, A., and Taraborrelli, D.: The impact of organic pollutants from Indonesian peatland fires on the tropospheric and lower stratospheric composition, Atmos. Chem. Phys., 21, 11257–11288, https://doi.org/10.5194/acp21112572021, 2021. a
Sayer, A. M., Govaerts, Y., Kolmonen, P., Lipponen, A., Luffarelli, M., Mielonen, T., Patadia, F., Popp, T., Povey, A. C., Stebel, K., and Witek, M. L.: A review and framework for the evaluation of pixellevel uncertainty estimates in satellite aerosol remote sensing, Atmos. Meas. Tech., 13, 373–404, https://doi.org/10.5194/amt133732020, 2020. a, b
Shephard, M. W., Dammers, E., CadyPereira, K. E., Kharol, S. K., Thompson, J., GainariuMatz, Y., Zhang, J., McLinden, C. A., Kovachik, A., Moran, M., Bittman, S., Sioris, C. E., Griffin, D., Alvarado, M. J., Lonsdale, C., SavicJovcic, V., and Zheng, Q.: Ammonia measurements from space with the Crosstrack Infrared Sounder: characteristics and applications, Atmos. Chem. Phys., 20, 2277–2302, https://doi.org/10.5194/acp2022772020, 2020. a
Sutton, M. A., Mason, K. E., Sheppard, L. J., Sverdrup, H., Haeuber, R., and Hicks, W. K. (Eds.): Nitrogen Deposition, Critical Loads and Biodiversity, Springer Netherlands, https://doi.org/10.1007/9789400779396, 2014. a
Tellinghuisen, J.: Statistical Error Propagation, J. Phys. Chem. A, 105, 3917–3921, https://doi.org/10.1021/jp003484u, 2001. a
Theys, N., Lerot, C., Brenot, H., van Gent, J., De Smedt, I., Clarisse, L., Burton, M., Varnam, M., Hayer, C., Esse, B., and Van Roozendael, M.: Improved retrieval of SO_{2} plume height from TROPOMI using an iterative CovarianceBased Retrieval Algorithm, Atmos. Meas. Tech., 15, 4801–4817, https://doi.org/10.5194/amt1548012022, 2022. a
Thorne, A., Litzén, U., and Johansson, S.: Spectrophysics. Principles and Applicatons, Springer, ISBN 9783540651178, 1999. a
Van Damme, M., Clarisse, L., Heald, C. L., Hurtmans, D., Ngadi, Y., Clerbaux, C., Dolman, A. J., Erisman, J. W., and Coheur, P. F.: Global distributions, time series and error characterization of atmospheric ammonia (NH_{3}) from IASI satellite observations, Atmos. Chem. Phys., 14, 2905–2922, https://doi.org/10.5194/acp1429052014, 2014. a
Van Damme, M., Erisman, J. W., Clarisse, L., Dammers, E., Whitburn, S., Clerbaux, C., Dolman, A. J., and Coheur, P.F.: Worldwide spatiotemporal atmospheric ammonia (NH_{3}) columns variability revealed by satellite, Geophys. Res. Lett., 42, 8660–8668, https://doi.org/10.1002/2015gl065496, 2015. a
Van Damme, M., Whitburn, S., Clarisse, L., Clerbaux, C., Hurtmans, D., and Coheur, P.F.: Version 2 of the IASI NH_{3} neural network retrieval algorithm: nearrealtime and reanalysed datasets, Atmos. Meas. Tech., 10, 4905–4914, https://doi.org/10.5194/amt1049052017, 2017. a, b, c
Van Damme, M., Clarisse, L., Franco, B., Sutton, M. A., Erisman, J. W., Kruit, R. W., van Zanten, M., Whitburn, S., HadjiLazaro, J., Hurtmans, D., Clerbaux, C., and Coheur, P.F.: Global, regional and national trends of atmospheric ammonia derived from a decadal (2008–2018) satellite record, Environ. Res. Lett., 16, 055017, https://doi.org/10.1088/17489326/abd5e0, 2021. a, b, c, d, e
van Geffen, J., Eskes, H., Boersma, K., and Veefkind, J.: TROPOMI ATBD of the total and tropospheric NO_{2} data products, Tech. Rep. S5PKNMIL20005RP, issue 2.4.0, KNMI, https://sentinel.esa.int/documents/247904/2476257/Sentinel5PTROPOMIATBDNO2dataproducts (last access: 20 October 2023), 2022. a
Walker, J. C., Dudhia, A., and Carboni, E.: An effective method for the detection of trace species demonstrated using the MetOp Infrared Atmospheric Sounding Interferometer, Atmos. Meas. Tech., 4, 1567–1580, https://doi.org/10.5194/amt415672011, 2011. a
Wang, W., Liu, C., Clarisse, L., Van Damme, M., Coheur, P.F., Xie, Y., Shan, C., Hu, Q., Zhang, H., Sun, Y., Yin, H., and Jones, N.: Spatial distribution and seasonal variability in atmospheric ammonia measured from groundbased FTIR observations at Hefei, China, Atmos. Meas. Tech. Discuss. [preprint], https://doi.org/10.5194/amt202039, 2020. a
Wells, K. C., Millet, D. B., Payne, V. H., Vigouroux, C., Aquino, C. A. B., Mazière, M. D., de Gouw, J. A., Graus, M., Kurosu, T., Warneke, C., and Wisthaler, A.: NextGeneration Isoprene Measurements From Space: Detecting Daily Variability at High Resolution, J. Geophys. Res.Atmos., 127, e2021JD036181, https://doi.org/10.1029/2021jd036181, 2022. a
Whitburn, S., Van Damme, M., Clarisse, L., Bauduin, S., Heald, C. L., HadjiLazaro, J., Hurtmans, D., Zondlo, M. A., Clerbaux, C., and Coheur, P.F.: A flexible and robust neural network IASINH_{3} retrieval algorithm, J. Geophys. Res., 121, 6581–6599, https://doi.org/10.1002/2016jd024828, 2016. a, b, c, d
Whitburn, S., Clarisse, L., Bouillon, M., Safieddine, S., George, M., Dewitte, S., De Longueville, H., Coheur, P.F., and Clerbaux, C.: Trends in spectrally resolved outgoing longwave radiation from 10 years of satellite measurements, NPJ Clim. Atmos. Sci., 4, 48, https://doi.org/10.1038/s41612021002057, 2021. a
Whitburn, S., Clarisse, L., Crapeau, M., August, T., Hultberg, T., Coheur, P. F., and Clerbaux, C.: A CO_{2}independent cloud mask from Infrared Atmospheric Sounding Interferometer (IASI) radiances for climate applications, Atmos. Meas. Tech., 15, 6653–6668, https://doi.org/10.5194/amt1566532022, 2022. a, b
Zhou, D. K., Larar, A. M., and Liu, X.: MetOpA/IASI Observed Continental Thermal IR Emissivity Variations, IEEE J. Sel. Top. Appl., 6, 1156–1162, https://doi.org/10.1109/JSTARS.2013.2238892, 2013. a, b