- Articles & preprints
- Submission
- Policies
- Peer review
- Editorial board
- About
- EGU publications
- Manuscript tracking

Journal cover
Journal topic
**Atmospheric Measurement Techniques**
An interactive open-access journal of the European Geosciences Union

Journal topic

- Articles & preprints
- Submission
- Policies
- Peer review
- Editorial board
- About
- EGU publications
- Manuscript tracking

- Articles & preprints
- Submission
- Policies
- Peer review
- Editorial board
- About
- EGU publications
- Manuscript tracking

- Abstract
- Introduction
- ATMOZ field measurement campaign and instrument description
- Atmospheric model
- Uncertainty estimation
- Results and discussion
- Conclusions
- Data availability
- Appendix A: Selecting the least squares fitting method
- Appendix B: TOC uncertainties obtained using Chebyshev polynomials
- Competing interests
- Acknowledgements
- References

**Research article**
20 Jun 2018

**Research article** | 20 Jun 2018

Uncertainty analysis of total ozone derived from direct solar irradiance spectra in the presence of unknown spectral deviations

^{1}Metrology Research Institute, Aalto University, P.O. Box 15500, 00076 Aalto, Finland^{2}Physikalisch-Meteorologisches Observatorium Davos, World Radiation Center, Dorfstrasse 33, 7260 Davos Dorf, Switzerland^{3}MIKES Metrology, VTT Technical Research Centre of Finland Ltd, P.O. Box 1000, 02044 VTT, Finland

^{1}Metrology Research Institute, Aalto University, P.O. Box 15500, 00076 Aalto, Finland^{2}Physikalisch-Meteorologisches Observatorium Davos, World Radiation Center, Dorfstrasse 33, 7260 Davos Dorf, Switzerland^{3}MIKES Metrology, VTT Technical Research Centre of Finland Ltd, P.O. Box 1000, 02044 VTT, Finland

**Correspondence**: Anna Vaskuri (anna.vaskuri@aalto.fi) and Petri Kärhä (petri.karha@aalto.fi)

**Correspondence**: Anna Vaskuri (anna.vaskuri@aalto.fi) and Petri Kärhä (petri.karha@aalto.fi)

Abstract

Back to toptop
We demonstrate the use of a Monte Carlo model to estimate the uncertainties in total ozone column (TOC) derived from ground-based direct solar spectral irradiance measurements. The model estimates the effects of possible systematic spectral deviations in the solar irradiance spectra on the uncertainties in retrieved TOC. The model is tested with spectral data measured with three different spectroradiometers at an intercomparison campaign of the research project “Traceability for atmospheric total column ozone” at Izaña, Tenerife on 17 September 2016. The TOC values derived at local noon have expanded uncertainties of 1.3 % (3.6 DU) for a high-end scanning spectroradiometer, 1.5 % (4.4 DU) for a high-end array spectroradiometer, and 4.7 % (13.3 DU) for a roughly adopted instrument based on commercially available components and an array spectroradiometer when correlations are taken into account. When neglecting the effects of systematic spectral deviations, the uncertainties reduce by a factor of 3. The TOC results of all devices have good agreement with each other, within the uncertainties, and with the reference values of the order of 282 DU during the analysed day, measured with Brewer spectrophotometer #183.

Download & links

How to cite

Back to top
top
How to cite.

Vaskuri, A., Kärhä, P., Egli, L., Gröbner, J., and Ikonen, E.: Uncertainty analysis of total ozone derived from direct solar irradiance spectra in the presence of unknown spectral deviations, Atmos. Meas. Tech., 11, 3595–3610, https://doi.org/10.5194/amt-11-3595-2018, 2018.

1 Introduction

Back to toptop
Atmospheric ozone has been defined as an essential climate variable in the global climate observing system (GCOS-200, 2016) of the World Meteorological Organization (WMO). Its long-term monitoring is necessary to document the expected recovery of the ozone layer due to the implementation of the Montreal Protocol (UNTC, 1987) and its amendments on the protection of the ozone layer. Atmospheric ozone, first discovered by Fabry and Buisson (1913), protects humans, the biosphere, and infrastructure from adverse effects of ultraviolet (UV) radiation by shielding the Earth's surface from excessive radiation levels (McElroy and Fogal, 2008). Since the 1970s, it is known that human-produced chlorofluorocarbons (CFCs) destroy atmospheric ozone (Molina and Rowland, 1974) and lead to recurring massive losses of total ozone in the Antarctic in the form of the ozone hole (Farman et al., 1985; Solomon et al., 1986). Unprecedented ozone depletion has also been recently observed in the Arctic (Manney et al., 2011), while in the midlatitudes, moderate ozone depletion has been observed (Solomon, 1999). The Montreal Protocol and its amendments have been successful in reducing the emission of ozone-depleting substances (Velders et al., 2007). Nevertheless, recent studies give conflicting results with respect to the observation of the recovery of the ozone layer, and model projections have shown the recovery to not occur before the middle of the 21st century (Ball et al., 2018; Weber et al., 2018). Therefore, careful monitoring of the thickness of the ozone layer with uncertainties of 1 % or less is crucial for verifying the successful implementation of the Montreal Protocol and the eventual recovery of the ozone layer to pre-1970s levels.

“Traceability for atmospheric total column ozone” (ATMOZ) was a 3-year project funded partly by the European Metrology Research Programme (EMRP) and the European Union (ATMOZ project, 2014). The goal of this project was to produce traceable measurements of total ozone column (TOC) with uncertainties down to 1 % through a systematic investigation of the radiometric and spectroscopic aspects of the methodologies used in retrieval. Another objective of the project was to provide a comprehensive treatment of uncertainties in all parameters affecting the TOC retrievals using spectrophotometers. This paper presents an outcome of the work on studying the uncertainty in TOC obtained from spectral direct solar irradiance measurements, taking unknown spectral errors explicitly into account.

TOC can be determined from spectral measurements of direct solar UV irradiance (Huber et al., 1995). We have developed a Monte Carlo (MC)-based model to estimate the uncertainties in the derived TOC values. One frequently overlooked problem with uncertainty evaluation is that the spectral data may hide systematic wavelength-dependent errors due to unknown correlations (Gardiner et al., 1993; Kärhä et al., 2017b, 2018). Omitting possible correlations may lead to underestimated uncertainties for derived quantities, since spectrally varying systematic errors typically produce larger deviations than uncorrelated noise-like variations that traditional uncertainty estimations predict. Complete uncertainty budgets for quantities measured are necessary to understand long-term environmental trends, such as changes in the stratospheric ozone concentration (e.g. Molina and Rowland, 1974) and solar UV radiation (e.g. Kerr and McElroy, 1993; McKenzie et al., 2007).

Physically, spectral correlations may originate from lamps or other light sources used in calibrations. If their temperatures change, e.g. due to ageing or current setting, a spectral change in the form of Planck's radiation law is introduced. Non-linearity in the responsivity of a detector causes systematic differences between high and low measured values. The introduced spectrally systematic but unknown changes in irradiance may change the derived TOC values significantly, exceeding the uncertainties calculated, assuming that the uncertainty in irradiance behaves like noise. The presence of correlations in measurements can be seen in many ways. For example, problems have occurred when new ozone absorption cross sections have been used (Fragkos et al., 2015; Redondas et al., 2014). Derived ozone values may change significantly because different systematic errors are included in the different cross sections. Also, TOC estimated from a measured spectrum often depends on the wavelength region chosen, although the measurement region should not affect the result much.

In this paper, we introduce a new method for dealing with possible correlations in spectral irradiance data and analyse uncertainties in ozone retrievals for three different spectroradiometers used in a recent ATMOZ intercomparison campaign at Izaña, Tenerife, to demonstrate how it can be used in practice. One of the instruments is QASUME (Gröbner et al., 2005), which is the reference UV spectroradiometer at the World Radiation Center (PMOD/WRC). The second one is an array-based high-quality spectroradiometer BTS2048-UV-S-WP (BTS) from Gigahertz-Optik (Zuber et al., 2017, 2018), operated by Physikalisch-Technische Bundesanstalt (PTB). The third one is an array-based spectroradiometer AvaSpec-ULS2048LTEC (AVODOR) from Avantes, operated by PMOD/WRC. The field of view of the spectroradiometers has been limited so that they measure the direct spectral irradiance of the Sun, excluding most of the indirect radiation from the remainder of the sky.

2 ATMOZ field measurement campaign and instrument description

Back to toptop
The ATMOZ project arranged a field measurement campaign (ATMOZ campaign, 2016)
that took place 12–30 September 2016 at the Izaña Atmospheric Observatory,
a high-mountain Global Atmosphere Watch (GAW) station located at an altitude
of 2.36 km above the sea level in Tenerife, Canary Islands, Spain
(28.3090^{∘} N, 16.4990^{∘} W). The measurement campaign was
organized by the Spanish State Meteorological Agency (AEMET) and the PMOD/WRC for
the intercomparison of TOC measured with different participating instruments,
including Dobson and Brewer spectrophotometers and various
spectroradiometers.

The focus of this paper is to study uncertainties in the TOC values derived from direct solar UV irradiance spectra. Total ozone column TOC is the vertical ozone profile ${\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)$ integrated over altitude as

$$\begin{array}{}\text{(1)}& \mathrm{TOC}=\underset{{z}_{\mathrm{0}}}{\overset{{z}_{\mathrm{1}}}{\int}}{\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)\mathrm{d}z\end{array}$$

from the station altitude *z*_{0} to the top-of-the-atmosphere altitude
*z*_{1}. We study the data measured during the day of 17 September 2016 with
three different spectroradiometers using the ozone retrieval algorithm
introduced in Sect. 3. Station pressure was monitored
during the campaign and determined to be 772.8 hPa with a standard
uncertainty of 1.3 hPa. The ozone and temperature profiles were measured
with a sonde during the campaign and examples of them are shown in
Fig. 1.

Our ozone retrieval method uses one atmospheric layer to reduce computational
complexity. With the single-layer model, the ozone absorption cross section is a
function of the effective temperature, and the relative air mass is a function
of the effective altitude of the ozone layer. Using the vertical ozone
profile ${\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)$, the effective altitude
*h*_{eff}=26 km ± 0.5 km of the ozone layer was estimated by
integration over altitude:

$$\begin{array}{}\text{(2)}& {h}_{\mathrm{eff}}={\displaystyle \frac{{\int}_{{z}_{\mathrm{0}}}^{{z}_{\mathrm{1}}}z\phantom{\rule{0.33em}{0ex}}{\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)\mathrm{d}z}{{\int}_{{z}_{\mathrm{0}}}^{{z}_{\mathrm{1}}}{\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)\mathrm{d}z}},\end{array}$$

from the station altitude *z*_{0} to the top-of-the-atmosphere altitude
*z*_{1}. The corresponding effective temperature *T*_{eff}=228 K ± 1 K was estimated (Fragkos et al., 2015; Komhyr et al., 1993) as

$$\begin{array}{}\text{(3)}& {T}_{\mathrm{eff}}={\displaystyle \frac{{\int}_{{z}_{\mathrm{0}}}^{{z}_{\mathrm{1}}}T\left(z\right){\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)\mathrm{d}z}{{\int}_{{z}_{\mathrm{0}}}^{{z}_{\mathrm{1}}}{\mathit{\rho}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(z\right)\mathrm{d}z}}.\end{array}$$

The uncertainties stated for *h*_{eff}=26 km ± 0.5 km and
*T*_{eff}=228 K ± 1 K are standard deviations. The values
and uncertainties are estimated from the measured vertical profiles
(Fig. 1). The profiles are extended to 80 km using
climatology.

The data sets measured with three different spectroradiometers were studied in this work. These spectroradiometers use different techniques to measure the spectral distribution of radiation. Monochromator-based spectroradiometers, such as QASUME, measure one nearly monochromatic wavelength band at a time, and thus measuring the full spectrum is relatively slow. On the other hand, they usually have significantly better stray light properties than array-based spectroradiometers, such as BTS and AVODOR, which image the full spectrum at once by dispersing the incoming radiation towards a photodiode array.

The QASUME spectroradiometer collects and guides the incoming radiation with
input optics and a quartz fibre bundle to the entrance slit of a Bentham
DM150 double monochromator (Gröbner et al., 2005). One wavelength at a time is
selected by rotating the two gratings of the double monochromator. Then, the
monochromatic signal is measured with a photomultiplier tube. QASUME is
usually operated in global spectral irradiance mode (Gröbner et al., 2005; Hülsen et al., 2016), but during the campaign it was equipped with a collimator tube
with a full opening angle of 2.5^{∘}, allowing the measurement of
direct solar spectral irradiance (Gröbner et al., 2017). The measurement range
of QASUME during the campaign was limited to 250–500 nm with a step
interval of 0.25 nm, so that one spectrum was measured every 15 min. To
ensure stable outdoor measurements, the double monochromator of QASUME was
mounted inside a temperature-controlled weatherproof box
(Hülsen et al., 2016).

The BTS spectroradiometer utilizes a stationary grating and a back-thinned cooled
CCD array detector, mounted in a Czerny–Turner configuration
(Zuber et al., 2017, 2018). To measure direct solar spectrum, BTS was
equipped with a collimator tube with a full opening angle of 2.8^{∘}
designed by PTB, and it uses an internal filter wheel system with eight
filter positions together with a specific measurement routine to reduce stray
light. BTS was mounted on a solar tracker, EKO STR-32G by EKO Instruments
Co., Ltd., with pointing accuracy better than 0.01^{∘}. A
weatherproof housing with temperature control allows BTS to operate at
ambient temperatures from −25 to 50 ^{∘}C. During the ATMOZ
campaign, the housing temperature of BTS was measured to be stable within
0.1 ^{∘}C (Zuber et al., 2017, 2018). The measurement range of BTS
was 200–430 nm with a step size of 0.2 nm during the campaign. One
spectrum was measured every 45 s.

AVODOR spectroradiometer has a stationary grating and a back-thinned cooled
CCD array detector in a Czerny–Turner configuration. AVODOR measures the
spectrum from 200 to 540 nm with a step size of 0.14 nm in the UV region.
During the ATMOZ campaign, the field of view of AVODOR was limited to
1.5^{∘} by a commercial collimator tube used, J1004-SMA by CMS
Ing.Dr.Schreder GmbH. The spectral range of AVODOR was limited between 295
and 345 nm by a combination of two solar blind filters to reduce stray light
from the visible and infrared parts of the solar spectrum. The solar blind
filters were mounted between the collimator tube and the fibre entrance of
the spectroradiometer. One spectrum was measured every 30 s.

The slit functions of the three spectroradiometers shown in
Fig. 2 were measured with lasers before the measurement
campaign. They are needed when fitting the modelled spectra at the Earth's
surface to the measured spectra. In addition, it is important to note
the different wavelength steps of the data: 0.25 nm for QASUME, 0.2 nm for
BTS, and 0.14 nm for AVODOR. The wavelength steps in the spectral data
affect the magnitude of the uncertainties in TOC created by spectrally random
components. In our full-spectrum TOC retrieval, the number of data points
*n*, which is smaller with a larger wavelength step interval, affects
uncertainties with a factor of $\mathrm{1}/\sqrt{n}$, as demonstrated in
Kärhä et al. (2017b); Poikonen et al. (2009).

Brewer MkIII spectrophotometers used as reference devices for ozone measurements established by the International Meteorological Organization, the Commission for Instruments and Methods of Observation (CIMO) (Redondas et al., 2016), also measure the spectral irradiance at UV region, but using four narrow wavelength bands at 310.1, 313.5, 316.8, and 320.0 nm (Kipp & Zonen, 2015). The Brewer MkIII instruments solve absolute TOC values by comparing the logarithms of ratios of count rates between four wavelength channels, i.e. using the double ratio technique. Determining the TOC using the double ratio method is invariant for spectral deviations which have the same relative magnitude at all wavelengths, i.e spectrally constant deviations.

Our full-spectrum retrieval method performs averaging in the wavelength domain, whereas the Brewer spectrophotometer does it in the time domain. A Brewer can measure up to tens of seconds to get millions of photons, so that the photon noise reduces to a level of 0.1 %. At this low noise level, it is not critical that only four wavelengths are used. As Brewer instruments are well-known and widely used, we also compare TOC results obtained using our full-spectrum retrieval method and the spectroradiometers to those measured with Brewer #183 during the same day.

3 Atmospheric model

Back to toptop
In this study, we use an atmospheric ozone retrieval algorithm that is in many
aspects similar to that in the article by Huber et al. (1995). The relationship between
the spectral irradiance *E*_{s}(λ) at the
Earth's surface and the extraterrestrial solar spectrum *E*_{ext}(λ) is based on Beer–Lambert–Bouguer absorption law
(Beer, 1852; Bouguer, 1729; Lambert, 1760) as

$$\begin{array}{ll}{\displaystyle}{E}_{\mathrm{s}}\left(\mathit{\lambda}\right)=& {\displaystyle}\phantom{\rule{0.25em}{0ex}}c\cdot {E}_{\mathrm{ext}}\left(\mathit{\lambda}\right)\cdot \mathrm{exp}\left[-{\mathit{\alpha}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(\mathit{\lambda},{T}_{\mathrm{eff}}\right)\cdot \mathrm{TOC}\cdot {m}_{\mathrm{TOC}}\right.\\ \text{(4)}& {\displaystyle}& {\displaystyle}\left.-{\mathit{\tau}}_{\mathrm{R}}\left(\mathit{\lambda},{P}_{\mathrm{0}},{z}_{\mathrm{0}},\mathit{\varphi}\right)\cdot {m}_{\mathrm{R}}-{\mathit{\tau}}_{\mathrm{AOD}}\left(\mathit{\lambda}\right)\cdot {m}_{\mathrm{AOD}}\right],\end{array}$$

where ${\mathit{\alpha}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(\mathit{\lambda},{T}_{\mathrm{eff}}\right)$ is the ozone absorption cross section at the effective ozone
temperature *T*_{eff}, ${\mathit{\tau}}_{\mathrm{R}}\left(\mathit{\lambda},{P}_{\mathrm{0}},{z}_{\mathrm{0}},\mathit{\varphi}\right)$ is the Rayleigh scattering optical depth, which depends on the
station pressure *P*_{0}, the station altitude *z*_{0}, and the geographic
latitude *ϕ*. The QASUME-FTS (Fourier transform spectroscopy) data set by Gröbner et al. (2017) was used as the
extraterrestrial spectrum *E*_{ext}(λ).
Parameter *c* is a scaling factor set as a free parameter to compensate for
spectrally constant deviations.

The relative air mass of the ozone layer with the Earth's curvature taken into account can be expressed as

$$\begin{array}{}\text{(5)}& {m}_{\mathrm{TOC}}={\displaystyle \frac{\mathrm{1}}{\mathrm{cos}\left[\mathrm{arcsin}\left(\frac{R}{R+{h}_{\mathrm{eff}}}\cdot \mathrm{sin}\mathit{\theta}\right)\right]}},\end{array}$$

where *θ* is the incident solar zenith angle at the observing site that
is a function of the local time, date, and geographic coordinates
(Meeus, 1998; Reda and Andreas, 2008). Parameter *h*_{eff} is the altitude of the
ozone layer from the ground, and *R* is the radius of the Earth. As the ozone
and other molecules creating scattering are distributed at different
altitudes, we calculate the relative air mass factor *m*_{R} for
Rayleigh scattering at the altitude of 5 km (Gröbner and Kerr, 2001) and
approximate the relative air mass factor of aerosols so that *m*_{AOD}≈*m*_{R} (Gröbner et al., 2017). The temperature dependence of
${\mathit{\alpha}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(\mathit{\lambda},{T}_{\mathrm{eff}}\right)$ between
203 and 253 K (Weber et al., 2016) was interpolated by a second-degree
polynomial at each wavelength (Paur and Bass, 1985):

$$\begin{array}{}\text{(6)}& {\mathit{\alpha}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(\mathit{\lambda},{T}_{\mathrm{eff}}\right)={a}_{\mathrm{1}}\left(\mathit{\lambda}\right){T}_{\mathrm{eff}}^{\mathrm{2}}+{a}_{\mathrm{2}}\left(\mathit{\lambda}\right){T}_{\mathrm{eff}}+{a}_{\mathrm{3}}\left(\mathit{\lambda}\right).\end{array}$$

We take the Rayleigh scattering optical depth into account using the state-of-the-art model by Bodhaine et al. (1999). The aerosol optical depth (AOD) is approximated from the Ångström AOD model (Ångström, 1964) as

$$\begin{array}{}\text{(7)}& {\mathit{\tau}}_{\mathrm{AOD}}\left(\mathit{\lambda}\right)=\mathit{\beta}\cdot {\left({\displaystyle \frac{\mathit{\lambda}}{\mathrm{1}\phantom{\rule{0.125em}{0ex}}\mathrm{\mu}\mathrm{m}}}\right)}^{-\mathit{\alpha}},\end{array}$$

where constant *α*≈1.4 is the Ångström coefficient at
typical atmospheric conditions and *β*≥0 is the Ångström
turbidity coefficient.

The model spectrum *E*_{s}(λ) at the Earth's
surface, convolved by the slit function of the spectroradiometer as shown in
Fig. 2, is fitted with parameters TOC, *β*, and *c*
to the measured ground-based spectrum *E*(λ). The
absolute TOC level obtained depends on the fitting method used. We used a
least squares fitting method (Levenberg, 1944; Marquardt, 1963) with
trust-region optimization with the Matlab function “lsqnonlin”:

$$\begin{array}{}\text{(8)}& S=\sum _{i=\mathrm{1}}^{n}w\left({\mathit{\lambda}}_{i}\right)\cdot {\left[{E}_{\mathrm{s}}\left({\mathit{\lambda}}_{i}\right)-E\left({\mathit{\lambda}}_{i}\right)\right]}^{\mathrm{2}},\end{array}$$

where *S* is the sum of the squared residuals to be minimized, and *w*(*λ*_{i}) is the weight for each point measured. Index $i=\mathrm{1},\mathrm{2},\mathrm{\dots},n$ runs over the wavelengths of the spectral measurements.

Figure 3 presents examples of measured and modelled spectra
for the spectroradiometers used in this work. As can be seen, the
signal-to-noise ratios and stray light properties of the devices differ
significantly among different spectroradiometers. All spectra measured with
QASUME are practically noiseless above 10^{−6} W m^{−2} nm^{−1},
resulting in a dynamic range of approximately 4 orders of magnitude. The
dynamic range for BTS is approximately 2 orders of magnitude and less than
2 orders of magnitude for AVODOR.

For QASUME, we use the relative least squares fitting method (RLS) minimization with $w\left(\mathit{\lambda}\right)=E{\left(\mathit{\lambda}\right)}^{-\mathrm{2}}$, as QASUME does not suffer from stray light and RLS fitting has been used in the past for monochromator-based spectroradiometers, e.g. by Huber et al. (1995). These least squares fitting selections are discussed in more detail in Appendix A.

To minimize the effect of stray light, we use the absolute least squares
fitting method, also known as the ordinary least squares fitting method (OLS), with
*w*(λ)=1 for BTS and AVODOR, as this selection is
less affected by the lowest irradiance levels where the stray light and noise
are dominant. As shown in Appendix A, using OLS introduces an offset,
approximately 1 % in these measurements, to the retrieved TOC values. We
take this into account by analysing the results at noon that are also less
influenced by stray light when using RLS, and make a correction to the OLS
results:

$$\begin{array}{}\text{(9)}& {\mathrm{TOC}}_{\mathrm{UTC},\mathrm{OLS},\mathrm{c}}={\displaystyle \frac{{\mathrm{TOC}}_{\mathrm{noon},\mathrm{RLS}}}{{\mathrm{TOC}}_{\mathrm{noon},\mathrm{OLS}}}}\cdot {\mathrm{TOC}}_{\mathrm{UTC},\mathrm{OLS}}.\end{array}$$

After this correction, results of all instruments, QASUME, BTS, and AVODOR are comparable.

The shortest fitting wavelength for the spectroradiometers in this work was selected to be 300 nm, since the typical stray light compensation methods are not effective below 300 nm (Nevas et al., 2014). The upper fitting wavelength limit was set to 340 nm with all three spectroradiometers, as the ozone absorption is not effective above that wavelength. Due to the relatively large bandwidths of the spectroradiometers (Fig. 2), calculations before the convolution and the convolution itself were carried out over a wider range 295–345 nm.

To see whether a global optimum is achieved with our atmospheric ozone
retrieval method, we varied the initial guess values of TOC from 10 to
700 DU, *β* from 0 to 0.5, and *c* from 0 to 100. Within the ranges
stated, the free parameters always converged to the same final values
regardless of the initial guess values.

4 Uncertainty estimation

Back to toptop
In uncertainty analysis, the combined uncertainties are calculated with the square sum of the standard deviations of the components; i.e. their variances are summed up. If correlations of uncertainties are known, they should be taken into account. This can be carried out with the methods defined in the Guide to the Expression of Uncertainty in Measurement (JCGM 100, 2008). In this paper, we do this for all uncertainty components, where the mechanism of contributing to the uncertainty in TOC is known. However, with some of the components, we do not exactly know the mechanisms leading to correlations. With these uncertainties, we estimate the effects that possible correlations might have using a newly developed MC model described in Kärhä et al. (2017a, b).

In our MC model, possible systematic deviations within uncertainties are reproduced using a cumulative Fourier series

$$\begin{array}{}\text{(10)}& \mathit{\delta}\left(\mathit{\lambda}\right)=\sum _{i=\mathrm{0}}^{N}{\mathit{\gamma}}_{i}{f}_{i}\left(\mathit{\lambda}\right),\end{array}$$

with sinusoidal base functions, shown in Fig. 4 as

$$\begin{array}{}\text{(11)}& {f}_{i}\left(\mathit{\lambda}\right)=\sqrt{\mathrm{2}}\cdot \mathrm{sin}\left[i\left(\mathrm{2}\mathit{\pi}{\displaystyle \frac{\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}}{{\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}}}\right)+{\mathit{\varphi}}_{i}\right],\end{array}$$

where index $i=\mathrm{1},\mathrm{2},\mathrm{\dots},N$ depicts the order of complexity of the
deviation (Kärhä et al., 2017b); *λ*_{1} and *λ*_{2} limit the
wavelength range of the analysis. For calculations before the convolution due
to slit function, this range was set to 295–345 nm. Otherwise, the results
at the ends of the range 300–340 nm would be distorted due to incomplete
convolution. This concerns the uncertainty in the extraterrestrial spectrum
and the ozone absorption cross section. After the convolution, actual fitting
of the modelled spectra to the measured spectra was carried out at
300–340 nm, and this range was also used in the uncertainty analysis of the
components related to the measured spectra. The phase *ϕ*_{i} of the base
function is an equally distributed MC variable between 0 and 2*π*. In
addition, *f*_{0}(λ)=1 is used to account for
constant offset. The weights *γ*_{i} for the base functions are selected
in an *N*-dimensional spherical coordinate system (Hicks and Wheeling, 1959) in such
a way that the variance of the final deviation function always equals
unity. In practice, this means that the weights *γ*_{i} are generated by
scaling the random variables ${Y}_{i}\sim \mathcal{N}\left(\mathrm{0},\mathrm{1}\right)$ as

$$\begin{array}{}\text{(12)}& {\mathit{\gamma}}_{i}={\displaystyle \frac{{Y}_{i}}{\sqrt{{Y}_{\mathrm{0}}^{\mathrm{2}}+{Y}_{\mathrm{1}}^{\mathrm{2}}+\mathrm{\dots}+{Y}_{N}^{\mathrm{2}}}}}.\end{array}$$

The complete *N*-dimensional system requires orthogonal base functions, such
as full periods of sine functions, to allow an arbitrary shape of deviation
function *δ*(λ) with unity variance. It is
possible to use other orthogonal sets of functions, such as Chebyshev
polynomials instead of sinusoidal base functions, but that would involve more
complicated mathematics. This is discussed in more detail in
Appendix B.

The deviation functions obtained with the cumulative Fourier series are used
to distort the measured spectra *E*(λ) as

$$\begin{array}{}\text{(13)}& {E}_{\mathrm{e}}\left(\mathit{\lambda}\right)=\left[\mathrm{1}+\mathit{\delta}\left(\mathit{\lambda}\right)u\left(\mathit{\lambda}\right)\right]E\left(\mathit{\lambda}\right),\end{array}$$

where *u*(λ) is the relative standard uncertainty in
the spectrum. The corresponding spectral deviation is applied separately to
other factors of Eq. (4), i.e. the extraterrestrial solar
spectrum, ozone absorption cross section, and Rayleigh scattering.

Variances of the TOC values obtained by varying the weights *γ*_{i} and
the phase terms *ϕ*_{i} give the desired uncertainties.
Figure 5a presents how the uncertainty induced by
deviation in spectral irradiance *E*(λ) (circles)
changes with increasing *N*. Each standard uncertainty in TOC in
Fig. 5a was estimated from the MC results obtained by
running the TOC retrieval 1000 times so that the phases *ϕ*_{i} and the
weights *γ*_{i} of the base functions were independent at each round.
Retrieved TOC deviations resemble the Gaussian distribution when the order of
complexity of the deviation function is *N*≥2 as illustrated in
Fig. 5b and c. As we can see,
full correlation with the base function *f*_{0}(λ) at *N*=0 causes a negligible uncertainty to TOC. The maximum at *N*=1 gives uncertainty for an unfavourable case of correlations with
base functions *f*_{0}(λ) and *f*_{1}(λ). Cases *N*=80 for QASUME, *N*=100 for BTS, or *N*=125 for
AVODOR correspond to the Nyquist criterion ($N=n/\mathrm{2}$) with base functions
and give the uncertainty with no spectral correlations (only random
noise). The obtained TOC value is affected most by spectral distortion that
mimics the spectral shape of the ozone absorption. The first combination of
constant offset and one sinusoidal function with two sign changes within the
region of interest is closest to this extreme.

The ozone absorption cross section ${\mathit{\alpha}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(\mathit{\lambda},{T}_{\mathrm{eff}}\right)$ is a direct multiplier of TOC, and thus the
uncertainty in TOC is directly proportional to the deviations in the ozone
absorption cross section. The uncertainty in TOC arising from the spectral
deviation in ${\mathit{\alpha}}_{{\mathrm{O}}_{\mathrm{3}}}\phantom{\rule{-0.125em}{0ex}}\phantom{\rule{-0.125em}{0ex}}\left(\mathit{\lambda},{T}_{\mathrm{eff}}\right)$ is plotted as crosses in Fig. 5a as a function
of increasing *N*. The ozone absorption cross section, from the
Serdyuchenko–Gorshelev data set (Weber et al., 2016), has a wavelength step
size of 0.01 nm, and thus the standard uncertainty of 0.05 % at the
Nyquist criterion *N*=2500 is outside the range displayed in
Fig. 5a. Unlike the negligible effect of full
spectral correlation in the spectral irradiance *E*(λ)
in TOC, full correlation (*N*=0) in the ozone absorption
cross section produces approximately the same uncertainty as the
unfavourable correlation (*N*=1). Generally, these results cannot
be known before the analysis is carried out, using a method that does not
have any internal limitation to the shape of the deviation function *δ*(λ). In some other cases, the uncertainty extreme
appears at higher *N* values, e.g. *N*=3, noted for correlated colour
temperature by Kärhä et al. (2017b).

One major problem in uncertainty estimation is that typically many of the correlations in spectral irradiance data are unknown. Figure 5a can be used to find limits for the uncertainties assuming different correlation scenarios. In the analysis carried out in this paper, we estimate for each uncertainty component which kind of correlation it most likely has. For this, we divide the correlation into three categories, full, unfavourable, and random and estimate fractions on the assortment of these correlations. “Full” indicates that relative deviation is wavelength independent, such as with distance setting in spectral irradiance measurements. “Random” indicates no correlation between spectral values. As can be seen in Fig. 5a, the uncertainty caused by noise depends on the Nyquist criterion, which increases with a smaller number of base functions. “Unfavourable” indicates an unknown deviation with systematic spectral structure that produces a large deviation in TOC.

Uncertainty budgets of the direct solar spectral irradiance measurements for QASUME, BTS, and AVODOR are presented in Tables 1–3. The tables also state fractions that we estimate for the three correlation types introduced for each component. The uncertainties due to radiometric calibration include factors such as the uncertainty in the standard lamp used and the additional uncertainty due to noise and alignment. QASUME has been validated using various methods; thus the uncertainty due to calibration is low, at 0.55 % (Hülsen et al., 2016). For QASUME and BTS, we assume the correlations to be equally distributed between full correlation, unfavourable correlation, and random correlation (Kärhä et al., 2018). Spectra measured with AVODOR are significantly noisier; thus half of the calibration uncertainty is associated with the random component. Values for the instability of the calibration lamp are based on long-term monitoring. The lamp irradiances have been noted to gradually drop, with no significant wavelength structure within the wavelength region concerned. Non-linearity values are estimations of the operators of the devices. Non-linearity is typically manifested so that the responsivity of the device changes gradually from high readings to low readings. This can cause significant changes to the TOC values; thus we assume the correlation type to be unfavourable. Uncertainties due to device stability and temperature dependence are based on long-term monitoring. The changes have been found to be wavelength independent in the region concerned; thus full correlation is assumed. Noise is the average standard deviation of typical measurements at noon over the wavelength region concerned. The wavelength scales of the devices have been checked using emission lines of gas discharge lamps. The uncertainty values given are the estimated standard deviations of the possible remaining errors after corrections. Wavelength error can introduce a significant change in TOC, because it introduces an error in the form of the derivative of the spectral irradiance. Thus, unfavourable correlation is assumed. Most of the uncertainty components are slightly wavelength dependent, but to simplify simulations, average uncertainty values are used over the wavelength range between 300 and 340 nm.

Table 4 presents an uncertainty budget for TOC that would be obtained with the high-accuracy QASUME spectroradiometer at local noon. All major uncertainty components are listed and estimated. The uncertainty components divided into the three correlation types have been analysed with the new model. The other components in Table 4 have been solved using traditional MC modelling because the mechanism for the uncertainty propagating to TOC is known.

Gröbner et al., 2017Weber et al., 2016Bodhaine et al., 1999^{a} Air mass *m*_{TOC} varies as a function of the altitude of the O_{3} layer. ^{b} Air mass *m*_{R} varies as a function of the altitude of the Rayleigh scattering layer. ^{c} O_{3} cross section varies as a function of temperature. ^{d} Rayleigh scattering depends on the station pressure.

The uncertainties produced in TOC were obtained separately for all
components by setting other uncertainties to zero. Division of the
correlation to the three categories introduced are stated for each row as
fractions *r*_{full}, *r*_{unfav}, and *r*_{random}. For example, the ground-based spectrum *E*(λ) is deviated with the three correlation
components as

$$\begin{array}{ll}{\displaystyle}{E}_{\mathrm{e}}\left(\mathit{\lambda}\right)=& {\displaystyle}\phantom{\rule{0.25em}{0ex}}\left(\mathrm{1}+u\phantom{\rule{0.33em}{0ex}}{r}_{\mathrm{full}}{f}_{\mathrm{0}}\left(\mathit{\lambda}\right)\right)\left(\mathrm{1}+u\phantom{\rule{0.33em}{0ex}}{r}_{\mathrm{unfav}}\sum _{i=\mathrm{0}}^{\mathrm{1}}{\mathit{\gamma}}_{i}^{\prime}{f}_{i}\left(\mathit{\lambda}\right)\right)\\ \text{(14)}& {\displaystyle}& {\displaystyle}\cdot \left(\mathrm{1}+u\phantom{\rule{0.33em}{0ex}}{r}_{\mathrm{random}}\sum _{j=\mathrm{0}}^{N}{\mathit{\gamma}}_{j}^{\prime \prime}{f}_{j}\left(\mathit{\lambda}\right)\right)E\left(\mathit{\lambda}\right),\end{array}$$

where ${\mathit{\gamma}}_{i}^{\prime}$ and ${\mathit{\gamma}}_{j}^{\prime \prime}$ are independent MC variables generated using Eq. (12).

It is worth noting that not all uncertainty components affect the spectrum *E*(λ) directly but via the exponent of
Eq. (4). Corresponding formulas are used to evaluate the
effect of uncertainties in extraterrestrial solar spectrum, ozone absorption
cross section, and Rayleigh scattering. The last column in
Table 4 states the standard uncertainties produced by
each uncertainty component with the assumed fractions, calculated with an
irradiance spectrum measured at local noon with QASUME (Hülsen et al., 2016).
The expanded uncertainty in the TOC, obtained as the square sum of the
individual components and multiplied with coverage factor *k*=2, for this
spectral measurement, is 3.6 DU (1.3 %).

The QASUME spectroradiometer has a combined measurement standard uncertainty of 0.91 % (Hülsen et al., 2016) arising from the uncertainty components explained in Sect. 4.2. The uncertainty components stated are typical in solar UV spectral irradiance measurements (Bernhard and Seckmeyer, 1999). Division of the radiometric calibration uncertainty to equal fractions of $\mathrm{1}/\sqrt{\mathrm{3}}$ is based on typical spectral correlations noted in intercomparisons (Kärhä et al., 2018). The lamp data obtained from national standard laboratories are highly accurate but also typically spectrally correlated. Due to very low noise, elements such as interpolation functions, offsets, and slopes are present in the data. When the calibration is transferred further, uncertainty increases due to noise, and correlations reduce. We thus assume that in this high accuracy calibration, there are equal amounts of fully correlated, unfavourably correlated, and uncorrelated uncertainties.

For *E*_{ext}(λ), we use QASUME-FTS
(Gröbner et al., 2017). We assume the correlation to be similar to a standard
lamp, thus containing equal fractions of full,
unfavourable, and random correlations. The QASUME-FTS is
provided in air wavelengths with a step size of 0.01 nm. Otherwise, the
wavelength shift due to the vacuum–air interface should be corrected from the
extraterrestrial spectrum.

As the reference ozone absorption cross section, the Serdyuchenko–Gorshelev data set given in air wavelengths with a step size of 0.01 nm was used with 1.5 % standard uncertainty (Weber et al., 2016). The systematic and random uncertainties in the Serdyuchenko–Gorshelev data set are given separately (Weber et al., 2016). We further estimate that the systematic uncertainty may include equal fractions of fully correlated and unfavourably correlated uncertainty. Thus, according to that, we use the fractions of 0.23 for full, 0.23 for unfavourable, and 0.95 for random correlations. Full correlation with a fraction of 0.23 produces a standard uncertainty of 0.96 DU, unfavourable correlation with a fraction of 0.23 produces a standard uncertainty of 1.01 DU, and random correlation with a fraction of 0.95 produces a standard uncertainty of 0.22 DU. Altogether, the ozone cross section causes an uncertainty of 1.41 DU to TOC and is thus the dominating component in the uncertainty. If the fractions of correlations are not equally distributed between full and unfavourable, uncertainty in TOC does not change significantly from 1.41 DU. Fractions of 0.31 for full, 0 for unfavourable (or fractions of 0 for full, 0.31 for unfavourable), and 0.95 for random correlations cause an uncertainty of 1.33 DU (or 1.43 DU) in TOC.

For components a–d in Table 4, the mechanism of
contributing to the uncertainty in TOC is known. We know the standard
uncertainty in the O_{3} layer altitude of 26 km to be *u*=0.5 km,
so we vary the altitude accordingly and note the variance of the resulting
TOC. Rayleigh scattering and aerosols are set at the altitude of 5 km ±0.5 km, which influences the relative air mass *m*_{R}≈*m*_{AOD} (Gröbner et al., 2017). This component causes negligible
uncertainty to TOC. To calculate ${\mathit{\tau}}_{\mathrm{R}}\left(\mathit{\lambda},{P}_{\mathrm{0}},{z}_{\mathrm{0}},\mathit{\varphi}\right)$, we use a model by (Bodhaine et al., 1999) with 0.1 %
uncertainty with equal estimated fractions of correlation types. The
correlation has been obtained by studying how this data deviates from the
model by Nicolet (1984). The ozone and temperature profiles were
measured with a sonde during the campaign and based on the profiles, the
effective altitude of the ozone layer was at 26 km ± 0.5 km at the
effective temperature of 228 K ± 1 K. The effect on TOC was obtained
by randomly varying the altitude using a Gaussian uncertainty distribution.
The same applies to air pressure, which was 772.8 hPa with a standard
uncertainty of 1.3 hPa. The effect of temperature on TOC was obtained by
randomly varying the temperature with its standard uncertainty of 1 K.
Varying the temperature systematically changes the spectral ozone absorption
cross section according to Eq. (6).

Stray light that affects TOC results at large solar zenith angles (Appendix A) has not been accounted for in the uncertainty analysis due to a lack of information. Proper correction and estimation of the uncertainty due to stray light would require the stray light correction matrix to be measured. The effect of stray light, typical for measurements with array spectroradiometers, was reduced from the TOC results by fitting BTS and AVODOR spectra with the OLS method. Then, these TOC values were corrected to be compatible with the RLS results by Eq. (9). The correction factor involves a standard uncertainty, which is 0.1 % (0.28 DU) for BTS and 1.1 % (3.10 DU) for AVODOR.

5 Results and discussion

Back to toptop
The calculated TOC values obtained with the three different spectroradiometers on 17 September 2016 are presented in Fig. 6. Expanded uncertainties in the TOC values calculated are stated in DU as error bars. Measurement results of Brewer spectrophotometer #183 used as a reference in the intercomparison have been included in Fig. 6 as well. Looking at the absolute values of TOC in Fig. 6, we may conclude that the results of QASUME and Brewer #183 are in excellent agreement. Also, the TOC values estimated for BTS and AVODOR are in agreement with Brewer #183 within uncertainties.

The expanded uncertainties in the TOC values obtained with the three instruments are shown in Fig. 7. The expanded uncertainties in the TOC data sets at local noon are 3.6 DU (1.3 %) for the QASUME spectroradiometer, 4.4 DU (1.5 %) for the BTS spectroradiometer, and 13.3 DU (4.7 %) for the AVODOR spectroradiometer. The expanded uncertainties stated include the standard deviations of 0.28 DU for BTS and 3.10 DU for AVODOR, arising from the fitting method.

It is of interest to compare the obtained uncertainties with values assuming
no correlations. If we neglect correlations (i.e. we assume the fractions in
Table 4 to be 0 for the full and unfavourable correlations and 1 for the random correlation, and run
the simulations with the spectrum measured at local noon), we obtain the
expanded uncertainty *U*_{QASUME}(TOC)=0.9 DU
(0.3 %), *U*_{BTS}(TOC)=1.1 DU (0.4 %),
and *U*_{AVODOR}(TOC)=7.7 DU (2.7 %). These
values are on average a factor of 3 lower than the uncertainties accounting
for correlations. This analysis assumes random noise only.

Typical practice in an analysis like this is to add a component introduced
by the standard deviation of the fit to the uncertainty. The standard
uncertainty to be added to *u*(TOC) because of the
standard deviation of the fit is 0.2 DU with QASUME, 0.7 DU with BTS, and
3.4 DU with AVODOR, raising the corresponding total expanded uncertainties
to 1.0 DU (0.3 %), 1.8 DU (0.6 %), and 10.3 DU (3.6 %). The results
are generally in agreement within these lower uncertainties as well. However,
comparing differences in the TOC results of the different spectroradiometers
does not represent the uncertainty in the absolute TOC scale, since the ozone
retrieval algorithm uses the same extraterrestrial spectrum and ozone
absorption cross section for all the instruments. Changing the
extraterrestrial spectrum or the ozone absorption cross section to another
data set may shift all the TOC values of the instruments beyond the latter
low uncertainties.

Figure 6 shows that the effect of stray light can be effectively reduced from the TOC results by using the OLS fitting described in Appendix A with the correction in Eq. (9). For example, BTS and QASUME results are in good agreement even at the largest zenith angles. TOC results of AVODOR are in agreement at noon, but the results before 09:00 and after 17:00 deviate from the other instruments by 10 DU.

6 Conclusions

Back to toptop
In this work, we introduced one possible way to take into account spectral correlations in the uncertainties in the atmospheric ozone retrieval and estimated the TOC uncertainties obtained from the spectral data of three different spectroradiometers, measured at the ATMOZ field measurement campaign at the Izaña Atmospheric Observatory. It should be noted that the method proposed has a drawback that the unknown correlations have to be approximated based on experience. However, the method has merits in estimating the order of magnitude of possible uncertainties accounting for correlations. The typical assumption made, that uncertainties are spectrally uncorrelated, is just an assumption as well and in many cases, it is not valid. The uncertainty values obtained with the new model are higher than the uncertainties obtained with the traditional method, which neglects correlations because some of the major uncertainty components may contain systematic spectral deviations. These results demonstrate the importance of accounting for correlations. If their origins and magnitudes are known, they can be accounted for precisely using methods of JCGM 100 (2008).

The new model uses a similar approach to our previously developed MC
uncertainty model for correlated colour temperature (CCT) (Kärhä et al., 2017b).
In the article, we demonstrated the use of the model for calculating the CCT
of a source resembling standard illuminant A. For standard illuminant A, the case representing
uncertainty with unfavourable correlations in CCT was found at *N*=3. On the contrary, for the ozone retrieval the deviation at *N*=1
produces the largest uncertainty, which is in a way trivial compared with
CCT. The use of a set of sine functions as base functions was originally
developed for the more complicated situation of CCT, where it was not known
where the unfavourable uncertainty would be. When we now have
analysed the situation, an uncertainty arising from unfavourable correlations
in the ozone retrieval could be modelled as well, e.g. using a combination of
full spectral deviation, a simple slope, and a parabola as the
deviation function mimicking unfavourable correlations. This is
discussed in more detail in Appendix B.

The new MC method for estimating uncertainties in TOC in the presence of systematic spectral deviations provides more complete estimations of the uncertainty budget compared with the traditionally used methods. The TOC values retrieved from different instrument data were well in agreement within the uncertainties estimated with the new MC method. Although the TOC results obtained using different instruments have good agreement, these differences do not represent the uncertainty in the absolute TOC scale. The TOC uncertainties we have estimated cover possible offsets in the absolute TOC scale, arising from the uncertainties in the ozone absorption cross section and extraterrestrial spectrum that are the dominating components in the uncertainty budget.

Data availability

Back to toptop
Data availability.

The data sets of Figs. 3 and 6 (for 17 September 2016) are parts of a larger data set containing the results on all days 12–30 September 2016 of the comparison campaign. Because more publications will be written on the results of the comparison campaign, the data cannot yet be uploaded to a public repository. Data used in this article can be provided upon request by email to Anna Vaskuri (anna.vaskuri@aalto.fi).

Appendix A: Selecting the least squares fitting method

Back to toptop
Two of the instruments being compared suffer from stray light and noise that distort the TOC results. In earlier studies, e.g. by Herman et al. (2015), stray light in array spectroradiometers has been noted to decrease TOC values at large solar zenith angles, resulting in an inverted U-shape dependence of the diurnal TOC variation. The effect of stray light can be compensated by reducing the effect of the short-wavelength tail, either by limiting the wavelength range or the dynamic range used, or by weighting the results. We studied various weightings and selection methods for data in order to find an objective way to perform the ozone retrieval method and to analyse the results.

Figure A1 shows the TOC results as a function of time analysed
with three different weighting methods for least squares minimization. The
methods include a relative least squares fitting (RLS) in
Eq. (8) with $w\left(\mathit{\lambda}\right)=E{\left(\mathit{\lambda}\right)}^{-\mathrm{2}}$, RLS fitting with the dynamic range (DR) limited to
avoid stray light, and an ordinary least squares fitting method (OLS) with *w*(λ)=1.

TOC values estimated for QASUME in Fig. A1a have no significant solar zenith angle dependence, and limiting the dynamic range of RLS fitting only affects individual TOC values in the early morning and late afternoon compared with the RLS fitting over the complete spectral range. Using the OLS fitting method, the diurnal variation of the TOC remains, but the values are underestimated by a constant factor of 1.013.

TOC values estimated for BTS in Fig. A1b and AVODOR in (c) have severe dependence on the solar zenith angle when using the RLS fitting method. The solar zenith angle dependence decreases to approximately half when limiting the dynamic range to exclude the baseline noise from the fitting. The best results are obtained by using the OLS minimization, which practically removes the solar zenith angle dependence for both BTS and AVODOR but introduces an offset to TOC results. An almost similar offset in TOC results was noted for QASUME. The OLS method violates the heteroscedasticity of our data sets, since we know that the absolute spectral uncertainties are not constant at the studied wavelength range. The only reason to use the OLS method for array spectroradiometers is to reduce the effect of stray light from TOC results. Hence, we correct the TOC results obtained with the OLS method with correction factors estimated from the ratios of TOC values determined from the local noon spectra using both RLS and OLS methods. The correction factors were averaged over 10 samples around noon, being 1.006 for BTS and 1.013 for AVODOR, with standard deviations of 0.1 % (0.28 DU) and 1.1 % (3.10 DU), respectively. This correction makes the TOC results comparable with devices analysed using the RLS method.

For QASUME, we use RLS minimization with the dynamic range limited to 4 orders of magnitude, as it uses most of the useful undistorted data. This is also consistent with the earlier methods used with monochromator-based spectroradiometers, e.g. by Huber et al. (1995).

Appendix B: TOC uncertainties obtained using Chebyshev polynomials

Back to toptop
In the MC uncertainty analysis, it is possible to use other orthogonal sets
of functions instead of sinusoidal functions, such as Chebyshev polynomials
shown in Fig. B1. A Chebyshev polynomial of the first
kind *T*_{j}(λ) of order *j* (Kreyszig, 2006,
p. 209) is defined as

$$\begin{array}{}\text{(B1)}& {T}_{j}\left(\mathit{\lambda}\right)=\mathrm{cos}\left[j\mathrm{arccos}\left({\displaystyle \frac{\mathrm{2}\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}-{\mathit{\lambda}}_{\mathrm{2}}}{{\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}}}\right)\right],\end{array}$$

where *λ*_{1} is the short-wavelength limit and *λ*_{2} is the
long-wavelength limit for the spectra measured. To create arbitrary spectral
deviations with unity variance, each Chebyshev polynomial, except for ${g}_{\mathrm{0}}\left(\mathit{\lambda}\right)={T}_{\mathrm{0}}\left(\mathit{\lambda}\right)=\mathrm{1}$, needs to be
normalized to unity variance as

$$\begin{array}{}\text{(B2)}& {g}_{j}\left(\mathit{\lambda}\right)={\displaystyle \frac{{T}_{j}\left(\mathit{\lambda}\right)}{{\mathit{\sigma}}_{j}}},\end{array}$$

where *σ*_{j} is the standard deviation of *T*_{j}(λ). In practice, Chebyshev polynomials in Fig. B1
can be generated fast using recurrence (e.g. Fateman, 1989) as

$$\begin{array}{}\text{(B3)}& {T}_{j}\left(\mathit{\lambda}\right)=\mathrm{2}\left({\displaystyle \frac{\mathrm{2}\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}-{\mathit{\lambda}}_{\mathrm{2}}}{{\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}}}\right){T}_{j-\mathrm{1}}\left(\mathit{\lambda}\right)-{T}_{j-\mathrm{2}}\left(\mathit{\lambda}\right),\end{array}$$

where *T*_{0}(λ)=1, and ${T}_{\mathrm{1}}\left(\mathit{\lambda}\right)=\left(\mathrm{2}\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}-{\mathit{\lambda}}_{\mathrm{2}}\right)/\left({\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}\right)$ is a straight line. According to Eq. (B2) the scaling with the
standard deviation is performed after
generating the Chebyshev polynomials.

Each base function of the cumulative Fourier series in Eq. (10) was formed with sine (odd) and cosine (even) terms (Kreyszig, 2006, p. 628),

$$\begin{array}{ll}{\displaystyle}\mathrm{sin}& {\displaystyle}\left[i\left(\mathrm{2}\mathit{\pi}{\displaystyle \frac{\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}}{{\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}}}\right)+{\mathit{\varphi}}_{i}\right]=\mathrm{cos}\left({\mathit{\varphi}}_{i}\right)\cdot \mathrm{sin}\left(\mathrm{2}\mathit{\pi}i{\displaystyle \frac{\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}}{{\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}}}\right)\\ \text{(B4)}& {\displaystyle}& {\displaystyle}+\mathrm{sin}\left({\mathit{\varphi}}_{i}\right)\cdot \mathrm{cos}\left(\mathrm{2}\mathit{\pi}i{\displaystyle \frac{\mathit{\lambda}-{\mathit{\lambda}}_{\mathrm{1}}}{{\mathit{\lambda}}_{\mathrm{2}}-{\mathit{\lambda}}_{\mathrm{1}}}}\right),\end{array}$$

where the phase *ϕ*_{i} is an equally distributed MC variable between 0
and 2*π*. Hence, the analysis based on Chebyshev polynomials to be
compatible with the sinusoidal approach, each base function *f*_{i}(λ) with index *i*≥1 is formed by the combination of odd
(2*i*−1) and even (2*i*) terms as

$$\begin{array}{}\text{(B5)}& {f}_{i}\left(\mathit{\lambda}\right)=\mathrm{cos}\left({\mathit{\varphi}}_{i}\right)\cdot {g}_{\mathrm{2}i-\mathrm{1}}\left(\mathit{\lambda}\right)+\mathrm{sin}\left({\mathit{\varphi}}_{i}\right)\cdot {g}_{\mathrm{2}i}\left(\mathit{\lambda}\right),\end{array}$$

where the weights cos(*ϕ*_{i}) and sin(*ϕ*_{i}) set the variance of *f*_{i}(λ) to unity.
These base functions *f*_{i}(λ) can be used with
Eqs. (10) and (13).

Figure B2 compares standard uncertainties in TOC obtained by generating arbitrary spectral deviations using Chebyshev polynomials as base functions (circles and triangles), formed using Eq. (B5), with those obtained by using sinusoidal base functions (crosses). The uncertainties change slightly at the lowest complexity orders of deviations when sinusoidal base functions are replaced with Chebyshev polynomials but essentially the results are similar.

Competing interests

Back to toptop
Competing interests.

The authors declare that they have no conflict of interest.

Acknowledgements

Back to toptop
Acknowledgements.

Peter Sperfeld from PTB is acknowledged for measuring and providing the BTS
data set. Alberto Redondas and all personnel from Izaña Atmospheric
Research Center, AEMET, Tenerife, Canary Islands, Spain, are acknowledged for
measuring and providing the Brewer #183 data set and the environmental
parameters such as the sonde data. Anna Vaskuri is grateful for the
grant by the Emil Aaltonen Foundation, Finland. This work has been supported
by the European Metrology Research Programme (EMRP) within the joint research
project ENV59 “Traceability for atmospheric total column ozone” (ATMOZ).
The EMRP is jointly funded by the EMRP participating countries within EURAMET
and the European Union.

Edited by: Lok Lamsal

Reviewed by: four anonymous referees

References

Back to toptop
Ångström, A.: The parameters of atmospheric turbidity, Tellus, 16, 64–75, 1964. a

ATMOZ campaign: ATMOZ field measurement campaign 2016, available at: http://rbcce.aemet.es/2015/11/24/atmoz-intercomparison-campaign-at-izana-tenerife-september-2016/ (last access: 15 May 2018), 2016. a

ATMOZ project: ENV59 “Traceability for atmospheric total column ozone” (ATMOZ), available at: http://projects.pmodwrc.ch/atmoz/ (last access: 15 May 2018), 2014–2017. a

Ball, W. T., Alsing, J., Mortlock, D. J., Staehelin, J., Haigh, J. D., Peter, T., Tummon, F., Stübi, R., Stenke, A., Anderson, J., Bourassa, A., Davis, S. M., Degenstein, D., Frith, S., Froidevaux, L., Roth, C., Sofieva, V., Wang, R., Wild, J., Yu, P., Ziemke, J. R., and Rozanov, E. V.: Evidence for a continuous decline in lower stratospheric ozone offsetting ozone layer recovery, Atmos. Chem. Phys., 18, 1379–1394, https://doi.org/10.5194/acp-18-1379-2018, 2018. a

Beer, A.: Bestimmung der Absorption des rothen Lichts in farbigen Flüssigkeiten, Annalen der Physik und Chemie, 86, 78–88, 1852. a

Bernhard, G. and Seckmeyer, G.: Uncertainty of measurements of spectral solar UV irradiance, J. Geophys. Res., 104, 14321–14345, 1999. a

Bodhaine, B. A., Wood, N. B., Dutton, E. G., and Slusser, J. R.: On Rayleigh Optical Depth Calculations, J. Atmos. Ocean. Tech., 16, 1854–1861, 1999. a, b, c

Bouguer, P.: Essai d'optique sur la gradation de la lumière, Paris, France, Claude Jombert, 16–22, 1729. a

Fabry, C. and Buisson, H.: L'absorption de l'ultra-violet par l'ozone et la limite du spectre solaire, J. Phys., 3, 196–206, 1913. a

Farman, J. C., Gardiner, B. G., and Shanklin, J. D.: Large losses of total
ozone in Antarctica reveal seasonal ClO_{x}∕NO_{x}
interaction, Nature, 315, 207–210, 1985. a

Fateman, R. J.: Lookup tables, recurrences and complexity, Proc. Int. Symp. Symbolic and Algebraic Computation (ISSAC '89), Portland, Oregon, USA, 17–19 July 1989. a

Fragkos, K., Bais, A. F., Balis, D., Meleti, C., and Koukouli, M. E.: The Effect of Three Different Absorption Cross-Sections and their Temperature Dependence on Total Ozone Measured by a Mid-Latitude Brewer Spectrophotometer, Atmos. Ocean, 53, 19–28, 2015. a, b

Gardiner, B. G., Webb, A. R., Bais, A. F., Blumthaler, M., Dirmhirn, I., Forster, P., Gillotay, D., Henriksen, K., Huber, M., Kirsch, P. J., Simon, P. C., Svenoe, T., Weihs, P., and Zerefos, C. S.: European intercomparison of ultraviolet spectroradiometers, Environ. Technol., 14, 25–43, 1993. a

GCOS-200: The Global Observing System for Climate: Implementation Needs, World Meteorological Organization, 2016. a

Gröbner, J. and Kerr, J. B.: Ground-based determination of the spectral ultraviolet extraterrestrial solar irradiance: Providing a link between space-based and ground-based solar UV measurements, J. Geophys. Res., 106, 7211–7217, 2001. a

Gröbner, J., Schreder, J., Kazadzis, S., Bais, A. F., Blumthaler, M., Görts, P., Tax, R., Koskela, T., Seckmeyer, G., Webb, A. R., and Rembges, D.: Traveling reference spectroradiometer for routine quality assurance of spectral solar ultraviolet irradiance measurements, Appl. Optics, 44, 5321–5331, 2005. a, b, c

Gröbner, J., Kröger, I., Egli, L., Hülsen, G., Riechelmann, S., and Sperfeld, P.: The high-resolution extraterrestrial solar spectrum (QASUMEFTS) determined from ground-based solar irradiance measurements, Atmos. Meas. Tech., 10, 3375–3383, https://doi.org/10.5194/amt-10-3375-2017, 2017. a, b, c, d, e, f

Herman, J., Evans, R., Cede, A., Abuhassan, N., Petropavlovskikh, I., and McConville, G.: Comparison of ozone retrievals from the Pandora spectrometer system and Dobson spectrophotometer in Boulder, Colorado, Atmos. Meas. Tech., 8, 3407–3418, https://doi.org/10.5194/amt-8-3407-2015, 2015. a

Hicks, J. S. and Wheeling, R. F.: An efficient method for generating
uniformly distributed points on the surface of an *n*-dimensional sphere,
Commun. ACM, 2, 17–19, 1959. a

Huber, M., Blumthaler, M., Ambach, W., and Staehelin, J.: Total atmospheric ozone determined from spectral measurements of direct UV irradiance, Geophys. Res. Lett., 22, 53–56, 1995. a, b, c, d

Hülsen, G., Gröbner, J., Nevas, S., Sperfeld, P., Egli, L., Porrovecchio, G., and Smid, M.: Traceability of solar UV measurements using the QASUME reference spectroradiometer, Appl. Optics, 55, 7265–7275, 2016. a, b, c, d, e

JCGM 100: Evaluation of measurement data – Guide to the expression of uncertainty in measurement (ISO/IEC Guide 98–103), 2008. a, b

Kärhä, P., Vaskuri, A., Gröbner, J., Egli, L., and Ikonen, E.: Monte Carlo analysis of uncertainty of total atmospheric ozone derived from measured spectra, AIP Conf. Proc., 1810, 110005, 1–4, 2017a. a

Kärhä, P., Vaskuri, A., Mäntynen, H., Mikkonen, N., and Ikonen, E.: Method for estimating effects of unknown correlations in spectral irradiance data on uncertainties of spectrally integrated colorimetric quantities, Metrologia, 54, 524–534, 2017b. a, b, c, d, e, f

Kärhä, P., Vaskuri, A., Pulli, T., and Ikonen, E.: Key comparison CCPR-K1.a as an interlaboratory comparison of correlated color temperature, J. Phys. Conf. Ser., 972, 012012, 1–4, 2018. a, b, c

Kerr, J. B. and McElroy, C. T.: Evidence for large upward trends of ultraviolet-B radiation, Science, 262, 1032–1034, 1993. a

Kipp & Zonen: Brewer MkIII Spectrophotometer, Operator's manual Rev F, 2015. a

Komhyr, W. D., Mateer, C. L., and Hudson, R. D.: Effective Bass-Paur 1985 ozone absorption coefficients for use with Dobson ozone spectrophotometers, J. Geophys. Res., 98, 20451–20465, 1993. a

Kreyszig, E.: Advanced Engineering Mathematics, 9th Edn., John Wiley & Sons, 1232 pp., 2006. a, b

Lambert, J. H.: Photometria sive de mensura et gradibus luminis, colorum et umbrae, Augsburg (“Augusta Vindelicorum”), Germany, Eberhardt Klett, 1760. a

Levenberg, K.: A method for the solution of certain non-linear problems in least squares, Q. Appl. Math., 2, 164–168, 1944. a

Manney, G. L., Santee, M. L., Rex, M., Livesey, N. J., Pitts, M. C., Veefkind, P., Nash, E. R., Wohltmann, I., Lehmann, R., Froidevaux, L., Poole, L. R., Schoeberl, M. R., Haffner, D. P., Davies, J., Dorokhov, V., Gernandt, H., Johnson, B., Kivi, R., Kyrö, E., Larsen, N., Levelt, P. F., Makshtas, A., McElroy, C. T., Nakajima, H., Concepción Parrondo, M., Tarasick, D. W., von der Gathen, P., Walker, K. A., and Zinoviev, N. S.: Unprecedented Arctic ozone loss in 2011, Nature, 478, 469–475, 2011. a

Marquardt, D. W.: An Algorithm for Least-Squares Estimation of Nonlinear Parameters, J. Soc. Ind. Appl. Math., 11, 431–441, 1963. a

McElroy, C. T. and Fogal, P. F., Ozone: From Discovery to Protection, Atmos. Ocean, 46, 1–13, 2008. a

McKenzie, R. L., Aucamp, P. J., Bais, A. F., Björn, L. O., and Ilyas, M.: Changes in biologically-active ultraviolet radiation reaching the Earth's surface, Photochem. Photobio. S., 6, 218–231, 2007. a

Meeus, J.: Astronomical Algorithms, 2nd Edn., Willmann-Bell, Richmond, VA, USA, 477 pp., 1998. a

Molina, M. J. and Rowland, F. S.: Stratospheric sink for chlorofluoromethanes: chlorine atom-catalysed destruction of ozone, Nature, 249, 810–812, 1974. a, b

Nevas, S., Gröbner, J., Egli, L., and Blumthaler, M.: Stray light correction of array spectroradiometers for solar UV measurements, Appl. Optics, 53, 4313–4319, 2014. a

Nicolet, M.: On the molecular scattering in the terrestrial atmosphere: An empirical formula for its calculation in the homosphere, Planet. Space Sci., 32, 1467–1468, 1984. a

Paur, R. J. and Bass, A. M.: The ultraviolet cross-sections of ozone: II. Results and temperature dependence, edited by: Zerefos, C. S. and Ghazi, A., Atmospheric Ozone, Springer, Dordrecht 611–616, 1985. a

Poikonen, T., Kärhä, P., Manninen, P., Manoocheri, F., and Ikonen, E.: Uncertainty analysis of photometer quality factor ${f}_{\mathrm{1}}^{\prime}$, Metrologia, 46, 75–80, 2009. a

Reda, I. and Andreas, A.: Solar Position Algorithm for Solar Radiation Applications, Technical Report NREL/TP-560-34302, Colorado, USA, Revised, 2008. a

Redondas, A., Evans, R., Stuebi, R., Köhler, U., and Weber, M.: Evaluation of the use of five laboratory-determined ozone absorption cross sections in Brewer and Dobson retrieval algorithms, Atmos. Chem. Phys., 14, 1635–1648, https://doi.org/10.5194/acp-14-1635-2014, 2014. a

Redondas, A., Rodríguez-Franco, J. J., López-Solano, J., Carreño, V., Leon-Luis, S. F., Hernandez-Cruz, B., and Berjón, A.: The Regional Brewer Calibration Center – Europe: an overview of the X Brewer Intercomparison Campaign, WMO Commission for Instruments and Methods of Observation, 1–8, 2016. a

Solomon, S.: Stratospheric ozone depletion: A review of concepts and history, Rev. Geophys., 37, 275–316, 1999. a

Solomon, S., Garcia, R. R., Rowland, F. S., and Wuebbles, D. J.: On the depletion of Antarctic ozone, Nature, 321, 755–758, 1986. a

Toledano, C., Cachorro, V. E., Berjon, A., de Frutos, A. M., Sorribas, M., de la Morena, B. A., and Goloub, P.: Aerosol optical depth and Ångström exponent climatology at El Arenosillo AERONET site (Huelva, Spain), Q. J. Roy. Meteor. Soc., 133, 795–807, 2007.

UNTC: United Nations Treaty Collection, Chapter XXVII, Environment, 2.a Montreal Protocol on Substances that Deplete the Ozone Layer, Montreal, 16 September 1987. a

Velders, G. J. M., Andersen, S. O., Daniel, J. S., Fahey, D. W., and McFarland, M.: The importance of the Montreal Protocol in protecting climate, P. Natl. Acad. Sci. USA, 104, 4814–4819, 2007. a

Weber, M., Gorshelev, V., and Serdyuchenko, A.: Uncertainty budgets of major ozone absorption cross sections used in UV remote sensing applications, Atmos. Meas. Tech., 9, 4459–4470, https://doi.org/10.5194/amt-9-4459-2016, 2016. a, b, c, d, e

Weber, M., Coldewey-Egbers, M., Fioletov, V. E., Frith, S. M., Wild, J. D., Burrows, J. P., Long, C. S., and Loyola, D.: Total ozone trends from 1979 to 2016 derived from five merged observational datasets – the emergence into ozone recovery, Atmos. Chem. Phys., 18, 2097–2117, https://doi.org/10.5194/acp-18-2097-2018, 2018. a

Zuber, R., Sperfeld, P., Nevas, S., Sildoja, M., and Riechelmann, S.: A stray light corrected array spectroradiometer for complex high dynamic range measurements in the UV spectral range, Proc. of the 13th Int. Conf. on New Developments and Applications in Optical Radiometry (NEWRAD 2017), Tokyo, Japan, 13–16 June 2017. a, b, c

Zuber, R., Sperfeld, P., Riechelmann, S., Nevas, S., Sildoja, M., and Seckmeyer, G.: Adaption of an array spectroradiometer for total ozone column retrieval using direct solar irradiance measurements in the UV spectral range, Atmos. Meas. Tech., 11, 2477–2484, https://doi.org/10.5194/amt-11-2477-2018, 2018. a, b, c, d

Short summary

In this work, we introduce a Monte Carlo uncertainty analysis that takes into account possible systematic spectral deviations in the atmospheric full spectrum ozone retrieval method. Accounting for possible systematic spectral deviations in the spectral data is important since they produce larger total ozone column uncertainties than uncorrelated noise-like variations that traditional uncertainty estimations predict.

In this work, we introduce a Monte Carlo uncertainty analysis that takes into account possible...

Atmospheric Measurement Techniques

An interactive open-access journal of the European Geosciences Union