The North America-based Tropospheric Ozone Lidar Network (TOLNet) was recently established to provide high spatiotemporal vertical profiles of ozone, to better understand physical processes driving tropospheric ozone variability and to validate the tropospheric ozone measurements of upcoming spaceborne missions such as Tropospheric Emissions: Monitoring Pollution (TEMPO). The network currently comprises six tropospheric ozone lidars, four of which are mobile instruments deploying to the field a few times per year, based on campaign and science needs. In August 2016, all four mobile TOLNet lidars were brought to the fixed TOLNet site of JPL Table Mountain Facility for the 1-week-long Southern California Ozone Observation Project (SCOOP). This intercomparison campaign, which included 400 h of lidar measurements and 18 ozonesonde launches, allowed for the unprecedented simultaneous validation of five of the six TOLNet lidars. For measurements between 3 and 10 km a.s.l., a mean difference of 0.7 ppbv (1.7 %), with a root-mean-square deviation of 1.6 ppbv or 2.4 %, was found between the lidars and ozonesondes, which is well within the combined uncertainties of the two measurement techniques. The few minor differences identified were typically associated with the known limitations of the lidars at the profile altitude extremes (i.e., first 1 km above ground and at the instruments' highest retrievable altitude). As part of a large homogenization and quality control effort within the network, many aspects of the TOLNet in-house data processing algorithms were also standardized and validated. This thorough validation of both the measurements and retrievals builds confidence as to the high quality and reliability of the TOLNet ozone lidar profiles for many years to come, making TOLNet a valuable ground-based reference network for tropospheric ozone profiling.
Although vital in the stratosphere, ozone has long been recognized as an air
pollutant near the Earth's surface, causing health problems for humans and
vegetation at high concentration (World Health Organization, 2003).
Tropospheric ozone is also a short-lived greenhouse gas impacting climate,
contributing to the Earth's global warming (IPCC, 2013). Despite significant
regulatory efforts and pollution-control programs developed over the past 20
years in the most densely populated regions of the globe (e.g., Europe,
North America, and more recently Asia), recent reports of continuing
free-tropospheric ozone increases, for example in the western United States
(Cooper et al., 2012; Granados-Muñoz and Leblanc, 2016; Gaudel et al.,
2018), have triggered the need to enhance our tropospheric ozone observation
capabilities. In this context, the North America-based Tropospheric Ozone
Lidar Network (TOLNet,
In August 2016, taking advantage of a favorable field deployment calendar,
all four TOLNet mobile lidars were brought to the fixed TOLNet site of
JPL-TMF for a 1-week-long intercomparison campaign that allowed for the
unprecedented simultaneous validation of five of the six TOLNet lidars: the
Southern California Ozone Observation Project (SCOOP). As part of the
international Network for the Detection of Atmospheric Composition Change
(NDACC) (De Mazière et al., 2018), TMF is a well-recognized research
facility for the validation of atmospheric remote-sensing instrumentation
(e.g., Leblanc et al., 2011; McDermid et al., 1995). In addition to its three
NDACC lidars (one of them being TMTOL), the facility hosts
pressure–temperature–humidity (PTU) sonde and ozonesonde launch systems,
radiometers, spectrometers, and surface composition and weather instruments.
In support of the SCOOP campaign, several surface ozone monitoring
instruments were operated at the site
Prior to this study, three of the TOLNet lidars (TOPAZ, TROPOZ, and LMOL) participated in the Deriving Information on Surface Conditions from COlumn and VERtically Resolved Observations Relevant to Air Quality (DISCOVER-AQ) field campaign in Colorado in 2014, showing a mean relative difference within 4 % between these three lidars (Wang et al., 2017). However, after the DISCOVER-AQ campaign, the TOPAZ and LMOL systems underwent significant hardware upgrades resulting in better stability, higher precision, and much higher measurable altitudes.
This paper reviews the TOLNet lidar measurement and retrieval validation efforts undergone prior to, during, and immediately after the SCOOP campaign, which eventually led to the current routine production of homogeneous, quality-controlled ozone profiles from the AMOLITE, LMOL, TMTOL, TOPAZ, and TROPOZ lidars. After a brief technical description of the participating TOLNet lidar instruments (Sect. 2), the campaign operational details relevant to the validation of the lidars are reviewed (Sect. 3). The validation of the TOLNet data processing algorithms is summarized in Sect. 4. The blind intercomparison of the lidar and ozonesonde measurements during SCOOP is presented in Sect. 5. This dual algorithm–measurement validation approach allows the separation of ozone biases owing to the data processing on one hand and to the measurement itself on the other hand. The final outcome is presented in Sect. 6, and all the results are summarized in Sect. 7. Conclusions are provided in Sect. 8 together with a brief discussion on the possible avenues of future TOLNet development.
Five of the six TOLNet lidars participated in the SCOOP campaign. During the few months preceding the campaign, some of these lidars had undergone a few instrument configuration changes, and further validation therefore turned out to be timely. By the end of the SCOOP campaign, and as will be demonstrated in this article, all five lidar systems proved to provide excellent quality ozone profiles, and their performance during the SCOOP campaign is believed to remain stable for years to come. Each instrument is briefly described below. Key transmitter and receiver specifications for all ozone lidar systems are compiled in Table 1, and key data acquisition settings in Table 2.
TOLNet ozone lidar instrument configuration used during SCOOP.
ADC: analog-to-digital converter; PC: photon counting; PMT: photomultiplier; TR: transient recorder.
The Autonomous Mobile Ozone Lidar Instrument for Tropospheric Experiments
(AMOLITE) was designed and built by Environment and Climate Change Canada
(Strawbridge et al., 2018), leveraging on a decade-long past experience of
building autonomous mobile aerosol lidars (Strawbridge, 2013). Space in the
2.1
The ozone system which produced all AMOLITE ozone profiles presented here
comprises two Nd:YAG lasers producing 45 mJ per pulse at 266 nm and 20 Hz.
The 266 nm beam is sent through a 1 m long cell filled with
The Langley Mobile Ozone Lidar (LMOL) is a ground-based tropospheric
profiling ozone lidar system housed in a mobile trailer that has
participated in air quality studies since 2014 (Young et al., 2017). Like
the other TOLNet lidar systems, LMOL relies on ultraviolet (UV) pulsed laser
source that produces two wavelengths allowing for calculation of
Backscattered light from the atmosphere was collected by a co-aligned 40 cm diameter fiber-coupled Newtonian telescope with a 1.4 mrad field of view, providing measurements from 0.6 to 8 km in altitude. The fiber output from the 40 cm telescope was connected to a light-tight enclosure containing a collimating optic, a pair of UV band-pass filters in series (280–295 nm spectral window) that were integrated with Hamamatsu PMT R7400-U03 detector. The PMT output was connected to a single-channel, 12 bit Licel data system that provided simultaneous analog and photon-counting outputs. The Licel system memory was synchronously gated with the alternating wavelength pulses, to separately capture profiles for the on- and offline data, and subsequently recorded by the instrument computer system for processing of raw signals into calibrated ozone profiles.
The processing of profiles was implemented following the standard DIAL technique (Browell et al., 1985). Raw signals, both analog and photon counting, are background-subtracted and range-squared before application of a single-pass Savitzky–Golay filter (Leblanc et al., 2016a, and references therein); the more points used in the filter, the lower the resolution. Analog and photon-counting channels are merged together to provide a single optimized profile for range and signal-to-noise performance (Leblanc et al., 2016b; Zhang et al., 2014; Newsom et al., 2009). Ozone cross sections along with pressure and temperature information are used as part of the filter process to extract ozone mixing ratio as a function of altitude. The process is repeated for each new profile on a 5–10 min temporally averaged basis, to provide a continuous curtain display on the evolution of ozone vertical distribution during the course of a day. From a data analysis perspective, the more the data are averaged vertically, the lower the noise, but at the expense of the vertical resolution. A real-time data display was also available, allowing for display of the system-generated ozone curtain profiles as they are collected, for immediate feedback on atmospheric observations. This display was also linked over the Internet and could be remotely monitored, along with other system parameters.
It is important to note that LMOL was originally configured to only collect
data in the lower troposphere, and hence the data system range configuration
was limited to 18 km. The background subtraction value is determined from
approximately the last 2 km of the data collection window. Ordinarily this does
not pose a problem; however the SCOOP type analyses can reveal a bias error
in LMOL due to residual laser light being captured in the range bins used
for background value determination. This is particularly true for extended
temporal averaging (
Since the SCOOP campaign, there are a number of instrument improvements that have been implemented that further enhance the capabilities of the LMOL system. These include implementation of a second, smaller-diameter wide-field telescope to allow measurements in the 120–1000 m altitude range (Farris et al., 2018; Gronoff et al., 2018), replacement of the outdated PMT with Hamamatsu model R9880U-113 and a new transmission configuration and roof window system to enable continuous unattended measurements. Since SCOOP, the LMOL system has successfully participated in three additional field deployments.
The JPL-TMF tropospheric ozone lidar (TMTOL) is the third of four lidars designed at JPL for the long-term monitoring of atmospheric composition, thus contributing to the international network NDACC since 1999 (McDermid et al., 2002). Over the course of nearly 20 years, the system has gone through several hardware and operational modifications.
The emitter comprises a quadrupled Nd:YAG laser producing two beams of approximately 1 W each at 266 nm, at a repetition rate of 30 Hz. Each beam is sent through a Raman cell, one cell filled with hydrogen and the other with deuterium, to shift the wavelength to 299.1 and 288.9 nm, respectively. The two beams are expanded five times to reduce their divergence (to less than 1 mrad) and to make them eye-safe as soon as they are transmitted outside the lidar building.
The optical receiver comprises a large Newtonian telescope (91 cm diameter, 2.4 m focal length) coupled with a dual optical fiber sending the lidar high-intensity returns to a polychromator. Two small telescopes (5 cm diameter), each aligned to one of the transmitted beams, are used to collect the near-range (low-intensity) signals. For each small telescope the light is focused at the entrance of an optical fiber and sent to the polychromator. This latter comprises four independent optical paths determined by the position of the fibers' output, corresponding to two high-intensity and two low-intensity channels. Until 2012, a mechanical chopper with four slits coinciding with the position of the fibers' outputs blocked the transmission of the strongest returns (lowest 1 km) from the large telescope fibers. Since 2012, the chopper wheel has been kept in a fixed open position allowing the returns from all altitudes for all four fibers' outputs to be transmitted. The light output from each fiber is transmitted through a dichroic beam splitter reflecting shorter wavelengths (Hartley band), a collimating lens, an interference filter (2 nm full width at half maximum (FWHM) centered at 289 or 299 nm, depending on the fiber considered), and a focusing lens, before it reaches the surface of a photomultiplier tube (Hamamatsu H5783P-06). Although of old age, these photomultipliers have proved to be very reliable in the long term, with minimal signal-induced noise despite the presence of high intensity returns.
The data acquisition system includes four joint analog–photon-counting transient recorders (Licel) allowing a vertical sampling of 7.5 m between the ground and 60 km altitude. The 16 bit analog signals are not used in the current SCOOP data analysis, and only the results coming from the photon-counting channels are shown here.
TOLNet ozone lidar data acquisition configuration used during SCOOP.
Before data acquisition, the two emitted beams are aligned to the large telescope mirror axis using a computer-controlled motion controller and actuators changing the orientation of the two transmitting mirrors. When properly aligned, the low-intensity channels can be used down to an altitude range of 600 m above ground, i.e., 2.9 km a.s.l.
During the SCOOP campaign the lidar typical altitude range after combining the low- and high-intensity channels extends from 2.9 to 15 km a.s.l. During the night, the top altitude typically reaches 18 km for a 30 min averaged profile. It is extended to 25 km by adding another DIAL pair of channels using the 299 nm high-intensity signal of TMTOL as the absorbed signal and the low-intensity 355 nm signal of the co-located NDACC water vapor Raman lidar as the non-absorbed signal.
In routine operation mode, the raw signals are saved every 5 min. They are then averaged to the desired vertical and temporal resolutions based on the science needs. For NDACC, the lidar routinely operates 2 h per night, 4–5 nights per week, year-round. The 2 h averaged (nighttime-only) ozone profiles are archived systematically at the NDACC Data Archive Center, forming a long-term dataset of more than 2000 profiles (3–25 km) since 1999. For the SCOOP campaign, the lidar operation was extended to all times of the day, with ozone profiles reaching a 8–10 km top altitude during the brightest hours of the day and 15–25 km top altitude at nighttime. During the SCOOP campaign, the only hardware configuration difference with the description of McDermid et al. (2002) is the discontinued use of the chopper and the newer Licel system.
The Tunable Optical Profiler for Aerosol and oZone (TOPAZ) lidar is a compact differential absorption lidar for measurement of ozone concentrations and aerosol backscatter in the lower troposphere that was originally designed (2006) as a nadir-viewing airborne instrument for the NOAA Twin Otter aircraft (Alvarez et al., 2011). The airborne system was deployed in the 2006 TexAQS (Senff, 2010) and 2010 CalNex (Langford et al., 2012) campaigns before being converted for zenith-viewing ground-based operation from a medium box truck in 2012 with an external turning mirror for slant path measurements within the lowest levels of the boundary layer. The truck-based system has been deployed to several field campaigns, including the 2013 Las Vegas Ozone Study (Langford et al., 2015).
Like the LMOL system, the TOPAZ transmitter is built on a rapidly tunable
(285–310 nm), all-solid-state Ce:LiCAF laser pumped by a
frequency-quadrupled, diode-pumped Nd:YLF laser. The TOPAZ laser also
operates at high pulse repetition rates (1000 Hz) and low pulse energy
(average of 50
The NASA Goddard Space Flight Center TROPospheric OZone Differential Absorption Lidar (TROPOZ) was designed in 2013 and installed in a 13 m transportable trailer (Sullivan et al., 2014). It has been routinely taking measurements in the Baltimore–Washington, D.C. region since fall of 2013. Its configuration is similar to the JPL TMTOL lidar. A quadrupled Nd:YAG laser transmits 266 nm at 50 Hz into two 1.8 m long cells filled with deuterium and hydrogen to Raman-shift the 266 nm wavelength to 289 and 299 nm.
The receiver comprises a 45 cm diameter Newtonian telescope, four 2.5 cm refracting telescopes, a set of beam splitters, 289 and 299 nm interference filters, neutral density filters, and PMTs and allows all altitudes between 400 m above ground and 12 km to be covered. Signals from the PMTs are sampled at 50 ns intervals (7.5 m) by transient recorders operating in analog and photon-counting modes, and the data are typically recorded every 1 min.
Since its inception, TROPOZ has been deployed to several field campaigns, including NASA's 2014 DISCOVER-AQ campaign (Sullivan et al., 2016) and the international KORUS-AQ campaign (Korea–US Air Quality) in 2016 (Sullivan et al., 2017).
As mentioned earlier, the planning of the SCOOP campaign leveraged from a favorable field deployment calendar of two of the four mobile TOLNet lidars. In early August 2016, the GSFC-based TROPOZ lidar was in transit back from the KORUS-AQ campaign in South Korea, and the NOAA-Boulder-based TOPAZ lidar was in transit back from the CABOTS campaign in the California Central Valley (Langford et al., submitted, 2018). The other two mobile lidars, AMOLITE and LMOL, were brought from their respective home bases, i.e., Ontario, Canada, and Hampton, VA, respectively. All lidar systems were ready and operational for the official kickoff of the campaign on 11 August 2016 (UT). The campaign was expected to finish on 17 August (UT), but a local wildfire triggered a 1-day premature end to the campaign due to the mandatory evacuation of TMF. The SCOOP campaign therefore officially ended on 16 August 2016 at 23:00 UT.
In order to optimize the measurements' simultaneity and co-location, two mobile lidars (TOPAZ and TROPOZ) were deployed at the TMF core facility (2285 m a.s.l.) next to the JPL lidar building TM-21 (where TMTOL operates), and the other two mobile lidars (AMOLITE and LMOL) were deployed at the TM-2 Facility (2270 m a.s.l.), an annex to TMF located approximately 400 m east-southeast of TM-21. This deployment configuration allowed the LMOL and AMOLITE lidars to operate next to each other (distance of 20 m between the two systems) without cross-talk, and allowed LMOL to operate simultaneously with TOPAZ without cross-talk despite similar wavelengths. At the TM-21 location, the TOPAZ system operating at the highest frequency (1000 Hz) provided a master trigger to the TROPOZ (50 Hz) and TMTOL (30 Hz) systems, allowing full synchronization and simultaneous operations of the three systems without cross-talk. Although cross-talk was avoided, spurious electronic interference in the TROPOZ and TMTOL signals occasionally occurred, partly due to a defective grounding of a TOPAZ subsystem and partly due to the poor quality and extended length of trigger cables feeding TMTOL for the occasion. These complications caused the TOPAZ and TMTOL systems to miss a few hours of measurement and a couple of ozonesonde launches.
The operational schedule of the SCOOP campaign was designed to spread the
lidar measurements over all times of the day and night, over the course of
1 week. The AMOLITE lidar is automated and acquired measurements nearly
24 h a day, 7 days a week. The other four lidars followed a pre-defined
incremental measurement schedule, with more hours each day as the campaign
progressed:
10–11 August (UT): 2 h, early night; 11–12 August (UT): 6 h spread from midday to evening/early night; 12–13 August (UT): 8 h spread from late night/early morning to
midday; 13–14 August (UT): 12 h spread from midday to midnight; 14–15 August (UT): rest day; 15–16 August (UT): 18 h spread from late night/early morning to
evening/early night; 16–17 August (UT): 24 h spread from midday to midday next day (truncated
by evacuation).
The above schedule defined the minimum requirement of SCOOP coordinated
measurements. Most lidar instruments actually operated beyond the minimum
requirement, leading to several hundreds of accumulated hours. Table 3
summarizes the operating times of all lidars over the SCOOP campaign period.
Lidar data availability during SCOOP.
The JPL-TMF lidar group manages the operation of several balloon systems at TMF. In support of the SCOOP campaign, 17 electrochemical concentration cell (ECC) ozonesondes (Komhyr, 1969; Smit et al., 2007) were launched from the site between 10 and 17 August. Another ozonesonde was launched 3 days prior to the official start of the campaign as a pre-campaign test flight. The ozonesonde launch times were tailored to match the needs of the SCOOP campaign, with a number of launches ranging from a minimum of one launch per day on 10 and 11 August (UT) to a maximum of six launches (one launch every 2 h) on 15 and 16 August (UT). All the lidar measurements and launches planned on 17 August (UT) were canceled due to the mandatory site evacuation order. Figure 1 summarizes the complete campaign schedule, including ozonesonde launches (labeled “ECC”) and lidar operating times. In all upcoming figures, the ozonesonde data will be labeled “ECC”.
SCOOP campaign operation schedule for the five participating TOLNet lidars and 17 ECC ozonesonde launches. Grey-shaded areas denote nighttime.
Other in situ or remote-sensing instruments operated during the campaign. An automated surface ozone analyzer (ThermoFisher 49i) has been operating continuously at TMF since 2013. Several similar surface ozone instruments were also deployed as part of the TOLNet mobile lidars' added instrumentation. The surface ozone data are typically used to infer physically meaningful correlation relations between the values measured by lidar at their lowermost boundary (usually 200–600 m above ground) and the surface.
The JPL-TMF lidar group operates two other lidars at TMF for NDACC. The water vapor Raman lidar (Leblanc et al., 2012) was operated on three nights during SCOOP (10, 12, and 16 August, UT), and the stratospheric ozone lidar just resumed operations during SCOOP after a several-month break due to laser failure. No results from those lidars will be shown in this article, but it is expected that the measurements from these lidars will be used together with the SCOOP campaign results for upcoming science investigations.
The JPL Table Mountain Facility (34.38
An example of a 20 h long measurement run by the JPL lidar TMTOL is shown in Fig. 2. This ozone curtain plot, obtained on 14 August, is typical of what all five co-located lidars have been measuring day after day during the campaign (a 31-day-long streak by AMOLITE is shown at the end of this article). The lidar's maximum vertical range is limited to 8 km in the middle of the day (08:00 to 11:00 UT) but extends to 14–16 km at nighttime for the 10 min profiles shown here. Ozone measured by six ozonesondes launched on that day is superimposed in the form of colored rectangles. In most cases, they are barely noticeable because of the excellent quantitative agreement between lidar and ozonesonde. On this particular day, a clear layer of high ozone mixing ratio (80–90 ppbv) is observed between 4 and 7 km, reaching the ground in the evening. Figure 2 also highlights the high ozone temporal variability, observed, for example, between 00:00 and 06:00 UT on 15 August near 6–7 km a.s.l. (ozone increase from 40 to 80 ppbv). High geophysical variability cannot be ignored when comparing non-simultaneous measurements (e.g., Vogelmann et al., 2011), and particular care, not only on co-location but also simultaneity, must be taken.
Ozone time–altitude cross section obtained by the JPL TMTOL lidar on 14 August 2016 (time resolution: 10 min). Ozone measured by the six ozonesondes launched on that day is superimposed using thin, colored, slanted rectangles.
Hundreds of hours of lidar measurements were carried out during SCOOP. However, in order to minimize biases due to geophysical variability (see previous paragraph), only simultaneous profiles were critically compared. Therefore, the results presented hereafter focus on the lidar measurements made simultaneously with the first 30 min of each SCOOP ozonesonde flight (i.e., the tropospheric part of the flights). Furthermore, during the blind validation phase (“blind” refers to ozone profiles retrieved by the five lidar teams without prior knowledge of the ozonesonde and other lidars' profiles), all five TOLNet lidar groups were asked to produce ozone profiles with the same effective vertical resolution in order to minimize biases introduced by differing vertical smoothing applied to the raw lidar data. The 30 min averaged sonde-coincident lidar profiles with this prescribed SCOOP effective vertical resolution scheme will be referred to as “SCOOP Level 2” data throughout the rest of this work. The prescribed SCOOP effective vertical resolution scheme is altitude-dependent, linearly increasing from 200 m at altitude of 2.7 km a.s.l. to 1500 m at altitude of 8.1 km a.s.l, and then fixed to 1500 m above that. The vertical resolution scheme is shown in Fig. 3a. Quantitatively, this scheme was chosen to ensure that random noise in the ozone profiles from all five lidars remains small. It is conservative for the LMOL, AMOLITE, and TOPAZ lidars, which could have benefited from a higher vertical resolution, but it provides just enough smoothing for the TMTOL low-intensity channels to avoid the presence of excessive random noise. Vertical smoothing was also applied to the ozonesonde profiles to mimic the SCOOP effective vertical resolution scheme used for the lidars. By default, the ozonesonde raw data are produced at 1 s (approx. 5 m) intervals, but their effective vertical resolution is 100–120 m due to the sonde time response of about 20 s (WMO, 2014). To account for the difference between the lidar's typical vertical sampling resolution of a few meters and the 100–120 m vertical resolution of the sonde, the averaging kernels applied to the sonde profiles to mimic the lidar's effective resolution are slightly different from those applied to the raw lidar signals. What counts in the end is not the averaging kernels themselves but how these kernels translate in terms of effective resolution. The middle and right panels of Fig. 3 show a comparison of ozonesonde profiles at the raw vertical resolution and at the SCOOP vertical resolution. Differences of 20 ppb or more can be found for individual flights. When averaging profiles from all 17 SCOOP launches, the differences reach up to 5 ppbv (10 %) at 9 km and above (not shown). Working with the same effective vertical resolution for all lidars and all ozonesonde profiles therefore avoids the introduction of smoothing-induced differences of up to 5 ppbv, or 10 %, in the SCOOP Level 2 mean profile comparisons shown thereafter.
Top-left panel: ECC ozonesonde profiles measured during each of the 17 launches performed during the SCOOP campaign (launch numbers listed on the side). All other panels: ozone profiles measured by lidar during each available coincident sonde–lidar measurements. Coincidences (number and list) vary by instrument.
Ozonesonde and 30 min lidar coincidences used to obtain the SCOOP Level 2 data.
Because of the operational constraints of the lidars, not all instruments
were fully operational during each SCOOP ozonesonde flight. Furthermore,
mid-elevation clouds appeared during 4 of the 17 ozonesonde flights,
impacting differently the ozone retrievals of the various lidars. As a
result, the actual number of ozonesonde–lidar coincidences is not 17 for all
systems, and the list of launches used for the comparisons varies from one
pair of instruments to another. Table 4 summarizes the coincidences used,
instrument by instrument, to produce the SCOOP Level 2 data after
operational and weather constraints were taken into account. Figure 4
illustrates the sampling bias issues caused by the coincidence
heterogeneity. For each of the six panels (ozonesonde
SCOOP Level 2 data validation results are presented thereafter. As part of the overall TOLNet lidar validation efforts, both the measurements and the retrieval algorithms were actually validated. This twofold approach allows, in theory, the separation of biases due exclusively to the experimental conditions and those due exclusively to the data processing algorithms. The next section focuses on the algorithm aspects.
As part of producing the best-quality and most homogeneous ozone profile dataset possible, the TOLNet community has engaged in a large effort to standardize and validate all TOLNet in-house data processing algorithms. This process leveraged from similar work done within the NDACC lidar community a few years ago (Leblanc et al., 2016a, b) and led to the full implementation of several standardized features within the TOLNet algorithms today.
Mean AMOLITE
Each standardized feature of the algorithms was verified through a comprehensive algorithm validation exercise. The modus operandi of this exercise is as follows: (1) consider “known” atmospheric conditions (density, temperature, ozone, and other chemical species), (2) simulate raw lidar signals under these conditions by a specific TOLNet lidar (forward model), (3) analyze the simulated signals using the TOLNet lidar in-house data processing algorithm to be validated (inverse model), and (4) compare the ozone profile retrieved by the in-house data processing algorithm with the original ozone profile used to simulate the signals. If the retrieved and original profiles differ significantly, the source of the difference is investigated, corrections to the algorithm are made wherever necessary, and steps 3 and 4 above are repeated until both original and retrieved profiles match perfectly (except for very small differences due to numerical rounding errors). This approach is used to validate not only the retrieved ozone profiles but also other products output by the algorithms, for example, vertical resolution and uncertainty.
Example of algorithm validation result (see text for details).
An example of algorithm validation results, in the context of SCOOP, is
provided in Fig. 6. The left panel of this figure shows a comparison between
the original ozone profile used in the forward model (cyan curve) and the
profile retrieved by the AMOLITE in-house data processor (red curve). In
this example, the forward model used the atmospheric conditions (
Another example of algorithm validation result, this time testing
vertical resolution (see text for details).
As part of the TOLNet-wide algorithm validation efforts, simulation runs similar to the present example were performed for all TOLNet instruments, either before or after SCOOP (e.g., Sullivan et al., 2015). This comprehensive effort led to the full validation of the TOLNet in-house retrievals, and any ozone bias identified during SCOOP between sonde and lidar, or between lidar and lidar, should not be expected to originate from the data processing algorithms.
In addition to the retrieved ozone profiles, an essential algorithm feature to validate is effective vertical resolution. The standardized definition used by all TOLNet lidar groups is the NDACC-standardized definition prescribed in Leblanc et al. (2016a). Using this definition, the reported vertical resolution corresponds to the FWHM of the response to a finite impulse, namely, a delta function for smoothing filters and a Heaviside step function for derivative filters. In DIAL retrievals, vertical smoothing can be applied either to the raw lidar signals or to the retrieved ozone profiles, or to both, by using either smoothing filters or derivative filters – hence the importance of using a standardized definition that is representative of a specific effective resolution. A validation example is provided in Fig. 7. The left panel shows the original simulated ozone profile used in the forward model (cyan curve), and the AMOLITE in-house-retrieved and GLASS-retrieved ozone profiles (red and blue curve, respectively). The simulated ozone profile is the same as in Fig. 6; i.e., it is taken from the SCOOP launch tm073 on 10 August 2016. Both in-house- and GLASS-retrieved profiles are smoother than the original profile as they were both processed using the same SCOOP effective vertical resolution scheme introduced in Sect. 3.5. The excellent agreement between the two retrieved profiles confirms that the AMOLITE in-house data processor applies the correct amount of smoothing, i.e., that it uses the correct definition of effective vertical resolution. The middle and right panels are similar to the left panel but for LMOL and TROPOZ. They are additional examples illustrating that the other TOLNet data processing algorithms were checked for computing a consistent effective vertical resolution.
NDACC-standardized ozone uncertainty budget for four of the five TOLNet lidars participating in SCOOP, including one random component (black: detection noise) and five systematic components (pink: ozone absorption cross sections; green: Rayleigh cross-sections; blue: background noise correction; brown: air density; yellow: saturation correction). Solid curves denote ozone uncertainty (%) computed by the in-house data processing algorithms, while dash curves denote the ozone uncertainty computed by the GLASS (reference transfer).
The next major aspect of the TOLNet algorithms that was standardized and validated is the uncertainty budget. The AMOLITE, LMOL, TMTOL, and TROPOZ data processing algorithms were checked to ensure that their uncertainty budget followed the NDACC recommendations on uncertainty provided in Leblanc et al. (2016b). No such check occurred for TOPAZ as no uncertainty estimates were provided with their SCOOP Level 2 data. Figure 8 shows an example of the detailed uncertainty budget computed by the AMOLITE (top left), LMOL (top right), TMTOL (bottom left), and TROPOZ (bottom right) in-house algorithms (solid curves) compared to their equivalent computed by the GLASS (thick dash curves, similar hues). The uncertainty budget computed by the GLASS follows the NDACC recommendations and can be used once again as a reference transfer. The random component of total uncertainty comes essentially from detection noise (Poisson statistics). This term is represented in black/grey in Fig. 8. The ozone total systematic uncertainty component is a combination of propagated ozone absorption cross-section differential uncertainty (pink/purple), signal (PMT) saturation correction uncertainty (yellow/orange), background noise (skylight) correction uncertainty (blue/cyan), Rayleigh scattering cross-section uncertainty (green), and air density uncertainty (brown). Aerosol extinction and backscatter uncertainty is not included in the present uncertainty budget, partly because its quantitative estimation is difficult and no standardized recommendation exists, and partly because the SCOOP campaign took place at Table Mountain Facility, a high-elevation site, i.e., mostly above the boundary layer, with reduced impact from aerosols considering the wavelength differentials considered (Trick et al., 2015). The ozone total uncertainty is the quadratic sum of all uncertainty components shown in Fig. 8. In this figure, the effect of transitioning between channels (ranges) of different intensity (near field to far field, low intensity to high intensity, analog to photon counting, etc.) is manifested by sharp or step-like vertical gradients of uncertainty.
One-on-one ozone profile intercomparison between ECC ozonesonde
(cyan curves) and lidar (from top to bottom: AMOLITE in red, LMOL in green,
TMTOL in blue, TOPAZ in purple, and TROPOZ in yellow). In the left panels,
the thin dotted lines represent the ozone profiles
When comparing the solid and dash curves of similar hue in Fig. 8, it is clear that all four in-house data processing algorithms (solid curves) follow closely the GLASS computation (dash curves). Note that for TMTOL the in-house and GLASS computations are identical, so the solid and dash curves overlap perfectly. There are only two cases of disagreement, both of which can easily be explained. One case is the saturation correction uncertainty (yellow) for AMOLITE near 5 km and TROPOZ near 6 km. The discrepancy is simply due to the fact that the GLASS algorithm does not combine the low- and high-intensity channels in the same way the AMOLITE and TROPOZ in-house algorithms do. The other case of disagreement is for random uncertainty (black/grey curves) below 5 km for AMOLITE and below 4 km for TROPOZ. This is due to the fact that the GLASS does not compute random uncertainty for analog channels the same way the AMOLITE and TROPOZ in-house data processors do. This result calls for further work needed on possible recommendations to standardize this particular aspect of the data processing, not only for random uncertainty but for all components of uncertainty for analog signals.
Figure 8 also provides important insights on the relative magnitude of each uncertainty component contributing to the total uncertainty, as a function of altitude, and depending on the instrument considered. For example, the ozone uncertainty owing to the absorption cross-section differential uncertainty (pink/purple curves) has a consistent behavior across all instruments, with nearly constant values of 2 % (AMOLITE, TMTOL, and TROPOZ) and 4 % (LMOL) throughout the entire profile. As part of the algorithm standardization process, a common set of temperature- and wavelength-dependent ozone absorption cross sections, and their uncertainty, was used. This dataset originates from the works of Daumont et al. (1992) and Malicet et al. (1995) for the absorption cross section values, and from Weber et al. (2016) for their uncertainty. The original dataset is interpolated every 0.01 nm between 260 nm and 320 nm, and every 0.1 K from 160 to 330 K, and then written in a unique lookup table file to be read by the TOLNet data processing algorithms, leading to typical uncertainties of 2 %–4 %, depending on temperature considered (e.g., Weber et al., 2016; Viallon et al., 2015).
Similarly to absorption cross-section differential uncertainty, the ozone uncertainty components owing to molecular extinction correction uncertainty (green and brown curves) exhibit a consistent altitude dependence and magnitude for all instruments. This is explained by the consistent use by all TOLNet lidar data processing algorithms of the same source of ancillary temperature and density profiles (and their uncertainty) during SCOOP. In the case of the SCOOP Level 2 data, the temperature and pressure measurements from the InterMet PTU radiosondes coupled with the ozonesondes were used.
Mean ozone difference (%) between one instrument (referenced on top of each panel) and all the others, computed using all available one-on-one instrument coincidences. Colored curves: one-on-one differences. Black thick curves: mean of all colored curves.
On the other hand, no obvious consistency is observed for the remaining ozone uncertainty components, namely the components owing to detection noise (black/grey curves), saturation correction (yellow/orange), and background noise correction (blue/cyan). These components are indeed instrument-dependent and show large differences, both in magnitude and shape. The different instrument characteristics and the different range combination options show that there is not one simple characterization of uncertainty for the TOLNet ozone lidars, even though they all use a consistent uncertainty budget approach.
The purpose of the data processing algorithm validation described above is to identify and/or characterize sources of bias that are due not to the measurements or instrument conditions but, instead, to the data processing algorithms. Through a few selected examples, it was shown that the in-house TOLNet data processing algorithms participating in SCOOP were validated. Any deviation observed during SCOOP between sonde and lidar, or between two lidars, that exceeds the differences observed at the conclusion of these algorithm validation efforts (typically 1 %) should therefore be interpreted as owing to the experimental conditions rather than the algorithms.
Despite the large efforts to standardize and validate the TOLNet data processing algorithms, there are still a few features that were not, or cannot be, standardized. Among them are the process of combining various intensity channels, the process of combining analog and photon-counting channels, and the method with which to correct or remove the influence of aerosol and clouds. In particular, the method of combining various intensity channels to form a single profile depends strongly on the experimental configuration (i.e., how many channels are available, what are their wavelengths, and what are their intensities). In the next section, it will be shown that such experimental aspects actually can explain a large fraction of the differences observed between the various lidar measurements and their uncertainty during the SCOOP campaign.
Same as Fig. 10 (top-left panel) but considering only nighttime
measurements
One-on-one instrument intercomparison profiles are given in Fig. 9 for all
five lidar instruments with respect to the ozonesondes. The left panels show the
mean ozone profiles computed using all available one-on-one coincidences
between ozonesonde (cyan curves) and lidar (from top to bottom: AMOLITE in
red, LMOL in green, TMTOL in blue, TOPAZ in purple, and TROPOZ in yellow).
For each instrument, the thin dotted lines denote the ozone profiles
In order to identify possible biases owing to individual instruments, each
lidar instrument was compared against all the others. The results are shown
in Fig. 10. Each panel corresponds to a particular instrument, referenced at
the top of each panel. The colored curves represent the mean ozone
differences (in percent) between the reference instrument and another
instrument, computed using all available one-on-one coincidences for this
particular pair of instruments. In each panel, the thick black curve
represents the mean of all colored curves. For a particular reference
instrument, if the black curve displays outstanding features similar in
shape and magnitude to features displayed by several colored curves, then
it is likely that these features are due to the reference instrument. For
example, the positive difference of 10 %–15 % and 8 %–9 % observed at around
10.5 and 5 km altitude, respectively, in the TMTOL panel (bottom row,
middle panel) points to a likely positive bias owing to TMTOL. Several
other small biases can likewise be identified, most noticeably a
Finally, the good performance of the tunable laser instruments (LMOL and TOPAZ) with respect to the other lidar instruments is noteworthy. However, it is not clear what actually balances the lower power of the tunable lasers. Likely candidates are the overall transmission of the receivers (including optical and electronic/quantum efficiencies), the choice of the spectral filters, a higher laser repetition rate, and possibly the shorter wavelengths used, although for the latter a quick calculation of ozone absorption and atmospheric extinction differentials yields little difference with the YAG-based systems.
Figure 11 is similar to the top-left panel of Fig. 10 (ref
However, no major mean bias stands out for either plot, showing that both daytime and nighttime profiles remain within the 7 %–8 % total combined uncertainty shown in the earlier figures.
31-day ozone time–altitude cross section obtained at TMF by the AMOLITE lidar during – and immediately after – the SCOOP campaign.
The presence of five TOLNet lidars operating in identical conditions, and using common data processing options, allowed for an objective assessment of their performance as a function of altitude range and time of the day, as well as an objective comparison of their reported uncertainties.
Figure 12 shows two selected 30 min ozone profiles (left panels) measured simultaneously by all five lidars in dark conditions (top) and in the brightest possible conditions (bottom), as well as their corresponding reported uncertainty expressed in parts per billion (middle panels) and percent (right panels). In the middle and right panels, the dotted curves denote the random component, the dash curves denote the systematic component, and the solid curves denote the total uncertainty (computed as the quadratic sum of random and systematic components). The dotted curves in Fig. 12 therefore correspond to the black/grey curves shown in Fig. 8, and the dash curves in Fig. 12 represent the quadratic sum of all the systematic components displayed in Fig. 8. Showing the ozone profiles (left panels) allows distinguishing between uncertainty changes associated with ozone changes and uncertainty changes inherent to the measurement technique itself (i.e., independent of the ozone content at a precise time and location). For example, the localized uncertainty peak for TMTOL at 5.5 km altitude (top-right panel, green curve) is essentially due to the dip in ozone mixing ratio (top-left panel) rather than a change in the uncertainty (top-middle panel, green curve, shows a nearly constant absolute systematic uncertainty).
The most striking feature in Fig. 12 is the difference in magnitude and shape between the uncertainty estimates computed for the various lidars. At nighttime (top row), a similar dependence on altitude holds for most lidars, specifically, a nearly constant total uncertainty of 1–4 ppbv (2 %–6 %) from the lowest data point up to about 9 km and then an increase to about 5–10 ppbv (10 %–15 %) at 12 km. The exception is TMTOL, with a total uncertainty of 5 ppbv (7 %) below 5 km, followed by a decrease to 2 ppbv (3 %) near 6–7 km, a wide peak at 6 ppbv (15 %) near 8 km, and finally a decrease to 4 ppbv (8 %) at 11 km, before increasing again like the other lidars. This difference between TMTOL and the other lidars can be explained by the use of three intensity ranges of very different characteristics: below 5 km, the TMTOL low-intensity channels were unusually weak during SCOOP and therefore yielded higher random uncertainty. The peak at 8 km comes from using a pair of very high intensity channels, therefore leading to a higher estimate of saturation correction uncertainty (blue dash curve). The estimation of this uncertainty component depends on the photon counter's dead time (provided by the manufacturer) and on the trueness of the correction equation. It is often overestimated for the sake of choosing a conservative side.
This high-intensity pair is used for the purpose of extending the ozone profile well beyond the tropopause (typically 25 km) as part of the TMTOL's mandate to produce lower stratospheric ozone profiles for NDACC. On the night of 16 August (UT), as well as several other SCOOP nights, TMTOL encountered alignment and low signal-to-noise ratio issues on the low-intensity channels, which forced the transition from low-intensity to high-intensity channels at an unusually low altitude (i.e., 7–8 km instead of the usual 12–14 km used routinely between 1999 and 2015). This uncertainty peak of 15 % at 8 km is therefore not representative of TMTOL in normal conditions. Indeed, a few months after the SCOOP campaign, several aging optics in the TMTOL transmitter and receiver were replaced, and the signal-to-noise ratio was significantly improved.
The random uncertainty in the 3–12 km altitude range has since remained within the 7 %–8 % range when using an effective vertical resolution and integration times similar to those of the present SCOOP Level 2 data. Finally, a brief, but sharp, increase of uncertainty is also observed for LMOL at 5–6 km (green curve), and to a lesser extent for TROPOZ at 4.5 km (pink curve). For TROPOZ, the increase is once again explained by the transition between the low-intensity range (analog channels) and the high-intensity range (photon-counting channels), while for LMOL it is mainly due to the ozone sudden decrease at 5.5 km (as discussed earlier).
In the bright conditions of midday (Fig. 12, bottom row), the altitude
dependence of uncertainty is similar for all lidars, once again with the
exception of TMTOL. Not surprisingly, uncertainty increases quickly for all
lidars from the 1–4 ppbv (2 %–6 %) values already noted at nighttime
to 10 ppbv (15 %) at around 9–10 km altitude and
The blind phase of the TOLNet lidar validation efforts during the SCOOP campaign, together with a thorough TOLNet data processing algorithm validation exercise, represented key steps of the TOLNet lidar quality assessment and quality control (QA/QC) process. For the AMOLITE, LMOL, and TMTOL lidars, these measurement and retrieval validation efforts led to the production of optimized ozone profiles, referred to as “SCOOP Level 3” data. With this data version, the ozone profiles' effective vertical resolution scheme is optimized and depends on the lidar considered (yet using the same NDACC-standardized definition). For the TOPAZ and TROPOZ lidars, the in-house algorithm had been validated prior to SCOOP, and the vertical resolution scheme used for the SCOOP Level 2 data was suitable enough to be kept as is. Therefore no data version change from Level 2 to Level 3 was therefore necessary.
Figure 13, top row, shows the mean differences (left panel: in ppbv; middle
panel: in percent) between the SCOOP Level 3 ozone lidar profiles and the
ozonesonde profiles for all available one-on-one lidar–sonde coincidences
(Level 2 data are shown for TROPOZ and TOPAZ). The right panel shows the
number of coincidence pairs used for each instrument as a function of
altitude. The lidar–ozonesonde differences remain within
Summary of mean biases found during SCOOP between a single instrument and all the other ones, and summary of key statistics characterizing the lidar instruments' capability.
The bottom row of Fig. 13 shows the mean of systematic (left panel) and random (middle panel) uncertainties associated with the coincidence pairs used to plot the ozone differences showed in the top row, as well as the reported effective vertical resolution (right panel). Table 5 summarizes the bias, precision, and accuracy estimates of all the instruments, taken either separately or as a whole. The six panels of Fig. 13 altogether conclude the SCOOP validation efforts and summarize well the overall quality of the five TOLNet lidars that participated in the campaign. They provide, together with Table 5 and Fig. 10 (top-left panel), an excellent QA/QC review for the AMOLITE, LMOL, TMTOL, TOPAZ, and TROPOZ lidar data, which can be used as a reference in future process studies and satellite validation efforts using these data.
Despite stringent air quality regulations put in place decades ago in many countries around the world, free-tropospheric ozone increase has continued to increase in certain regions, including the western United States. This increase contributed to the decision to expand tropospheric ozone observation capabilities in North America through the establishment of the TOLNet lidar network. In August 2016, five of the six TOLNet lidars (namely, AMOLITE, LMOL, TMTOL, TOPAZ, and TROPOZ) participated in the SCOOP intercomparison and validation campaign at the JPL Table Mountain Facility in California. After significant efforts validating the TOLNet data processing algorithms, the SCOOP campaign provided an unprecedented opportunity to validate the simultaneous measurements of five co-located tropospheric ozone lidars.
Approximately 400 h of lidar measurements were made, and 17 ozonesondes were launched over the 1-week-long campaign, allowing for a thorough validation of the lidars. Over the range of 3–10 km a.s.l., the mean difference between lidar and ozonesonde was found to be 0.7 ppbv (1.7 %), with rms deviation of 1.6 ppbv, or 2.4 %, which is well within the combined reported uncertainties of lidar and sonde (Table 5). When compared to previous intercomparison campaigns, these estimates are fully consistent with the 1.2 %–4 % differences found by Wang et al. (2017) and 2 % lidar–sonde differences found by Papayannis et al. (2005), and they are smaller than the 10 %–20 % estimates reported in Kuang et al. (2011). The rare and minor differences identified here were typically associated with the known limitations of the lidars at the profiles boundaries, for example, errors associated with incomplete beam–telescope overlap and signal saturation at the bottom of the profiles (below 3–4 km a.s.l.), and random noise at the top of the profiles (above 10 km a.s.l.). Geophysical variability, and the fact that the ozonesonde is no longer co-located with the lidars higher up, is also believed to contribute to some of the differences observed in the upper troposphere. Together with the measurements, many aspects of the data processing algorithms – such as ozone absorption cross sections, the definition of effective vertical resolution, and the uncertainty budget – were standardized and validated. This thorough validation of both the measurements and retrievals gives high confidence in the quality and reliability of the TOLNet ozone lidar profiles.
After several years of instrumental development and optimization, the SCOOP campaign represents a turning point in the lifecycle of TOLNet. Upon their deployment in Southern California in August 2016, the participating TOLNet lidars had reached a mature stage of technical development. The 1-week-long SCOOP campaign represented the most comprehensive and rigorous TOLNet ozone lidar intercomparison yet. In particular, its focus on algorithm testing and homogenization ensures that TOLNet ozone lidar network data will be of the highest quality for years to come. The results of this campaign demonstrate the excellent accuracy of the tropospheric ozone lidar technique, which is expected to be used more intensively in the decades to come for high-vertical-resolution profiling of tropospheric ozone. In this respect, TOLNet has the potential to become the first continental-scale high-quality ozone lidar network that could be operated over an extended period of time.
As part of its technical expertise development, TOLNet is now striving to provide more automated, autonomous field measurements. Figure 14 shows a 31-day ozone time–altitude cross section obtained at TMF by the AMOLITE lidar during, and immediately after the SCOOP campaign. It illustrates nicely the full capability of an autonomous and automated tropospheric ozone lidar. Today, several other TOLNet lidars (e.g., TMTOL) are testing/implementing this new mode of operation. As technology improves and becomes more reliable and affordable, it is expected that most TOLNet instruments will converge towards autonomous operations. This mode of operation opens the door to advanced process studies (e.g., extended ozone diurnal variability studies) and will likely lead to the production of extensive ground-based reference datasets for process studies, as well as model and satellite validation. One example is the validation of the TROPOMI instrument on board the European satellite Sentinel 5P. For a given location, this instrument measures ozone at the same local time (13:00 LT) every day. In 2017, the TMTOL lidar was upgraded to operate autonomously, upon demand. It was programmed to run automatically for 1 h every day at approximately 13:00 LT, and it has since acquired more than 150 correlative profiles for the validation of TROPOMI. Another application is the validation of the future NASA instrument TEMPO to be launched to a geostationary orbit in 2020/2021. For a given location in North America, this instrument will measure tropospheric ozone during daytime at 1 h intervals with high horizontal resolution. The TMTOL lidar, and likely several other TOLNet lidars, will be programmed to measure for a few minutes every 1 h during daytime, 7 days a week, which will provide a maximum number of correlative measurements with TEMPO yet minimize instrumental wear-out.
In addition to automated measurements, TOLNet is working towards extending the lidars' measurement range downward to about 100 m above ground. The TOPAZ system can already measure ozone at even lower range (25 m above ground) thanks to their scanning transmitter mirror, and assuming homogeneous ozone field in the vicinity of the instrument deployment site. Other TOLNet groups (e.g., TMTOL, LMOL) just started to provide valid measurements down to 100 m above ground (Chouza et al., 2018; Farris et al., 2018). Finally, additional coordinated efforts within TOLNet are planned to provide improved ozone retrievals including an aerosol correction. Several groups (e.g., TOPAZ) have previously implemented an optional correction, and future efforts within TOLNet will concentrate on the possible homogenization of such a correction across the network.
Questions pertaining to the methods and approaches used to perform the comparison and validation results presented here should be directed to the first author at thierry.leblanc@jpl.nasa.gov.
All ozonesonde and ozone lidar profiles shown here, and obtained during
SCOOP, are publicly available at the TOLNet website
The authors declare that they have no conflict of interest.
The work described here was in part carried out at the Jet Propulsion Laboratory, California Institute of Technology, under agreements with the National Aeronautics and Space Administration. The Tropospheric Ozone Lidar Network and the SCOOP campaign acknowledge funding from the Tropospheric Chemistry Program of the NASA Earth Science and Division. The NOAA/ESRL lidar operations were also supported by the NOAA Climate Program Office, Atmospheric Chemistry, Carbon Cycle, and Climate (AC4) Program. The views, opinions, and findings contained in this report are those of the author(s) and should not be construed as an official National Oceanic and Atmospheric Administration or U.S. Government position, policy, or decision. AMOLITE's participation was supported by the Environment and Climate Change Canada's Climate Change and Air Quality Program (CCAP) and the Joint Oil Sands Monitoring program (JOSM). Edited by: Ulla Wandinger Reviewed by: two anonymous referees