the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Retrieval of tropospheric aerosol, NO2, and HCHO vertical profiles from MAX-DOAS observations over Thessaloniki, Greece: intercomparison and validation of two inversion algorithms
Martina Michaela Friedrich
Steffen Beirle
Alkiviadis Bais
François Hendrick
Kalliopi Artemis Voudouri
Ilias Fountoulakis
Angelos Karanikolas
Paraskevi Tzoumaka
Michel Van Roozendael
Dimitris Balis
Thomas Wagner
Download
- Final revised paper (published on 11 Mar 2022)
- Preprint (discussion started on 31 Aug 2021)
Interactive discussion
Status: closed
-
RC1: 'RC1: Comment on amt-2021-201', Anonymous Referee #1, 18 Oct 2021
General comments
Karagkiozidis et al. present a comprehensive comparison and validation study of two MAX-DOAS profiling algorithms. The algorithms retrieve trace gas and aerosol profiles from MAX-DOAS observations over Thessaloniki, Greece.
The manuscript is well written, the analyses have been performed thoroughly and the conclusions are interesting.However, while reading this document, I was wondering, what is the aim of this study? From the title, I expected a characterization of the temporal and spatial distribution of NO2, HCHO and aerosols over Thessaloniki. But the authors focused mainly on the comparison and validation of two profiling algorithms. Algorithms which have already been validated in other studies! In my viewpoint, the authors should change the manuscript slightly in order to go more in the direction of either a pure algorithm validation/verification paper or a characterization paper of Thessaloniki's trace gas/aerosol distribution.
If the authors decide for case 1, I would expect a detailed comparison of vertical profiles. If validation is not possible due to sparse measurements of ancillary instruments, please add a comparison of temporal/spatial mean profiles of both algorithms. I was also wondering if MAPA retrieves concentrations in higher altitudes compared to MMF? On the other hand, MMF does not retrieve small VCD's even though the correlation with in situ data is high. Does the a priori SH of 1km leads to this constrain? If the manuscript is modified based on these suggestions, please change the title accordingly.
In case the authors decide for a characterization paper of the tropospheric composition over Thessaloniki, I would expect a discussion of weekday to weekend variations. I would also expect diurnal variation plots. Furthermore, in this case, the analysis of HCHO is insufficient. Even
though validation is not possible we learn nothing about the spatial distribution of HCHO from your study. You neither show HCHO profiles nor do you talk about possible sources (for all species).
In both cases, I would love to see some contour plots of seasonal mean profiles for all species.Please also add the following points:
1. Even though the applied flags have been applied elsewhere, please add a table of flags for each algorithm in the appendix. I guess that
flagging thresholds might differ for UV and vis?
2. What is the conclusion of your flagging scheme discussion? I would consider your results as unclear. Maybe there is no clear conclusion to be made?
3. Please add a short discussion of NO2 retrieved in the UV. You have mentioned that HCHO and aerosols in the UV might be negatively affected by increased spectral noise. Is there a similar conclusion for UV NO2?
4. Please add a short discussion of possible issues of your aerosol retrieval due to the inaccurate Henyey-Greenstein phase function at the proper sections in your manuscript.
5. If I understand the authors correctly, the instrument measures in an altitude of 80m. How is this "elevated" position treated by the algorithms? What is the meaning of the lowermost retrieval grid point in this context?
Specific commentsP2, L43: "can lead to or" ) can lead to ... or deteriorate ...
P3, L81 - L84: You mention that the data is also analyzed regularly within the FRM4DOAS project. Please name the specific differences in retrieval settings between your study and the regularly submitted data and the reason for specific changes of settings. It would also be interesting to compare FRM4DOAS data with your new settings.
Fig. 2: Please add other instruments if not measured at the same location (e.g. in situ).
P10, L211: "by assuming a correlation length" ) "by assuming a Gaussian function with correlation length of...". Note that a correlation length of 50m was used in the cited publication!
P10, L224: What is the lowermost retrieval altitude for each algorithm? Surface values were extrapolated?
P12, L285: Why did you use hourly mean values? You could also average all in situ values for the corresponding MAX-DOAS elevation scan cycles.
P13, L288 - L292: I don't understand your reasoning here. I guess that tracffic emissions contribute strongly to the MAX-DOAS signal but then an in situ site should not be a background site. How far away is the next site in viewing direction of the telescope?
P13, L304: 5° is already quite small, especially when using Henyey-Greenstein. Have you tried different values? I would expect that 10° improves data quality significantly but might decrease the number of data points (maybe too much?).
P13, L308-L309: I am wondering how negative columns can make it through any flagging step? Also 8.5% is a really large fraction of invalid profiles. Is there any reason known why MAPA produces so many unrealistic profiles?
P14, Table 3: When looking at the HCHO fraction (also aerosols in UV) of valid profiles for MAPA, I am really worried about the general performance of MAPA in the UV. Is there any particular reason for this bad performance? There was already a BIAS found for MAPA's
HCHO results in Tirpitz et al. 2021 so I don't think that noisy data can explain everything!
P15, Figure 5: For reach row, MAPA shows values close to zero, except for NO2. I am not sure if it is a good thing, that MMF doesn't show small values at all or that MAPA cannot find them only for NO2. Could you please say something about that? And again, I would be interested in MAPAS flagging thresholds and if they differ in the visible and UV spectral range.
P15, Figure 6: I think this figure tells us that MMF has a positiv Bias for low elevation angles (reddish dots more often over black line) which would also explain why we don't see small values in Fig. 5 for MMF. It seems that the algorithm has problems in retrieving accurate profiles
for small dSCD, especially in the UV. This could be explained by more noise but the MAPA results seem to be unaffected. Do you have any explanation for the different LOS depending performance of both algorithms?
P18, L382 - L384: Concentrations for the lowermost layer rather than conc. at ground? Do you mean the lowermost layer with concentrations larger than zero? If not, please explain!
P18, Figure 7: Again, MMF doesn't show HCHO values close to zero which means that the main HCHO concentration is found in higher altitudes. MAPA seems to retrieve HCHO closer to the surface. However, P18, L382 - L384 tells us that this conclusion might be wrong. So
I am wondering if you could show a similar figure with surface concentrations only? I have to admit that I am confused by the sentence P18, L382 - L384 and the fact that MAPA finds HCHO concentrations close to zero!
P21, L439 - L440: I am not sure if I understand scheme #3 correctly. In this line, you write about warning flags while you use "erroneous" in Table 4. Please describe this scheme more detailed.
P24, L493 - L494: "Aerosol layers between 2 and 4 km are "invisible"...". This is not correct! An elevated layer will for sure be identified as elevated layer in these altitude regions if aerosols below are negligible. MAX-DOAS might not find the correct altitude but the elevated layer
will be identified for sure showing a small but existing sensitivity.
Figure 12: It is hard to say which profile is the best, especially for the 21. of July. Could you please add a subplot showing the modelled and measured dSCDs at each elevation angle for all scenarios and both algorithms? Maybe this helps to assess better the performance here.
Figure A3: As you have mentioned, the error bars for the scaling factors are larger in winter than in summer.I was wondering if the number of data points in winter is large enough to show a mean daily variation for January (and compare with a similar curve from August)? Do these
curves show a clear diurnal cycle?References
Tirpitz, Jan-Lukas, Udo Frie, Francois Hendrick, Carlos Alberti, Marc Allaart, Arnoud Apit-
uley, Alkis Bais, u.a. "Intercomparison of MAX-DOAS Vertical Pro le Retrieval Algorithms:
Studies on Field Data from the CINDI-2 Campaign". Atmospheric Measurement Techniques
14, Nr. 1 (4. Januar 2021): 1{35. https://doi.org/10/ghx39m.Citation: https://doi.org/10.5194/amt-2021-201-RC1 -
AC1: 'Reply on RC1', Dimitrios Karagkiozidis, 16 Dec 2021
The comment was uploaded in the form of a supplement: https://amt.copernicus.org/preprints/amt-2021-201/amt-2021-201-AC1-supplement.pdf
-
AC1: 'Reply on RC1', Dimitrios Karagkiozidis, 16 Dec 2021
-
RC2: 'review of "Retrieval of tropospheric aerosol, NO2 and HCHO vertical profiles from MAX-DOAS observations over Thessaloniki, Greece” by Dimitris Karagkiozidis et al.', Anonymous Referee #2, 22 Oct 2021
The paper "Retrieval of tropospheric aerosol, NO2 and HCHO vertical profiles from MAX-DOAS observations over Thessaloniki, Greece” by Dimitris Karagkiozidis et al., presents results of 2 MAXDOAS profiling retrievals (MMF and MAPA) for 1 year of observation (May 2020 to May 2021) in Thessaloniki. The 2 approaches are presented, with investigations of the impact of different filtering selections, and are compared to available ancillary measurements (AOD from Brewer and CIMEL, aerosols extinction profiles from a few lidar measurements and surface NO2 from in-situ data).
The paper is well written and easy to follow, and its scientific content fits the scope of AMT.
The title is however a bit misleading: we expect to learn about profiles in Thessaloniki, but NO2 and HCHO profiles are never shown in any of the figures! The paper is more about a comparison of the 2 approaches, mostly focusing on VCD and surface concentration, and comparisons to external data, when available (which is not the case for HCHO). The outcome of the study is also a bit confusing, specifying for each case the best regression statistics, but not how to deal with these data if they want to be used. Should an average of both profiling techniques should be recommended? Should we only rely on VCD and surface concentration? Should we use only one of them (eg MMF that provides AVK), but then use the bias to MAPA to estimate a (more) realistic uncertainty? Are the profiles of the 2 algorithm within their estimated uncertainties? (uncertainties of each approach are never mentioned).
It would be good that the authors provide some suggestions in the conclusions.I would thus recommend some revision of the title and text, with some further geophysical (instead of only statistical) investigation, as described below.
I would also suggest some reordering of Section 3. The results are now presented first for VCD (3.1), then dSCD (3.2), then surface concentration (3.3) and then AVK (3.4). It would make more sense to me to follow the retrieval order: from dSCD, to profiles and AVK, and then VCD and surface extracted from the profiles. Or focusing first on the output products (VCD and surface concentration), and then some diagnostic elements (dSCD and AVK).
specific comments:
-------------------The study would allow to present many geophysically results, instead of only showing coherence of 2 (both are possible, see eg. Vlemmix et al., 2015). E.g. answering the following questions:
- how are the profiles themselves (is e.g. the H75 characteristic height (see eg Vlemmix et al., 2015) of NO2 lower or higher than the HCHO and aerosols one? how is it changing over the day and the seasons?)
- how is the variability within the different measured azimuths (is there an heterogeneous situation, as shown e.g. for Athens in Gratsea et al 2016? is it stronger for NO2 than for HCHO, as we would expect?).Also, to my point of view, the paper is missing the opportunity to make the link with the previously created datasets from this instrument. It would be nice to know how much these profiling results are coherent with approaches used in the past for the VCD estimation (Drosoglou et al., 2017 and 2018, QA4ECV dataset used in Pinardi et al., 2020; Verhoelst et al, 2021; De Smedt et al. 2021). Are results similar or very different in term of VCD? E.g., see comment for P 14, line 338, or for P. 20, line 412.
There is also a lack of reference to literature when presenting the specific results of this study and stating some "realities". (e.g., page 24, line 485 "Since the MAX-DOAS profile retrievals in the UV are sensitive only at altitudes closer to the ground*, where the lidar system is not, the profiles for 360 nm are excluded from the analysis") - *: how can we confirm this sentence? )
It would be good to also show the coherence of the lidar comparisons (Figure 12) with the AOD from Brewer and AERONET. Is the vertically integrated extinction profile coherent with the AOD? (see comment for Figure 12)
Technical comments and corrections:
------------------------------------ Figure 2: please also specify other instruments location.
- Section 2.3 (or 2.6): are the 2 retrievals treating cloud filtering in the same way? are they both starting from a reduced set of cloud filtered dSCD, or is this done within the MMF and MAPA algorithms?
- page 10, line 212: "the progress of the convergence is faster when using an a priori VCD or AOD below the true value" - why is this?
- Section 2.7: specify the location of the ancillary data - how far are they from the MAXDOAS? and mention the impact of the different fields of views.
- P. 12, line 259: just to have an idea, how many lidar measurements this schedule would represent in the interested time period (May 2020 to May 2021)?
- Section 3: the results are presented separately for the different viewing azimuths (with no clear major difference or explation of difference between MMF and MAPA relative to the azimuth), while in Sect. 4, where the results are "validated", this information is now missing. What is used here? only one of the azimuths or an average of both or a mix of them, depending on the time of the day?
- P. 13, line 305: "the elevation sequences, for which the retrieved AOD from the MAX-DOAS inversion algorithms is greater than 1.5 are filtered-out, since such high aerosol loads are unrealistic for Thessaloniki" - is this a big proportion of data? can this be impacted by clouds, or have these been filtered before?
- P. 13, line 307: "Negative columns can occur in the trace gas retrievals of MAPA within the Monte Carlo ensemble and they are intentionally not removed" - add "at first/by default/..." - is this 8.5% of negative HCHO VCD points already included in the 18% valid MAPA flagged data of Table 3, or to be additionally removed ?
- Table 3: add a third column with the remaining valid data percentage when both algorithms have coincident valid flags (filter #4, used as default in most of this section, if I understood well).
- P. 13, line 317: "an elevation sequence is considered valid as long as it is flagged as valid by both MMF and MAPA. This is the default flagging scheme for NO2, HCHO and AOD at 477 nm" --> this would mean flagging scheme #4 of Table 4, right?
- P. 14, line 324: you mention the Orthogonal Distance Regression (ODR or bivariate least-squares) instead of an Ordinary Linear Regression (OLR or standard least-squares), but in figures 5, 7, 11 you mention linear regression. Please adapt with the correct regression type.
- P 14, line 338 "This is the first time during the Phaethon’s operation that the whole elevation sequence is being used in order to derive the tropospheric VCDs more accurately": comment coherence of VCD results obtained here with respect to approaches used in past datasets (see comment above).
- Figure 5: it is difficult to understand from this figure if the larger variability of MAPA results (eg for HCHO and aerosols UV) is related to the different azimuths - is MMF seeing less well the variability among the different azimuths, is MMF too sensitive or is this a false impression? are the SCD showing some systematic (?) larger signal over the city or the sea? or is this just coming from the larger variability in aerosols in the UV ? (if latter explanation is relevant, also add it to P. 16, lines 355- 356).
- P. 19, line 396: consider "Figure 8 shows a typical example of the calculated AVKs for each of the retrieved species. The DoF of this example retrieval
are shown for each species." --> "Figure 8 shows a typical example of the calculated AVKs for each of the retrieved species, including their corresponding DoF."
- P. 19, line 399: "The averaging kernels verify that" - change "verify" to "illustrate" or something similar.
- P. 20, line 412: no other source of independent HCHO is present, but this section could also be a good place to compare results from the 2 profiling algorithms to results of past VCD retrieval methods (see comment above)
- Figure 9: what flagging choice is used to make this figure?
from this figure, the feeling is that MAPA has systematically lower AOD @477 than the other datasets (a lot of points close to zero), which is not the case for AOD @360. I would say that the comparisons in the UV are better than in the visible...
- P. 21, line 435: "Compared to the CIMEL, MAPA seems to perform slightly better than MMF when its own flagging algorithm is applied to the data, with correlation coefficients of 0.70 and 0.50, respectively." - suggestion to replace by "when each algorithm consider is own flagging, with correlation coefficients of 0.70 and 0.50, respectively (MAPA for case #2 and MMF for case #1)." for more clarity!
- P. 21, line 447: "The AOD derived from the MAX-DOAS, both in the UV and the VIS range, is, generally, underestimated compared to the AOD measured by the CIMEL and the Brewer" --> add references to other studies showing that! also in P. 22, line 454.
- P. 24, line 476: "Thus, differences in the retrieved extinction profiles are expected, especially at locations with large horizontal inhomogeneities of aerosols" --> is this the case here? having a geophysically analysis (diurnal and seasonal) of the results for the different azimuths would help answer to this question. What azimuth is shown in Figure 12 for MAXDOAS?
- Figure 12: it would be nice to also have a comparison of the integrated aerosols profiles, to compare the lidar AOD to the MAXDOAS ones and to Brewer and AERONET (if available) for those cases.
- P. 26, line 510: what MAXDOAS dataset is shown in Figure 13? all the azimuth angles together?
- Figure 13: how is the fact that the MAXDOAS is situated at an height of 80m is taken into account here?
- P. 26, line 517: Zieger et al 2011 reference is for aerosols comparisons, it should appear in Sect. 4.1 instead of 4.2
- Figure A1: why none of the statistics for NO2 and HCHO correspond to those of Figure 7 black values? I would assume to find the same values in "O4 SF var"?!References:
---------------
- Gratsea, M., Vrekoussis, M., Richter, A., Wittrock, F., Schönhardt,
A., Burrows, J., Kazadzis, S., Mihalopoulos, N., Gerasopoulos, E., Slant Column MAX-DOAS
measurements of nitrogen dioxide, formaldehyde, glyoxal and oxygen dimer in the urban environment of
Athens, Atmospheric Environment (2016), doi: 10.1016/j.atmosenv.2016.03.048.- Gratsea, M., Bösch, T., Kokkalis, P., Richter, A., Vrekoussis, M., Kazadzis, S., Tsekeri, A., Papayannis, A., Mylonaki, M., Amiridis, V., Mihalopoulos, N., and Gerasopoulos, E.: Retrieval and evaluation of tropospheric-aerosol extinction profiles using multi-axis differential optical absorption spectroscopy (MAX-DOAS) measurements over Athens, Greece, Atmos. Meas. Tech., 14, 749–767, https://doi.org/10.5194/amt-14-749-2021, 2021.
- Irie, H., Kanaya, Y., Akimoto, H., Iwabuchi, H., Shimizu, A., and Aoki, K.: First retrieval of tropospheric aerosol profiles using MAX-DOAS and comparison with lidar and sky radiometer measurements, Atmos. Chem. Phys., 8, 341–350, https://doi.org/10.5194/acp-8-341-2008, 2008.
- Irie, H., Kanaya, Y., Akimoto, H., Iwabuchi, H., Shimizu, A., and Aoki, K.: Dual-wavelength aerosol vertical profile measurements by MAX-DOAS at Tsukuba, Japan, Atmos. Chem. Phys., 9, 2741–2749, https://doi.org/10.5194/acp-9-2741-2009, 2009.
- Vlemmix, T., Hendrick, F., Pinardi, G., De Smedt, I., Fayt, C., Hermans, C., Piters, A., Wang, P., Levelt, P., and Van Roozendael, M.: MAX-DOAS observations of aerosols, formaldehyde and nitrogen dioxide in the Beijing area: comparison of two profile retrieval approaches, Atmos. Meas. Tech., 8, 941–963, https://doi.org/10.5194/amt-8-941-2015, 2015.
Citation: https://doi.org/10.5194/amt-2021-201-RC2 -
AC2: 'Reply on RC2', Dimitrios Karagkiozidis, 16 Dec 2021
The comment was uploaded in the form of a supplement: https://amt.copernicus.org/preprints/amt-2021-201/amt-2021-201-AC2-supplement.pdf
-
AC2: 'Reply on RC2', Dimitrios Karagkiozidis, 16 Dec 2021