the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Emissivity retrievals with FORUM's end-to-end simulator: challenges and recommendations
Hilke Oetjen
Helen Brindley
William Cossich
Dulce Lajas
Tiziano Maestri
Davide Magurno
Piera Raspollini
Luca Sgheri
Laura Warwick
Download
- Final revised paper (published on 23 Mar 2022)
- Preprint (discussion started on 07 Sep 2021)
Interactive discussion
Status: closed
-
RC1: 'Comment on amt-2021-232', Anonymous Referee #1, 08 Sep 2021
Thank you for sharing this work with the community. This paper represents good progress in the demonstration of the mathematical machinery which can be applied to the FORUM mission radiance dataset.
The main problem I see is that the term OE is used many times but the actual results do not include a climatology for surface emissvity so therefore this work is not Optimal Estimation nor is it the Maximum A Posteriori (MAP) method described in Rodger's paper. I believe it is more correct to refer to the method described as Minimum Information or Generalized Least Squares (GLS) using a diagonal matrix with a spectrally constant value. In other words this is the result you would get if you did not have any prior information about the land surface nor did you know anything about the spectral correlations of the land surface. For that reason it represents a kind of "worse case" scenario for retrieving information. As if you were flying FORUM on a different unknown planet somewhere outside the solar system. In reality the actual Earth's infrared surface emissivty is slowly varying both spectrally and temporally for any given latitude/longitude. The whole point of the FORUM mission is to provide the calibrated radiances globally for a long enough time (at least one year) that the radiance dataset can be used to derive a climatology of FarIR emissivity for a grid of latitudes/longitudes by month of the year. However the method described is far from optimal for doing that. For this reason I suggest that the abstract and conclusions be modified to indicate that the results are expected to greatly improve AFTER the FORUM mission is concluded and a climatology is derived (by some to-be-determined manner). Perhaps you can suggest some kind of timeline whereby currently you don't have a priori information so you can't use an OE (or MAP) method but by the end of the mission you hopefully can demostrate an OE method that uses a priori information. This is just the first step and demonstrates that the machinery of the mathematics has been coded correctly and the somewhat disappointing results are expected to improve by the end of the mission.
Comments:
1) In Section 3.3 I suggest rewriting and expanding the first paragraph to state a bit more clearly the role that the xa and Sa play in the OE method. I disagree that the Xa is the a priori knowledge and the Sa is the uncertainty. I don't think that is a proper interpretation. In fact the Sa represents the variance of the a priori climatology so for surface emissivity this is the natural variability of the actual surfaces included in the dataset. In particular, if you restrict the climatology to Snow/Ice scenes (by using some image classification for example) then the Sa matrix will "constrain" the solution so that it is consistent with the natural variability each spectra channel. This is critically important because as shown in Figure 7 the snow/ice emissivity is close to unity at 960cm-1 and the variablity is necessarly smallest there. In that case the Sa matrix will weight the spectral channels so that the fitted surface temperature is derived mainly from the 960 cm-1 region and that greatly reduces the error in the Ts. In that case the xa (guess) value at 960 cm-1 has a small variance and thus allows for the Ts to be derived in an true OE method with a physical constraint. This is how you narrow the "sloppy valley", kind of like a ford in the stream which provides the most obvious place to cross. At the same time the off-diagonal elements of Sa provide the spectral correlation for physical surface emissivities which is critical for estimating the surface emissivity in the FarIR using microwindows (mainly) that do not fully constrain the solution by themselves. So rather than just dismissing the entire purpose of the OE approach I think you could add some sentences that say why you want to use the OE method with a real climatology but you don't have one yet.
The issue you point out that a single global Sa matrix can not distinguish between quartz and snow is true but the solution is not to throw out OE the better approach, much better is to use scene classification and develop climatologies for each scene type or mixture of scene types. The approach for doing this "divide and conquore" approach is described in the following references and is already implemented in RTTOV 12+ for the MidIR. The same approach should work for the FarIR.
Borbas, E.E., Hulley, G., Feltz, M., Knuteson, R. and Hook, S., 2018. The combined ASTER MODIS emissivity over land (CAMEL) part 1: Methodology and high spectral resolution application. Remote Sensing, 10(4), p.643.Feltz, M., Borbas, E., Knuteson, R., Hulley, G. and Hook, S., 2018. The combined ASTER MODIS emissivity over land (CAMEL) part 2: Uncertainty and validation. Remote Sensing, 10(5), p.664.Loveless, M., Borbas, E.E., Knuteson, R., Cawse-Nicholson, K., Hulley, G. and Hook, S., 2021. Climatology of the Combined ASTER MODIS Emissivity over Land (CAMEL) Version 2. Remote Sensing, 13(1), p.111.2) In the conclusions I suggest that you change the wording slightly to emphasize that the current results are what would be possible without an a priori climatology of surface emissivity BUT at the end of the FORUM mission you expect that the results will improve based on the development of climatologies that are consistent with the FORUM radiances.Citation: https://doi.org/10.5194/amt-2021-232-RC1 -
AC1: 'Reply on RC1', Maya Ben Yami, 08 Feb 2022
Thank you for reading our paper and for your helpful suggestions. Since some issues where addressed by both referees in their comment, we have chosen to post a single response. This includes detailed answers to all the individual comments as well as the changes we have made to the manuscript.
-
AC1: 'Reply on RC1', Maya Ben Yami, 08 Feb 2022
-
RC2: 'Comment on amt-2021-232', Anonymous Referee #2, 13 Sep 2021
I have read the paper "Emissivity Retrievals with FORUM's End-to-end Simulator: Challenges and Recommendations" by Ben-Yami et al. with interest. It is clear that this paper is the result of very careful and extensive work, and I congratulate the authors for this. Most of the results are interesting (but see below) and I also liked the figures. Despite this, I have several general comments that could lead to an improved paper (see below). I leave it up to the authors to decide whether and to what extent these general comments are addressed. They are given merely to help increasing the impact of the paper. Even without addressing these, I think the paper is suitable for publication in AMT after minor revision.
General comments
(i) Explanations are not always expressed very clearly. Very frequently I found myself reading a paragraph twice or even three times to understand. The paper is also too long-winded, especially near the end. It is also repetitive at times. In all, I think the paper would really benefit from careful copy-editing, to increase its impact and make the paper more pleasurable to read (and to increase the chances that readers actually make it to the end).
(ii) It is not always clear what the point is of the analysis or whether what is presented is really new. Some of the analysis is more appropriate for a thesis, or a technical report. A paper is not meant to show all results obtained in a study, but should present those results that are new and useful to the community. As an example, consider section 6.3 - did the reader really learn something? From the concluding paragraph (lines 509-515) one would say no. A ruthless shortening of the paper (both with respect to its wordiness and the material presented) would be highly beneficial in my opinion.
(iii) the study is geared towards FORUM and the specific tools that have been developed, but is this paper going to be useful to anyone else? (especially since it is mentioned several times that the paper is just a step in the development of a future product).
(iv) Point (2) in the abstract illustrates these three points. It is hard to read, difficult to understand what is meant, and not sure that it is useful to anyone but the developing team of FORUM.Specific Comments:
Line 2: its FIR contribution > that the FIR is..
Line 10: absolute or relative uncertainty? is this % or absolute?
Line 13: not sure if I agree with the first recommendation (even after reading the paper). Why limit the range artificially with an ad hoc threshold? Why not simply provide the emissivity over the entire range together with the estimated uncertainty (or information content quantifier) and let the user decide what to use?
Line 15: Point (2) is very hard to understand, in particular the "Thus" - how does the second sentence follow from the first (which doesn't even mention uncertainty). An abstract should be understood by itself, without the need for going through the entire paper. If i understand it correctly, what you want to say is that because emissivity and temperature cannot be retrieved independently, a priori knowledge on at least one or both is needed - however errors on e.g. the a priori of the Tskin, might result in unrealistic uncertainty estimates; and a way has to be found to improve these estimates. If this is what is said, it is a rather weak way to close an abstract.
Abstract: overall, the abstract could be much stronger and would highly benefit from copy editing. It would also benefit from a few strong, easy to understand take-home messages.
Introduction: I didn't see this paper cited https://doi.org/10.1175/BAMS-D-20-0155.1 which could be relevant
Line 25: "never been observed"; not exactly, as there have been aircraft measurements. Perhaps add "from satellite"
Line 34-35: a bit strange to say that it is exciting to measure because only one instrument can measure it. There are many things unique that are very unexciting. The second reason is much more convincing.
Line 95: I would move this to section 3.2, as it is there that the retrieval parameters are discussed.
Line 107: This deserves a reference or justification
Line 115: I would move the start of Section 3 to the end of the introduction
Line 177 spectral region considered > considered spectral region
Line 187: to this end four > to this end, four
Line 192: "The reason of the focus on the water vapour" .. this sentence is very important, but should be mentioned much earlier in the manuscript (in the introduction), because water vapour is mentioned over and over, without saying why it is important.
Figure 3: This is a very nice figure, but here are a couple suggested improvements: (1) Panel a: plot 1 sigma uncertainties as a semi-transparent shaded region, because as-is, the error bars draw all the attention. (2) I would add a 5th panel with the total transmittance (surface to TOA) as a function of wavenumber, since you discuss transmittance many times, without ever showing it. This property is probably available from the forward model without much effort. On this plot you could also indicate the main spectral ranges of absorption due to the different species (O3, CO2, H2O, CH4, ...) As a side comment, the paper emphasizes strongly on H2O but does not mention the other strong absorbers - I think it is a shame not too. This does not need to be long, but you could for instance raise the following question: With current trends in CO2 increases, can we expect that the retrieval range will become more narrow by the time FORUM is operational? (3) For the bottom panel, how about just displaying the diagonal of the averaging kernel? You mention that it is not smooth (line 267), but from the plot this does not seem to be the case for the diagonal. The diagonal will probably look similar to the IQ.
Line 236: "below the CO2" - might be unclear to some readers, but see previous comment on inclusion of extra panel.
Figure 4: since a discrete number of of pwv are used, it would be good to use a discrete colorbar with the same number of colors.
Figure 5: From figure 5, and the visible "noise" in the retrieval, it can be argued that the retrieval is not smooth enough on the one hand, but gives too much importance to long range correlations. One way of tuning this is with the correlation length, as the paper does, but the results in Figure 5 suggest that the formula used for the covariance matrix (line 614) is far from optimal. Perhaps replacing Delta/CL with (Delta/CL)^n would already do it, with n>1 so that the short range correlations become relatively more important than the long). The value of CL would need to be reevaluated. You could optimize by minimizing the RMS for different choices of n and CL (like you do in appendix B).
Figure 5: Please add the value of the RMS to each of the panels
Section 5: The word "extent" is a bit of misnomer, as it doesn't express the width of the interval. I would simply replace it with "lowest wavenumber" everywhere in figure, table and text.
Line 327: Only pwv is mentioned while obviously some other species are equally important (see comment above on the other species).
Caption of Figure 7: please shorten. Only at the end of the caption the reader actually learns what the lines in the main plot represent. No need to give needless details (like the time of the observation) or repeat everything that is in the text, or what should be clear from the legend (like that the dashed line corresponds to the true emissivity).
"same in all four cases": do you mean exactly the same, this is very surprising!
uncertainty > uncertainty.
Figure 7: the legend in the figure (i)-(iv) could be improved, e.g. true +/- 0.5K etc would be clearer if it is written as, True a priori, +/-0.5 K uncertainty.
Line 333-335: this is incorrect in the sense that we have a robust lower bound on the temperature (corresponding to an assumed emissivity of 1, whereas lower temperature would need an emissivity above 1). The statement is correct for temperatures higher than the actual temperature.
Line 337: unclear as you already use MIR? Please also define what you understand under MIR, as there are many definitions.
Section 6.1: I believe that temperature and emissivity will be easier to disentangle once you find a more appropriate covariance matrix per comment above.
Line 362 "the the"
End of section 6.1 + section 6.2: I do not understand the choice of a priori value of 1 for the emissivity. Why not say a constant 0.98 or 0.99? This will in almost all cases be closer to true emissivity, and will therefore: (1) result in faster convergence and (2) result in retrieval results closer to true value (as your a priori value is closer to the truth). It is a free gain.
Figure 8: not a big fan of this figure, as it is very hard to read / interpret. First, the study of initial guess is not that interesting/relevant as there is little reason to take the initial guess different from the a priori. Easier, more comprehensive and more interesting would be a combined analysis of the a priori and constraint. How about a scatter plot with X-axis the a priori (say 0.8-1 in steps of 0.01), Y-axis the a priori uncertainties and then the datapoints colorcoded by RMS (averaged over the 4 cases)?Citation: https://doi.org/10.5194/amt-2021-232-RC2 -
AC2: 'Reply on RC2', Maya Ben Yami, 08 Feb 2022
Thank you for reading our paper and for your helpful suggestions. Since some issues where addressed by both referees in their comment, we have chosen to post a single response. This includes detailed answers to all the individual comments as well as the changes we have made to the manuscript.
-
AC2: 'Reply on RC2', Maya Ben Yami, 08 Feb 2022