Maximizing the Use of Pandora Data for Scientific Applications

Abstract. As part of the Pandonia Global Network (PGN), Pandora spectrometers are widely deployed around the world. These ground-based, remote-sensing instruments are federated such that they employ a common algorithm and data protocol for reporting on trace gas column densities and lower atmospheric profiles using two modes based on direct-sun and sky-scan observations. To aid users in the analysis of Pandora observations, the PGN standard quality assurance procedure assigns flags to the data indicating high, medium, and low quality. This work assesses the suitability of these data quality flags for filtering data in the scientific analysis of nitrogen dioxide (NO₂) and formaldehyde (HCHO), two critical precursors controlling tropospheric ozone production. Pandora data flagged as high quality assures scientifically valid data and is often more abundant for direct-sun NO₂ columns. For direct-sun HCHO and sky-scan observations of both molecules, large amounts of data flagged as low quality also appear to be valid. Upon closer inspection of the data, independent uncertainty is shown to be a better indicator of data quality than the standard quality flags. After applying an independent uncertainty filter, Pandora data flagged as medium or low quality in both modes can be demonstrated to be scientifically useful. Demonstrating the utility of this filtering method is enabled by correlating contemporaneous but independent direct-sun and sky-scan observations. When evaluated across 15 Pandora sites in North America, this new filtering method increased the availability of scientifically useful data by as much as 90 % above that tagged as high quality. A method is also developed for combining the direct-sun and sky-scan observations into a single dataset by accounting for biases between the two observing modes and differences in measurement integration times. This combined data provides a more continuous record useful for interpreting Pandora observations against other independent variables such as hourly observations of surface ozone. When Pandora HCHO columns are correlated with surface ozone measurements, data filtered by independent uncertainty exhibits similarly strong and more robust relationships than high-quality data alone. These results suggest that Pandora data users should carefully assess data across all quality flags and consider their potential for useful application to scientific analysis. The present study provides a method for maximizing use of Pandora data with expectation of more robust satellite validation and comparisons with ground-based observations in support of air quality studies.