Estimates of PM2.5 levels are crucial for monitoring air quality and studying the epidemiological impact of air quality on the population. Currently, the most precise measurements of PM2.5 are obtained from ground stations, resulting in limited spatial coverage. In this study, we consider satellite-based PM2.5 retrieval, which involves conversion of high-resolution satellite retrieval of aerosol optical depth (AOD) into high-resolution PM2.5 retrieval. To improve the accuracy of the AOD-to-PM2.5 conversion, we employ the machine-learning-based post-process correction to correct the AOD-to-PM conversion ratio derived from Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) reanalysis model data. The post-process-correction approach utilizes a fusion and downscaling of satellite observation and retrieval data, MERRA-2 reanalysis data, various high-resolution geographical indicators, meteorological data, and ground station observations for learning a predictor for the approximation error in the AOD-to-PM2.5 conversion ratio. The corrected conversion ratio is then applied to estimate PM2.5 levels given the high-resolution satellite AOD retrieval data derived from Sentinel-3 observations. The region of study is central Europe during the year 2019. Our model produces PM2.5 estimates with a spatial resolution of 100 m at satellite overpass times with R2= 0.55 and RMSE = 6.2 µg m-3. The corresponding metrics for monthly averages are R2= 0.72 and RMSE = 3.7 µg m-3. Additionally, we have incorporated an ensemble of neural networks to provide error envelopes for machine-learning-related uncertainty in the PM2.5 estimates. The proposed approach can produce accurate high-resolution PM2.5 data that can be very useful for air quality monitoring, emission regulation, and epidemiological studies.
European Space Agency4000137651/22/I-DT-lrResearch Council of Finland336791321761Introduction
Poor air quality is one of the most serious environmental health risks of our time. In September 2021, the World Health Organization (WHO) released Global Air Quality Guidelines, revealing clear evidence of the damage air pollution inflicts on human health at even lower concentrations than previously understood . The WHO estimates that exposure to air pollution causes 7 million premature deaths every year. A key indicator in monitoring air quality and epidemiological studies is the PM2.5 parameter, which is the dry-mass concentration of fine particulate matter with an aerodynamic diameter of less than 2.5 µm (micrograms of particulate matter per cubic meter of air). Fine particulate matter originates from vehicle emissions, coal burning, and industrial emissions, among many other human and natural sources. Epidemiological studies link long exposures to high PM2.5 levels to many severe illnesses, such as stroke and cardiovascular and respiratory diseases e.g.,. On a global scale, the magnitude of the PM2.5-exposure-related risk for human health is enormous as more than 90 % of the world's population lives in areas with annual mean PM2.5 levels exceeding the new WHO 2021 air quality guideline of 5 µg per cubic meter (µg m-3, annual average) .
While the knowledge of the health effects of pollution increases continuously, the epidemiological estimates still have significant uncertainties due to the lack of accurate global air pollution data . Networks of ground-based observation stations produce accurate pointwise observations of PM2.5 and certain chemical components such as ozone, sulfur dioxide, and nitrogen dioxide. These ground station measurements produce relatively accurate data, but the networks consist of only a few thousand irregularly located observation stations, mainly in developed countries, leading to the insufficient spatial coverage of the PM2.5 data. To better monitor and understand air quality and pollution sources, near-real-time global observations of air quality are needed. The only way to get spatially resolved air quality data is to utilize satellite retrievals.
Satellite retrievals of PM2.5 are often based on satellite aerosol optical depth (AOD) retrievals and an AOD-to-PM conversion ratio . AOD is a columnar optical quantity, whereas PM2.5 is the mass concentration of dry aerosol particles at some single point, typically at the surface level. Many factors affect the AOD-to-PM conversion ratio, including the aerosol vertical extinction profile, aerosol type and size distribution, and relative humidity. These factors are typically unavailable from a single data source, such as data provided by the instruments aboard a satellite, so a simulation-model-based AOD-to-PM ratio is often used. The simulation-model-based AOD-to-PM conversion ratio is typically computed based on meteorology, chemical transport models (CTMs), and auxiliary satellite data such as lidar-based aerosol vertical profiles. The PM2.5 retrieval at a given location and time is then calculated as a product of the retrieved satellite AOD and the AOD-to-PM2.5 ratio. The current state-of-the-art PM2.5 retrieval algorithm also contains a post-processing step where the retrieved spatial PM2.5 estimate is fitted to the ground-based PM2.5 station data by a linear geographically weighted regression .
Many previous studies use machine-learning techniques to convert AOD to PM2.5 levels. In particular, used a variant of random forest called extremely randomized trees (ETs) to estimate PM2.5 across Europe. and used random forest regressors in a multi-stage approach to estimate PM2.5 at ground stations when only PM10 measurements were available, to impute AOD values when not accessible, and to finally predict PM2.5 values across Italy and Great Britain. considered multiple random forest models to evaluate PM2.5 levels across Germany using four different AOD datasets.
In this paper, we propose a novel approach for high-resolution satellite-based retrieval of PM2.5. While the previous studies use machine learning to learn the AOD-to-PM2.5 conversion directly, we take a novel approach where we train the model to predict the approximation error in the geophysical-model-based conversion ratio. Our approach retrieves PM2.5 at a spatial resolution of 100 m. It is based on the machine-learning post-process-correction approach, which we developed for the correction of approximation errors in satellite retrievals and employed for high-resolution spectral aerosol optical depth (AOD) retrieval (POPCORN AOD) from Sentinel-3 SYNERGY data . In our algorithm development work, we take the spectral, high-resolution Sentinel-3 POPCORN AOD as the starting point. Our PM2.5 retrieval is based on the AOD-to-PM2.5 conversion ratio applied to the POPCORN AOD. The AOD-to-PM2.5 ratio is estimated by machine-learning techniques utilizing a fusion of collocated ground station-based in situ PM2.5 data, MERRA-2 reanalysis model AOD and PM2.5 data, spectral AERONET AOD, satellite-observed spectral top-of-atmosphere reflectances, meteorology data, and various high-resolution geographical indicators representing, for example, population density and land surface elevation. Utilizing these data, we employ the post-process-correction approach to the estimation of the AOD-to-PM2.5 ratio , and then the high-resolution PM2.5 retrieval is obtained as the product of the post-process-corrected AOD-to-PM2.5 ratio and POPCORN AOD. Using an ensemble of neural networks, we can also provide error envelopes for the machine-learning-related uncertainty in the PM2.5 estimates. The approach is tested with Sentinel-3 data from central Europe in 2019.
Data
We use various input data variables in computing the estimate for the surface PM2.5. We use satellite observation data and retrievals, in situ observations, and reanalysis model data. This section lists all the variables and data sources used in our work.
Sentinel-3 POPCORN AOD
The Sentinel-3 POPCORN AOD product is based on the post-process-corrected Sentinel-3 SYNERGY land AOD product. It offers a spatial resolution of 300 m and is currently accessible for Sentinel-3A and 3B overpasses, covering five regions of interest for the year 2019: central Europe, eastern USA, western USA, southern Africa, and India. Two Sentinel-3 satellites currently flying provide revisit times of less than 2 d for the Ocean and Land Colour Instrument (OLCI) and less than 1 d for the Sea and Land Surface Temperature Radiometer (SLSTR) instrument at the Equator. The swath width of the OLCI instrument is 1270 km. The SLSTR swath width is 1420 km for the nadir view and 750 km for the oblique view.
The post-process correction is based on a feed-forward neural network that was trained to predict the bias in Sentinel-3 SYNERGY AOD. Sentinel-3–AERONET-collocated data were used as the training data for the neural network, and the trained neural network was then used for bias correction and super-resolution of the Sentinel-3 AOD (land) data. The idea for post-process correction of satellite AOD retrievals was introduced in . For the technical details and accuracy metrics of Sentinel-3 SYNERGY land POPCORN AOD and related openly available code and data, see .
In this work, we use POPCORN AODs at 440, 500, 550, 675, and 870 nm, as well as the Ångström exponent derived using AODs at these wavelengths as input for the AOD-to-PM2.5 ratio model. POPCORN AODs are the data that bring the accurate AERONET AOD information to the AOD-to-PM2.5 conversion.
OpenAQ
OpenAQ (https://openaq.org/, last access: 13 April 2023) is an open database for air quality data. In this work, we use OpenAQ as our data source for surface in situ PM2.5 observations. OpenAQ provides pointwise air quality measurement data for thousands of stations. The temporal resolution of the data provided varies by station; 1 h and daily observations are commonly available. See Fig. for a map of OpenAQ stations providing hourly data in our region of interest.
Map of stations in the region of interest.
Some OpenAQ stations report 24 h average PM2.5 every hour.
In this work, we used the 24 h averages given every hour to estimate hourly PM2.5. This was done station by station using a Tikhonov regularized (with regularization parameter value 0.05) least-squares fit to unfold the time-integrated data into hourly estimates.
In practice, the hourly PM2.5 estimates were computed using the formula
PM2.5,1h=ATA+αI-1ATb,
where
2A=124124⋯12400⋯00124⋯1241240⋯0⋮00⋯000⋯124,3b=PM2.5,24h,1PM2.5,24h,2⋮PM2.5,24h,N,4PM2.5,1h=PM2.5,1h,24PM2.5,1h,25⋮PM2.5,1h,N,
and α is the regularization parameter. PM2.5,1h,N and PM2.5,24h,N denote the 1 and 24 h average PM2.5 at time step N, respectively.
MERRA-2
The Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) is NASA's reanalysis model . MERRA-2 provides us meteorological variables, such as wind fields and temperatures. Furthermore, the MERRA-2 reanalysis also has the necessary aerosol and air quality information to compute an estimate for the surface PM2.5.
MERRA-2 has a spatial resolution of 0.5° × 0.625°. This is roughly 50 km in the central Europe region. The time-varying MERRA-2 variables we use have the temporal resolution of 1 h, and instantaneous values or time-averaged values are given depending on the variable and data product. We also use some MERRA-2 constant variables as inputs for our AOD-to-PM2.5 model. See the Appendix for a list of all variables we have used as inputs in our models from the MERRA-2 reanalysis.
In addition to MERRA-2-provided variables, the following variables are derived using the MERRA-2 meteorology and aerosol-related variables and used in our models as inputs:
relative humidity (RH) at the surface – equation based on the Clausius–Clapeyron equation see e.g.,,RH=0.263⋅PS⋅QLML/exp(17.67⋅(T2M-273.15))/(T2M-29.65);
wind direction (WD10M) at 10 m,WD10M=arctan-V10M/U10M;
wind speed (WS10M) at 10 m,WS10M=U10M2+V10M2;
PM2.5 at surface ,PM2.5=1.375⋅SO4SMASS+1.4⋅OCSMASS+BCSMASS+DUSMASS25+SSSMASS25⋅109;
AOD-to-PM2.5 ratio η,η=PM2.5TOTEXTTAU.
CALIOP aerosol vertical profile climatology
We use the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) Lidar Level 3 Tropospheric Aerosol Profiles, Cloud Free Data, Standard Version 4-20 data product as one of our input data sources . This level 3 climatology data product has a spatial resolution of 2.5° × 2° and a temporal resolution of 1 month. We use daytime variables, and in the case of missing data, we use the nearest value found in the dataset. We use two variables from this dataset: AOD 63 % below and AOD 90 % below. These variables indicate the vertical height below which 63 % and 90 % of AOD is located on average. This gives us information about the vertical distribution of aerosols in the atmosphere.
Time variables
Information about the time of day and year is given as input for the model. The yearly and daily fractions from the beginning of the year and day until the end of year and day, respectively, are mapped to a unit circle, and the x and y coordinates of the unit circle points are used as inputs for the model. With this approach, we get very similar values for the end and beginning of the year and day.
OpenStreetMap is an open-map project, and it contains map data with high spatial resolution. We use OpenStreetMap roads as a data source for our model inputs. We compute the distance to the nearest street or highway and use this distance as an input. We use a 100 m resolution grid for the distances. The paths, streets, and highways are all classified as “highways” in OpenStreetMap, and we use only the following sub-classes to only accept roads and highways with car traffic and thus potential PM2.5 sources (information from ). See Appendix for all the OpenStreetMap road types used to compute the distance to the closest road.
NASA Black Marble night lights
NASA's Black Marble is a night light product based on Visible Infrared Imaging Radiometer Suite (VIIRS) day/night band (DNB) radiances measured at nighttime. DNB is highly sensitive to light and can therefore detect even very low intensity lights on Earth's surface at night. Most of the nighttime lights seen on Earth's surface are due to human activities. As human footprints are seen well in the night lights, we use the NASA Black Marble night lights as a proxy variable for the population density, and we use it as one input for our models. We use night light data at a spatial resolution of 500 m as our input based on the yearly data product VNP46A4 .
MODIS land cover type
We use the MODIS MCD12Q1 land cover type data product to derive input variables that contain distances to the closest International Geosphere-Biosphere Programme (IGBP) land cover types . The spatial resolution of the MODIS MCD12Q1 data product is 500 m. For the list of IGBP land cover types, see Appendix .
Digital elevation model
We use the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) digital elevation model (DEM) to describe the land surface elevation . The ASTER DEM has a spatial resolution of 1 arcsec corresponding to about 30 m.
For example, as in , we model the dependency between the PM2.5 at the surface level and AOD using the following model:
PM2.5=η⋅AOD,
where η=η(r,t) is the AOD-to-PM2.5 conversion coefficient that is function of both time t and space r.
Post-process-correction approach
Let y∈Rm denote an accurate satellite retrieval,
y=f(x),
where vector y contains the output of the satellite retrieval algorithm, f:Rn↦Rm is an accurate retrieval algorithm, and x∈Rn contains all the algorithm inputs including the observation geometry and level 1 satellite observation data such as the top-of-atmosphere reflectances. The retrieval y can consist, for example, of surface PM2.5 at a given point in space and time.
In practice, due to uncertainties in the auxiliary parameters of the underlying forward model, the extensive computational dimension of the problems, and processing time limitations, it is not possible to construct an accurate retrieval algorithm f, but an approximate retrieval algorithm,
ỹ≈f̃(x),
has to be employed instead. The approximate retrieval f̃ is typically based on physically simplified and computationally reduced approximate forward models that are used due to the huge dimensionality of the retrieval problems and the need for computational efficiency. The utilization of the approximate retrieval algorithm leads to an approximation error,
e(x)=f(x)-f̃(x),
in the retrieval parameters.
The core idea of the model-enforced post-process-correction model is to improve the accuracy of the approximate retrieval () by machine-learning techniques. By Eqs. ()–(), the accurate retrieval can be written as
y=f(x)=f̃(x)+f(x)-f̃(x)=f̃(x)+e(x).
To obtain the corrected retrieval, Eq. () is used to combine the conventional (physics-based) retrieval algorithm f̃(x) and a machine-learning-based model e^(x) to predict the realization of the approximation error e(x) to obtain a corrected retrieval
y≈f̃(x)+e^(x).
Note that this approach is different from a conventional fully learned machine-learning model in which the aim is to emulate the accurate retrieval algorithm f(x) with a machine-learning model,
y≈f^(x),
that is trained to predict the retrieval y directly from the satellite observation and geometry data x. The approximation error of the physics-based retrieval is a less complicated function (compared to the direct retrieval) for a machine-learning regression to learn. This leads to a more accurate and reliable estimation of the retrieval quantity.
In our work, we use the post-process-correction approach () to correct for the MERRA-2-based AOD-to-PM2.5 conversion factor η. We utilize an ensemble of neural networks to learn the correction to the conversion factor η and simultaneously produce error envelopes related to the learning process. Our post-process-correction model e^(x):Rn↦R corrects the conversion factor pixel by pixel, meaning that
12η(x)=η^+e^(x),13PM2.5=η(x)⋅AODPOPCORN,
where η^ represents the AOD-to-PM2.5 ratio to be corrected. The correction model is learned using collocated data from ground station PM2.5 data, MERRA-2 data, satellite data and retrieval, meteorological data, and high-resolution geographical indicators. All the inputs used can be found in Table and are described in Sect. . We used SHAP analysis in order to estimate feature importance after the training of the model. In Fig. you can see a bar plot of the first 26 input features ordered by their importance (SHAP value), and in Table the features are ordered by their SHAP importance (from left to right and from top to bottom). Since no features showed a non-negligible SHAP value, we decided to keep them all in the training of the model. We finally add the estimated correction term to the MERRA-2 η values and calculate the PM2.5 estimates corresponding to POPCORN AOD retrievals using Eq. ().
Selection of the network model
As the dimension n of the input data x to the correction model e^(x) is relatively small (n=172) and the output is a scalar, we utilize a fully connected feed-forward neural network for the regression task. The networks are implemented using the TensorFlow framework.
To optimize the neural-network architecture, we employed KerasTuner, a hyperparameter optimization framework. The Adam optimizer and 10-3 learning rate were selected. We used the mean square error (MSE) loss function in the training. A linear activation function was employed for the output layer as the correction e^(x) is real-valued. Other parameters, such as the activation functions and the number of nodes in hidden layers, were optimized using KerasTuner. We considered the number of hidden layers, experimenting with two-, three-, and four-layer architectures. The model with two hidden layers led to better accuracy compared to the deeper models with three or four hidden layers, and thus we employed the architecture with two hidden layers as our final model. The final optimal neural-network architecture is comprised of 172 input features and two hidden layers with seLu activation functions. The first and second hidden layers consist of 160 and 128 neurons, respectively. Figure shows the neural-network architecture obtained from the model optimization.
Feed-forward neural-network architecture for post-process correction of the η ratio, optimized with KerasTuner. The model contains two hidden layers with seLu activation functions (160 and 128 nodes, respectively) and a single node output layer with a linear activation function.
We divided the dataset into three subsets in training our neural-network model. Specifically, 60 % of the data were used for training, 20 % for validation, and 20 % for testing; see Fig. for the division of the air quality (AQ) stations into the training, validation, and test sites. The learning data were divided into training, validation, and test data by stations instead of random division of data points in order to avoid model overfitting and having test data from locations within the region of interest that were not included in the model training. Figure shows the proportions of different PM2.5 values in the training, validation, and test data. We used the validation set and applied early stopping with a patience parameter value of 30 epochs to prevent the neural-network model from overfitting.
Distribution of AQ station PM2.5 values in training, validation, and test sets. The training data are used to train the machine-learning algorithm, while the validation data are used to prevent overfitting. The test data are used to test the results after training. The division of the data was obtained by dividing the AQ stations in the region of interest into three separate sets with 60 %, 20 %, and 20 % shares of training, validation, and test stations.
In our tests, the model struggled to predict high PM2.5 values accurately. We partially attributed this limitation to the skewed distribution of our dataset, which was predominantly composed of low PM2.5 values; see Fig. for the histogram of the PM2.5 values of the AQ stations in the learning data. To address this, we introduced a cutoff value of 80 µg m-3 for PM2.5 and trained our model with samples corresponding to PM2.5 values only below this. Furthermore, we experimented with reweighting the loss function to emphasize higher PM2.5 values. Although this strategy slightly improved the model's performance on the high-end tail, it compromised the accuracy on the low-end tail. Consequently, we decided not to use the reweighted loss function.
Ensemble of networks
To address the problem of local minima and dependency on the initialization in neural-network training, we used an ensemble-based technique where we trained an ensemble of 80 networks each initialized with different random weights. We considered the predictions of the networks as samples from a distribution and used the median of the predictions as a point estimate for the correction term of η. We use the spread minimum-to-maximum interval of the 80 outputs of the networks as a learning-related uncertainty for η, which was propagated onward to the uncertainty of the PM2.5 estimates through the conversion ().
(a) MERRA-2 PM2.5 predictions against OpenAQ PM2.5 measurements per single overpass. (b) Uncorrected NOODLESALAD PM2.5 predictions against OpenAQ PM2.5 measurements per single overpass. (c) Corrected NOODLESALAD PM2.5 predictions against OpenAQ PM2.5 measurements per single overpass. (d) MERRA-2 monthly average PM2.5 predictions against OpenAQ monthly average PM2.5 measurements. (e) Uncorrected NOODLESALAD monthly average PM2.5 predictions against OpenAQ monthly average PM2.5 measurements. (f) Corrected NOODLESALAD monthly average PM2.5 predictions against OpenAQ monthly average PM2.5 measurements.
Results
Figure shows scatter plots of the satellite- and model-based predictions of PM2.5 with respect to the values of the ground stations for the test data AQ stations per single overpass and as monthly averages. We calculated the monthly averages considering a threshold: monthly averages were accepted only when we had more than five daily measurements per month (and station). The panels on the top row show results for single overpasses, and the panels on the bottom row show monthly averages. The panels on the left show the ground data comparison for the MERRA-2 PM2.5 estimates, the panels in the middle show the ground data comparison for the PM2.5 values estimated using Eq. () with POPCORN AOD and MERRA-2 conversion factor η, and the panels on the right show the comparison for the PM2.5 values estimated using Eq. () with POPCORN AOD and post-process-corrected η. As can be seen, the use of a post-process-corrected conversion factor leads to a clear improvement on the accuracy of the predictions of PM2.5 at the independent test data locations. The R2 coefficient for instantaneous values is improved by about 290 % compared to both the MERRA-2 prediction and the estimate () with the POPCORN AOD and MERRA-2 conversion factor. The RMSE is improved by a factor of 32 % compared to MERRA-2 prediction and by a factor of 41 % compared to the product of POPCORN AOD with MERRA-2 η. The absolute value of the bias is reduced by a factor of over 95 % with respect to both of the uncorrected estimates, and the MAE decreased by a factor of 26 % compared to the MERRA-2 prediction and by a factor of 41 % compared to the product of POPCORN AOD with MERRA-2 η. In the monthly averages the R2 coefficient is improved by a factor of 350 % with respect to MERRA-2 prediction and by a factor of 279 % compared to the estimate () with POPCORN AOD and MERRA-2 η. The RMSE in the monthly averages is reduced by a factor over 47 % with respect to both uncorrected methods. The bias in the monthly averages is reduced by a factor of 92 % and 89 %, respectively, and the MAE decreased by a factor of 44 % and 49 %.
We remark that we also tested the fully learned approach () for directly learning the AOD-to-PM2.5 conversion factor η values instead of the correction of the MERRA-2-based conversion, but the results with the fully learned approach were less accurate than with the post-correction approach (). The comparison can be seen in Fig. .
(a) Single-overpass not-corrected PM2.5 map over Paris (RMSE against ground stations = 7.82 µg m-3). (b) Single-overpass corrected PM2.5 map over Paris (RMSE against ground stations = 6.36 µg m-3). Notice that the white regions for the panels on top are regions where the AOD (so the PM2.5) values are missing because of cloud contamination. (c) Comparison of the uncorrected and corrected method at the ground stations. The red error bars represent the spread of values obtained through the ensemble method, while the red dots represent the medians of those values. (d) Comparison between OpenAQ and corrected-method-predicted time series of PM2.5 monthly averages at a single station (indicated on the corrected map by a green arrow). The red envelope represents the uncertainty coming from the ensemble method.
(a) Single-overpass not-corrected PM2.5 map over Madrid (RMSE against ground stations = 4.59 µg m-3). (b) Single-overpass corrected PM2.5 map over Madrid (RMSE against ground stations = 2.27 µg m-3). Notice that the white regions for the panels on top are regions where the AOD (so the PM2.5) values are missing because of cloud contamination. (c) Comparison of the uncorrected and corrected method at the ground stations. The red error bars represent the spread of values obtained through the ensemble method, while the red dots represent the medians of those values. (d) Comparison between OpenAQ and corrected-method-predicted time series of PM2.5 monthly averages at a single station (indicated on the corrected map by a green arrow). The red envelope represents the uncertainty coming from the ensemble method.
Figures and show PM2.5 maps over Paris (23 February 2019) and Madrid (29 March 2019) for a single satellite overpass, respectively. On the top left the uncorrected map is obtained based on POPCORN AOD 500 nm and MERRA-2 η, while on the top right the corrected map uses the post-process-corrected MERRA-2 η. On the bottom left we compare the satellite-based PM2.5 values to the measured PM2.5 values at the AQ stations, which are represented by the circles in the maps. The red circles represent the post-corrected estimates (medians calculated from the ensemble predictions), the black dots represent the uncorrected estimates, and the blue dots represent the ground-based measurement values at the stations. The red error bars represent the spread of PM2.5 values coming from the ensemble of networks, and they are to be considered uncertainty estimates related to the machine-learning process. The joint RMSEs of the uncorrected estimates with respect to the ground stations are 7.82 and 4.59 µg m-3, respectively, for Paris and Madrid, and the joint RMSEs for the post-corrected estimates with respect to the ground stations are 6.36 and 2.27 µg m-3, indicating improved accuracy of the per-overpass PM2.5 estimates in the post-process-correction approach. Figures c and c reveal that, for all the stations, the different initialization points for the trainings improve over the uncorrected prediction. The median of the ensemble predictions is not always better than the uncorrected prediction, but the uncertainty interval either encloses the measured value or is closer to the measured value than the uncorrected estimate. The bottom-right images show a time series of PM2.5 monthly average predictions against the time series coming from ground station monthly averages (the stations are shown on the corrected maps by a green arrow). The red envelopes show the uncertainty envelope of the post-process-corrected estimate. Here the ground station monthly averages are contained in the uncertainty envelope. Figure shows time series of PM2.5 monthly averages of the post-process-corrected estimates for different stations in the region of interest, showing good alignment with the accurate ground-based AQ measurements. Similar performance was found for the monthly averages in most of the test stations in the region of interest, indicating that the post-process-corrected estimates of monthly averages of PM2.5 are generally well aligned with the accurate ground-based observations.
Monthly average time series for six stations from the independent test set within the region of interest. The red envelopes represent the uncertainty coming from the ensemble method.
(a) GEOS-CF PM2.5 predictions against OpenAQ PM2.5 measurements per single overpass. (b) Uncorrected NOODLESALAD PM2.5 predictions against OpenAQ PM2.5 measurements per single overpass (using GEOS-CF data). (c) Corrected NOODLESALAD PM2.5 predictions against OpenAQ PM2.5 measurements per single overpass (using GEOS-CF data).
The post-process-correction method we have proposed here is flexible with respect to data utilized in the training, as it allows straightforward addition of more training data (by re-optimization of the neural-network architecture) coming from different data sources in order to improve the PM2.5 predictions. In this study, we demonstrated the approach using POPCORN AOD data, which is obtained by post-correcting Sentinel-3 AOD. The approach can also be extended and trained to other satellite instruments and their AOD products to obtain similarly post-process-corrected high-resolution satellite estimates of PM2.5, leading to more frequent temporal sampling of a particular location. In this study, we demonstrated the approach using a relatively large region of interest covering the year 2019 in central Europe. The approach can also be scaled in a straightforward manner to smaller or larger regions of interest by changing the training data. To demonstrate the performance of our approach with different model data, we tested the post-process correction using Goddard Earth Observing System Composition Forecast (GEOS-CF) data instead of MERRA-2 data. GEOS-CF offers a higher spatial resolution of 25 km and variables that are not available from MERRA-2, for example, additional chemical species such as nitrate. The temporal resolution of GEOS-CF is 1 h. The result obtained when GEOS-CF data are used in the training of the correction model is shown in Fig. . Comparison to Fig. c shows that the performance of the correction model is similar to the model trained with MERRA-2 with MERRA-2, leading to slightly better error metrics.
Conclusions
We developed an innovative machine-learning technique aimed at correcting the AOD-to-PM2.5 ratio derived from MERRA-2 data. This correction method integrates data from various sources, including ground station PM2.5 data, MERRA-2 data, satellite data, meteorological data, and high-resolution geographical indicators. The post-process-corrected AOD-to-PM ratio was then employed to estimate PM2.5 levels within the central Europe region for the year 2019. Our approach outperforms MERRA-2 predictions and predictions made using the MERRA-2 AOD-to-PM ratio and POPCORN AOD, resulting in an improvement in all evaluated metrics, whether considering individual overpasses or monthly averages. The PM2.5 estimates were derived by aggregating the median values from an ensemble of neural networks. We incorporated the ensemble's value spread as a measure of machine-learning-related uncertainty in the post-process-corrected PM2.5 estimates, and our estimates with their uncertainty envelopes were found to be generally highly feasible with respect to the accurate ground-based observations at the independent test station locations. We remark that while our approach produced generally good accuracy in estimation of PM2.5, it exhibited poorer performance for the high-end values of PM2.5. This finding can be attributed to the small number of learning data for the high-end tail of PM2.5 values in our region of interest, highlighting the obvious fact that the learning data for machine learning need to be representative of the operational environment and conditions.
In this study, our goal was to utilize a simple neural-network model to estimate the PM2.5 values from satellite data. Therefore, the adoption of a fully connected neural-network architecture was considered a reasonable choice. The architecture of the network was determined through a combination of manual selection and the use of KerasTuner to optimize the number of neurons per layer and the activation function. This ensured the development of an effective network for the specific problem under study. The robust performance of the resulting model highlights the efficacy of employing a simple neural-network model to address PM2.5 estimation with notable success.
Lists of variables used from datasetsMERRA-2 variables
We use the following meteorology-related variables from the MERRA-2 M2T1NXSLV dataset.
PS: surface pressure (Pa)
QV10M: 10 m specific humidity (kg kg-1)
QV2M: 2 m specific humidity (kg kg-1)
SLP: sea level pressure (Pa)
T10M: 10 m air temperature (K)
T2M: 2 m air temperature (K)
TO3: total column ozone (dobsons)
TOX: total column odd oxygen (kg m-2)
TQI: total precipitable ice water (kg m-2)
TQL: total precipitable liquid water (kg m-2)
TQV: total precipitable water vapor (kg m-2)
TROPPB: tropopause pressure based on blended estimate (Pa)
TROPPT: tropopause pressure based on thermal estimate (Pa)
TROPPV: tropopause pressure based on Ertel's potential vorticity (EPV) estimate (Pa)
TROPQ: tropopause specific humidity using blended tropopause pressure (TROPP) estimate (kg kg-1)
TROPT: tropopause temperature using blended TROPP estimate (K)
TS: surface skin temperature (K)
U10M: 10 m eastward wind (m s-1)
U2M: 2 m eastward wind (m s-1)
U50M: eastward wind at 50 m (m s-1)
V10M: 10 m northward wind (m s-1)
V2M: 2 m northward wind (m s-1)
V50M: northward wind at 50 m (m s-1)
We use the following meteorology-related variables from the MERRA-2 M2T1NXFLX dataset.
BSTAR: surface buoyancy scale (m s-2)
CDH: surface exchange coefficient for heat (kg m-2 s-1)
CDM: surface exchange coefficient for momentum (kg m-2 s-1)
CDQ: surface exchange coefficient for moisture (kg m-2 s-1)
CN: surface neutral drag coefficient (1)
DISPH: zero plane displacement height (m)
EFLUX: total latent energy flux (W m-2)
EVAP: evaporation from turbulence (kg m-2 s-1)
FRCAN: areal fraction of anvil showers (1)
FRCCN: areal fraction of convective showers (1)
FRCLS: areal fraction of nonanvil large-scale showers (1)
FRSEAICE: ice-covered fraction of tile (1)
GHTSKIN: ground heating for skin temperature (W m -2)
HFLUX: sensible heat flux from turbulence (W m-2)
HLML: surface layer height (m)
NIRDF: surface downwelling near-infrared diffuse flux (W m-2)
NIRDR: surface downwelling near-infrared beam flux (W m-2)
PBLH: planetary boundary layer height (m)
PGENTOT: total column production of precipitation (kg m-2 s-1)
OCSMASS: organic carbon surface mass concentration (kg m-3)
SO2CMASS: SO2 column mass density (kg m-2)
SO2SMASS: SO2 surface mass concentration (kg m-3)
SO4CMASS: SO4 column mass density (kg m-2)
SO4SMASS: SO4 surface mass concentration (kg m-3)
SSANGSTR: sea salt Ångström parameter 470–870 nm (1)
SSCMASS: sea salt column mass density (kg m-2)
SSCMASS25: sea salt column mass density – PM2.5 (kg m-2)
SSEXTT25: sea salt extinction AOD 550 nm – PM2.5 (1)
SSEXTTAU: sea salt extinction AOD 550 nm (1)
SSFLUXU: sea salt column u-wind mass flux (kg m-1 s-1)
SSFLUXV: sea salt column v-wind mass flux (kg m-1 s-1)
SSSCAT25: sea salt scattering AOD 550 nm – PM2.5 (1)
SSSCATAU: sea salt scattering AOD 550 nm (1)
SSSMASS: sea salt surface mass concentration (kg m-3)
SSSMASS25: sea salt surface mass concentration – PM2.5 (kg m-3)
SUANGSTR: SO4 Ångström parameter 470–870 nm (1)
SUEXTTAU: SO4 extinction AOD 550 nm (1)
SUFLUXU: SO4 column u-wind mass flux (kg m-1 s-1)
SUFLUXV: SO4 column v-wind mass flux (kg m-1 s-1)
SUSCATAU: SO4 scattering AOD 550 nm (1)
TOTANGSTR: total aerosol Ångström parameter 470–870 nm (1)
TOTEXTTAU: total aerosol extinction AOD 550 nm (1)
TOTSCATAU: total aerosol scattering AOD 550 nm (1)
OpenStreetMap road types used to compute the distance to the closest road
We use the following road types to compute the distance to the closest road. The descriptions of the road types are obtained from .
Motorway: a major restricted-access divided highway, normally with two or more running lanes plus an emergency hard shoulder; equivalent to the freeway, autobahn, etc.
Trunk: the most important roads in a country's system that are not motorways.
Primary: the next most important roads in a country's system.
Secondary: the next most important roads in a country's system.
Tertiary: the next most important roads in a country's system.
Motorway_link: the link roads (slip roads/ramps) leading to/from a motorway from/to a motorway or lower-class highway; normally with the same motorway restrictions.
Trunk_link: the link roads (slip roads/ramps) leading to/from a trunk road from/to a trunk road or lower-class highway.
Primary_link: the link roads (slip roads/ramps) leading to/from a primary road from/to a primary road or lower-class highway.
Secondary_link: the link roads (slip roads/ramps) leading to/from a secondary road from/to a secondary road or lower-class highway.
Tertiary_link: the link roads (slip roads/ramps) leading to/from a tertiary road from/to a tertiary road or lower-class highway.
IGBP land cover types
The IGBP classification contains the following land cover types:
evergreen needleleaf forests;
evergreen broadleaf forests;
deciduous needleleaf forests;
deciduous broadleaf forests;
mixed forests;
closed shrublands;
open shrublands;
woody savannas;
savannas;
grasslands;
permanent wetlands;
croplands;
urban and built-up;
cropland/natural;
snow and ice;
barren;
water bodies.
Table of all input variables
List of input variables used in our model ordered by SHAP value (from left to right and from top to bottom).
Bar plot of the SHAP values for the first 26 input variables in order of importance.
Comparison of the post-process-correction approach vs. the fully learned approach
(a) Post-process-corrected PM2.5 predictions against OpenAQ PM2.5 measurements. (b) Fully learned NOODLESALAD PM2.5 predictions against OpenAQ PM2.5 measurements.
Code and data availability
The Sentinel-3 SYNERGY land POPCORN dataset is openly available for download at https://a3s.fi/swift/v1/AUTH_ca5072b7b22e463b85a2739fd6cd5732/POPCORNdata/readme.html. The OpenAQ data are open data and available for download at https://openaq.org/. The OpenStreetMap data are open data and available for download at https://www.openstreetmap.org/. All the NASA data (MERRA-2, CALIOP, MODIS, ASTER DEM) used in this work are open data and can be found and downloaded using the NASA Earthdata Search website at 10.5067/ASTER/ASTGTM.003, https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/, https://www-calipso.larc.nasa.gov/, https://ladsweb.modaps.eosdis.nasa.gov/. The NASA Black Marble night lights data are available at https://blackmarble.gsfc.nasa.gov/. Code will be available from the authors upon reasonable request.
The contact author has declared that none of the authors has any competing interests.
Disclaimer
Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.
Acknowledgements
This study was funded by the European Space Agency EO Science for Society program via the NOODLESALAD project (contract number 4000137651/22/I-DT-lr). The research was also supported by the Research Council of Finland via the Finnish Centre of Excellence of Inverse Modelling and Imaging (project no. 353084), Flagship of Advanced Mathematics for Sensing Imaging and Modelling (grant no. 358944), and research project (grant no. 321761). The authors wish to acknowledge CSC – IT Center for Science, Finland, for computational resources.
Financial support
This research has been supported by the European Space Agency (grant no. 4000137651/22/I-DT-lr) and the Research Council of Finland (grant nos. 353084, 358944, and 321761).
Review statement
This paper was edited by Can Li and reviewed by two anonymous referees.
References Belward, A. S., Estes, J. E., and Kline, K. D.: The IGBP-DIS global 1-km land-cover data set DISCover: A project overview, Photogramm. Eng. Rem. S., 65, 1013–1020, 1999.Buchard, V., Da Silva, A., Randles, C., Colarco, P., Ferrare, R., Hair, J., Hostetler, C., Tackett, J., and Winker, D.: Evaluation of the surface PM2.5 in Version 1 of the NASA MERRA Aerosol Reanalysis over the United States, Atmos. Environ., 125, 100–111, 2016. Cohen, A. J., Brauer, M., Burnett, R., Anderson, H. R., Frostad, J., Estep, K., Balakrishnan, K., Brunekreef, B., Dandona,, L., Dandona, R., Feigin, V., Freedman, G., Hubbell, B., Jobling, A., Kan, H., Knibbs, L., Liu, Y., Martin, R., Morawska, L., Pope III, C. A., Shin, H., Straif, K., Shaddick, G., Thomas, M., van Dingenen, R., van Donkelaar, A., Vos, T., Murray, C. J. L., and Forouzanfar, M. H.: Estimates and 25-year trends of the global burden of disease attributable to ambient air pollution: an analysis of data from the Global Burden of Diseases Study 2015, Lancet, 389, 1907–1918, 2017. Fujisada, H., Urai, M., and Iwasaki, A.: Advanced methodology for ASTER DEM generation, IEEE T. Geosci. Remote, 49, 5080–5091, 2011. Fujisada, H., Urai, M., and Iwasaki, A.: Technical methodology for ASTER global DEM, IEEE T. Geosci. Remote, 50, 3725–3736, 2012.Geng, G., Zhang, Q., Martin, R., Donkelaar, A., Huo, H., CHE, H., Lin, J., and He, H.: Estimating long-term PM2.5 concentrations in China using satellite-based aerosol optical depth and a chemical transport model, Remote Sens. Environ., 166, 262–270, 10.1016/j.rse.2015.05.016, 2015.Global Modeling and Assimilation Office (GMAO): MERRA-2: Modern-Era Retrospective analysis for Research and Applications, Version 2, NASA Goddard Space Flight Center, https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/ (last access: 13 April 2023), 2015. Hammer, M. S., van Donkelaar, A., Li, C., Lyapustin, A., Sayer, A. M., Hsu, N. C., Levy, R. C., Garay, M. J., Kalashnikova, O. V., Kahn, R. A., Brauer, M., Apte, J. S., Henze, D. K., Zhang, L., Zhang, Q., Ford, B., Pierce, J. R., and Martin, R. V.: Global estimates and long-term trends of fine particulate matter concentrations (1998–2018), Environ. Sci. Technol., 54, 7879–7890, 2020.Handschuh, J., Erbertseder, T., and Baier, F.: Systematic Evaluation of Four Satellite AOD Datasets for Estimating PM2.5 Using a Random Forest Approach, Remote Sens., 15, 2064, 10.3390/rs15082064, 2023. Health Effects Institute: State of global air 2019, Health Effects Institute, ISSN 2578-6873, 2019.Ibrahim, S., Landa, M., Pešek, O., Brodský, L., and Halounová, L.: Machine Learning-Based Approach Using Open Data to Estimate PM2.5 over Europe, Remote Sens., 14, 3392, 10.3390/rs14143392, 2022.Keller, C. A., Knowland, K. E., Duncan, B. N., Liu, J., Anderson, D. C., Das, S., Lucchesi, R. A., Lundgren, E. W., Nicely, J. M., Nielsen, E., Ott, L. E., Saunders, E., Strode, S. A., Wales, P. A., Jacob, D. J., and Pawson, S.: Description of the NASA GEOS Composition Forecast Modeling System GEOS-CF v1.0, J. Adv. Model. Earth Syst., 13, e2020MS002413, 10.1029/2020MS002413, 2021.Lipponen, A., Reinvall, J., Väisänen, A., Taskinen, H., Lähivaara, T., Sogacheva, L., Kolmonen, P., Lehtinen, K., Arola, A., and Kolehmainen, V.: POPCORN Sentinel-3 aerosol optical depth (AOD) data for year 2019, Finnish Meteorological Institute and University of Eastern Finland [data set], https://a3s.fi/swift/v1/AUTH_ca5072b7b22e463b85a2739fd6cd5732/POPCORNdata/readme.html (last access: 13 April 2023), 2019.Lipponen, A., Kolehmainen, V., Kolmonen, P., Kukkurainen, A., Mielonen, T., Sabater, N., Sogacheva, L., Virtanen, T. H., and Arola, A.: Model-enforced post-process correction of satellite aerosol retrievals, Atmos. Meas. Tech., 14, 2981–2992, 10.5194/amt-14-2981-2021, 2021.Lipponen, A., Reinvall, J., Väisänen, A., Taskinen, H., Lähivaara, T., Sogacheva, L., Kolmonen, P., Lehtinen, K., Arola, A., and Kolehmainen, V.: Deep-learning-based post-process correction of the aerosol parameters in the high-resolution Sentinel-3 Level-2 Synergy product, Atmos. Meas. Tech., 15, 895–914, 10.5194/amt-15-895-2022, 2022. Loveland, T. R. and Belward, A.: The international geosphere biosphere programme data and information system global land cover data set (DISCover), Acta Astronaut., 41, 681–689, 1997.Lundberg, S. M. and Lee, S.: A unified approach to interpreting model predictions, CoRR, arXiv [preprint], 10.48550/arXiv.1705.07874, 22 May 2017.Michaelides, S., Lane, J., and Kasparis, T.: Effect of Vertical Air Motion on Disdrometer Derived Z-R Coefficients, Atmosphere, 10, 77, 10.3390/atmos10020077, 2019.NASA: CALIPSO Data User's Guide, National Aeronautics and Space Administration, https://www-calipso.larc.nasa.gov/resources/calipso_users_guide/ (last access: 13 April 2023), 2022.NASA Goddard Space Flight Center: MODIS Data Products in LAADS DAAC, NASA Earth Science Data and Information System (ESDIS), https://ladsweb.modaps.eosdis.nasa.gov/ (13 April 2023), 2019.NASA Goddard Space Flight Center: NASA Black Marble: Nighttime Lights Data, NASA Earth Observing System Data and Information System (EOSDIS), https://blackmarble.gsfc.nasa.gov/ (13 April 2023), 2024.NASA/METI/AIST/Japan Spacesystems, and US/Japan ASTER Science Team: ASTER Global Digital Elevation Model V003, NASA EOSDIS Land Processes DAAC [data set], 10.5067/ASTER/ASTGTM.003, 2019.NASA Langley Atmospheric Science Data Center: CALIOP: Cloud-Aerosol Lidar with Orthogonal Polarization Data, NASA Langley Research Center, https://www-calipso.larc.nasa.gov/ (13 April 2023), 2019.OpenAQ contributors: OpenAQ: Open Air Quality Dataset, https://openaq.org/ (last access: 13 April 2023), 2023.OpenStreetMap contributors: OpenStreetMap: Free Geographic Data, https://www.openstreetmap.org (last access: 13 April 2023), 2022.OpenStreetMap: OpenStreetMap Wiki – Key:highway, OpenStreetMap, https://wiki.openstreetmap.org/wiki/Key:highway (last access: 13 April 2023), 2023.Pope, C. A. I. and Dockery, D. W.: Health Effects of Fine Particulate Air Pollution: Lines that Connect, J. Air Waste Manage. Assoc., 56, 709–742, 10.1080/10473289.2006.10464485, 2006. Randles, C. A., da Silva, A., Buchard, V., Colarco, P. R., Darmenov, A. S., Govindaraju, R. C., Smirnov, A., Ferrare, R. A., Hair, J. W., Shinozuka, Y., and Flynn C.: The MERRA-2 aerosol reanalysis, 1980 onward. Part I: System description and data assimilation evaluation, J. Climate, 30, 6823–6850, 2017.Schneider, R., Vicedo-Cabrera, A. M., Sera, F., Masselot, P., Stafoggia, M., de Hoogh, K., Kloog, I., Reis, S., Vieno, M., and Gasparrini, A.: A Satellite-Based Spatio-Temporal Machine Learning Model to Reconstruct Daily PM2.5 Concentrations across Great Britain, Remote Sens., 12, 3803, 10.3390/rs12223803, 2020.Stafoggia, M., Bellander, T., Bucci, S., Davoli, M., de Hoogh, K., de' Donato, F., Gariazzo, C., Lyapustin, A., Michelozzi, P., Renzi, M., Scortichini, M., Shtein, A., Viegi, G., Kloog, I., and Schwartz, J.: Estimation of daily PM10 and PM2.5 concentrations in Italy, 2013–2015, using a spatiotemporal land-use random-forest model, Environ. Int., 124, 170–179, 10.1016/j.envint.2019.01.016, 2019.Sulla-Menashe, D. and Friedl, M. A.: User guide to collection 6 MODIS land cover (MCD12Q1 and MCD12C1) product, USGS, Reston, VA, USA, https://modis.ornl.gov/documentation/guides/MCD12_User_Guide_V6.pdf (last access: 13 April 2023), 2018.Taskinen, H., Väisänen, A., Hatakka, L., Virtanen, T. H., Lähivaara, T., Arola, A., Kolehmainen, V., and Lipponen, A.: High-Resolution Post-Process Corrected Satellite AOD, Geophys. Res. Lett., 49, e2022GL099733, 10.1029/2022GL099733, 2022. van Donkelaar, A., Martin, R. V., Spurr, R. J., Drury, E., Remer, L. A., Levy, R. C., and Wang, J.: Optimal estimation for global ground-level fine particulate matter concentrations, J. Geophys. Res.-Atmos., 118, 5621–5636, 2013.van Donkelaar, A., Martin, R. V., Brauer, M., Hsu, N. C., Kahn, R. A., Levy, R. C., Lyapustin, A., Sayer, A. M., and Winker, D. M.: Global Estimates of Fine Particulate Matter using a Combined Geophysical-Statistical Method with Information from Satellites, Models, and Monitors, Environ. Sci. Technol., 50, 3762–3772, 10.1021/acs.est.5b05833, 2016.van Donkelaar, A., Hammer, M. S., Bindle, L., Brauer, M., Brook, J. R., Garay, M. J., Hsu, N. C., Kalashnikova, O. V., Kahn, R. A., Lee, C., Levy, R. C., Lyapustin, A., Sayer, A. M., and Martin, R. V.: Monthly Global Estimates of Fine Particulate Matter and Their Uncertainty, Environ. Sci. Technol., 55, 15287–15300, 10.1021/acs.est.1c05309, 2021.Wang, Z., Shrestha, R., and Román, M. O.: VIIRS/NPP Lunar BRDF-Adjusted Nighttime Lights Yearly L3 Global 15 arc second Linear Lat Lon Grid, NASA Level-1 and Atmosphere Archive & Distribution System Distributed Active Archive Center [data set], 10.5067/VIIRS/VNP46A4.001, 2020. Winker, D. M., Pelon, J., Coakley Jr., J. A., Ackerman, S. A., Charlson, R. J., Colarco, P. R., Flamant, P., Fu, Q., Hoff, R. M., Kittaka, C., Kubar, T. L., Le Treut, H., Mccormick, M. P., Mégie, G., Poole, L., Powell, K., Trepte, C., Vaughan, M. A., and Wielicki, B. A.: The CALIPSO mission: A global 3D view of aerosols and clouds, B. Am. Meteorol. Soc., 91, 1211–1230, 2010.World Health Organization: New WHO Global Air Quality Guidelines aim to save millions of lives from air pollution, World Health Organization, https://www.who.int/news/item/22-09-2021-new-who-global-air-quality-guidelines-aim-to-save-millions-of-lives-from-air-pollution (last access: 12 April 2023), 2021.Zhang, H. and Kondragunta, S.: Daily and Hourly Surface PM2.5 Estimation From Satellite AOD, Earth and Space Science, 8, e2020EA001599, 10.1029/2020EA001599, 2021.