Characterising low-cost sensors in highly portable platforms to quantify personal exposure in diverse environments
- 1Department of Chemistry, University of Cambridge, Cambridge, CB2 1EW, UK
- 2Atmospheric Sensors Ltd, Bedfordshire, SG19 3SH, UK
- 3MRC-PHE Centre for Environment & Health, Imperial College London and King's College London, London, W2 1PG, UK
- 4College of Environmental Sciences and Engineering, Peking University, Beijing, 100871, China
- 5Department of Analytical, Environmental and Forensic Sciences, King's College London, London, SE1 9NH, UK
- 6Department of Chemistry, University of York, York, YO10 5DD, UK
- 7The Beijing Innovation Center for Engineering Science and Advanced Technology, Peking University, Beijing, 100871, China
- 8NIHR Health Protection Research Unit in Health Impact of Environmental Hazards, King's College London, London, SE1 9NH, UK
- 9National Heart and Lung Institute, Imperial College London, SW3 6LR, UK
- These authors contributed equally to this work.
Correspondence: Lia Chatzidiakou (firstname.lastname@example.org)
The inaccurate quantification of personal exposure to air pollution introduces error and bias in health estimations, severely limiting causal inference in epidemiological research worldwide. Rapid advancements in affordable, miniaturised air pollution sensor technologies offer the potential to address this limitation by capturing the high variability of personal exposure during daily life in large-scale studies with unprecedented spatial and temporal resolution. However, concerns remain regarding the suitability of novel sensing technologies for scientific and policy purposes. In this paper we characterise the performance of a portable personal air quality monitor (PAM) that integrates multiple miniaturised sensors for nitrogen oxides (NOx), carbon monoxide (CO), ozone (O3) and particulate matter (PM) measurements along with temperature, relative humidity, acceleration, noise and GPS sensors. Overall, the air pollution sensors showed high reproducibility (mean , min–max: 0.80–1.00) and excellent agreement with standard instrumentation (mean , min–max: 0.54–0.99) in outdoor, indoor and commuting microenvironments across seasons and different geographical settings. An important outcome of this study is that the error of the PAM is significantly smaller than the error introduced when estimating personal exposure based on sparsely distributed outdoor fixed monitoring stations. Hence, novel sensing technologies such as the ones demonstrated here can revolutionise health studies by providing highly resolved reliable exposure metrics at a large scale to investigate the underlying mechanisms of the effects of air pollution on health.
Emerging epidemiological evidence has associated exposure to air pollution with adverse effects on every major organ system (Thurston et al., 2017). Most of this evidence comes from western Europe and North America (Newell et al., 2017) as population-scale air pollution health studies have largely relied on available outdoor air pollution measurements from fixed monitoring stations (COMEAP, 2018). Due to limitations in the availability of monitoring networks in low- and middle-income countries (LMICs), the effects of air pollution on health have been under-researched in these settings. A clear need exists for more direct epidemiological evidence in diverse geographical settings with varying air pollution sources considering the high likelihood that health effects of air pollution are not linear and cannot be simply transcribed from the western world to LMICs (Tonne, 2017).
Secondly, the low spatial and temporal resolution of exposure metrics at postcode level or coarser, which are often employed in large-scale epidemiological research, cannot separate the individual health effects of pollutants, which are generally highly correlated at these coarser scales. Additionally, outdoor measurements cannot capture the total personal exposure that results from the cumulative effects of an individual moving between different indoor and outdoor microenvironments. During daily life, peak exposure events often occur during commuting (Karanasiou et al., 2014) while the indoor environment is a significant site for exposure in part because people spend as much as 90 % of their time indoors (Klepeis et al., 2001). Indoor air is affected by outdoor pollutants penetrating building envelopes with additional indoor sinks, sources and emissions from building materials which cannot be detected by fixed outdoor monitoring networks. The lack of information on indoor environments at the population scale is a significant factor in poorly quantified health risks. As a result, inaccurate personal exposure estimations to air pollution introduce both bias and error in health estimations, ultimately preventing epidemiological research from moving from general to specific associations (Zeger et al., 2000).
Rapid advancements in novel sensing technologies of air pollution sensors now offer the potential to monitor detailed personal exposure during daily life at the population scale, thanks to their significantly reduced cost, smaller size and fast response. Instrument development is accelerating fast with a growing number of companies utilising combinations of such sensors (Cross et al., 2017) as well as auxiliary components to build different types of monitors (Morawska et al., 2018). As a special case, it is now estimated that there are currently over 30 000 sensors operating in China to monitor concentrations of air pollutants (Morawska et al., 2018). Several studies over the last 15 years have attempted to quantify personal exposure to air pollutants by employing portable sensors, but most of those studies have been restricted to small-scale surveys (Steinle et al., 2013). However, large-scale studies are necessary to assess the health effects of harmful pollutants because they are often seen in only small subgroups of the population due to varying individual susceptibility and exposure profiles. Novel sensing technologies are in fact the only method to expand the personal exposure coverage at the population level. Yet, concerns remain about the validation and quality control of those sensors (Castell et al., 2017) as few personal exposure studies have evaluated their performance in field deployment conditions (Rai et al., 2017). Typically, novel sensing platforms are exclusively evaluated in outdoor static co-locations with reference instruments and they only target small numbers of pollutants, most commonly ozone, nitrogen dioxide (Lin et al., 2015) and/or particulate matter (Holstius et al., 2014; Feinberg et al., 2018).
To address these shortcomings, a highly portable personal air pollution monitor (PAM) that measures a large number of chemical and physical parameters simultaneously has been developed. This paper aims to evaluate the performance of the PAM when capturing total personal exposure to air pollution in diverse environmental conditions. To do so, the PAM performance was assessed in well-characterised outdoor, indoor and commuting microenvironments across seasons and different geographical settings. The PAM has already been deployed to participants of two large cardiopulmonary cohorts in China (Han et al., 2019) (AIRLESS- Theme 3 APHH project) (Shi et al., 2019) and the UK (COPE) (Moore et al., 2016), and in a number of smaller international pilot projects in North America, Europe, South and East Asia, and Africa. This is the first of a series of publications that aim to capture total personal exposure to a large number of pollutants at unprecedented detail, and together with medical outcomes, to identify underlying mechanisms of specific air pollutants on health. As the field of novel air pollution sensing technologies expands rapidly, this paper further aims to provide methodological guidance to researchers from diverse disciplines on how to comprehensively calibrate and validate portable monitors suitable for personal exposure quantification.
The PAM has been developed at the Department of Chemistry, University of Cambridge in collaboration with Atmospheric Sensors Ltd. It is now commercially available (independently from the University of Cambridge) from Atmospheric Sensors Ltd (model AS520, http://www.atmosphericsensors.com, last access: 22 August 2019). The PAM (Fig. 1) is an autonomous platform that incorporates multiple sensors of physical and chemical parameters (Table 1). The compact and lightweight design of the PAM (ca. 400 g) makes the unit suitable for personal exposure assessment. The PAM is almost completely silent and can operate continuously. No other input is required by the user other than to place it for periodic charging (e.g. daily) and data upload in a base station. The measurements are also stored in an SD card inside the monitor and uploaded through a general packet radio service (GPRS) to a secure access FTP server. Customised system software has been developed to optimise the performance of the platform. Depending on the chosen sampling interval of either 20 s or 1 min, the battery life on a single charge lasts for 10 h or 20 h respectively. The combined cost of the sensors alone is less than GBP 600 and the total cost of the PAM is less than GBP 2000, making it a “lower-cost” system (Cross et al., 2017).
User-friendly, bespoke software (Fig. S1) has been developed to automate the management and post-processing of the large volume of raw data collected with the PAM network. Data are held in a PostgreSQL relational database management system, which has an unlimited row-storage capacity and allows the querying of large quantities of data in a flexible manner while maintaining performance as the volume of data grows. Post-processing was performed in R software (R Development Core Team, 2008) (Fig. S1) following the methodology outlined in this paper.
2.1 Measurements of CO, NO, NO2 and O3
The principle of operation of all commercially available miniaturised gaseous sensors currently involves measuring changes in specific properties of a sensing material (e.g. electrical conductivity, capacitance, mass, optical absorption) when exposed to a gas species (Morawska et al., 2018). The PAM integrates small (20 mm diameter) electrochemical (EC) sensors based on an amperometric principle of operation (Stetter and Li, 2008) for the quantification of carbon monoxide (CO), nitric oxide (NO), nitrogen dioxide (NO2) and ozone (O3). These EC sensors are the A4 variant from Alphasense (NO-A4, Alphasense Ltd, 2016a; CO-A4, Alphasense Ltd, 2017a; NO2-A43F, Alphasense Ltd, 2016b; Ox-A431, Alphasense Ltd, 2017b) and operate on a four-electrode system. The principle of operation of the four-electrode system is identical to that of the earlier variants of the three-electrode system (Alphasense, 2013a) where the conventional setup of working electrode, counter electrode and reference electrode is supplemented with an additional electrode, the auxiliary (or non-sensing) electrode, to compensate for the temperature dependence of the cell potential (Popoola et al., 2016). Earlier variants of EC sensors used in this paper have been extensively characterised in laboratory conditions and in static outdoor dense sensor networks (Mead et al., 2013). Those studies provided evidence that, after appropriate post-processing, the sensors had a linear response to the targeted pollutants and achieved excellent performance with limits of detection (LOD) < 4 ppb demonstrating their suitability for atmospheric air quality measurements. The linearity and LOD of the four-electrode sensors (when integrated in the PAM) have been tested under laboratory conditions following the same methodology as described in Mead et al. (2013) yielding very similar results.
Currently, standards for the calibration and performance evaluation of EC sensors focus on industrial applications (British Standards Institution, 2017). Following those standards, a widely adopted approach to calibrate EC sensors is gas chamber experiments to determine offset (baseline) and sensitivity (gain). To address the lack of standards for novel sensing technologies, a number of researchers and governmental organisations are developing protocols and guidelines to evaluate sensor and monitor performance in the laboratory and in the field, such as the European Metrology Research Programme of EURAMET (Spinelle et al., 2013), the European Standardisation Committee (CEN/TC 264/WG 42, 2018) and US-based groups (Long et al., 2014; AQ-Spec, 2017).
Building on those protocols, the EC sensors were calibrated by co-location with certified reference instruments in similar environmental conditions and the same geographical area where the monitors had been or were to be deployed. The considerable advantage of this approach over laboratory calibration includes the exposure of the sensor to the actual air pollution and temperature–relative humidity conditions under which it is expected to operate, as well as the assessment of any site-specific potential cross-interferences. A linear regression model (Eq. 1) was applied to the co-location data to determine the calibration parameters used to convert raw sensor signals (mV) to mixing ratios (ppb). Temperature effects were corrected through the auxiliary electrode (AE), which might have a different sensitivity to the working electrode (WE, a≠b). The cross-sensitivities between the NO2 and O3 measurements were corrected via parameter c (the cross-sensitive gas Y is NO2 for O3 measurements and vice versa). As the CO and NO sensors were found to be sufficiently selective, c was set to zero for the calibration of those sensors.
where [X]ref is the reference measurement of pollutant X (ppb), a is the sensitivity of the working electrode (ppb mV−1), WEX and AEX are the raw signal of the working and auxiliary electrodes respectively (mV), b is the sensitivity of the auxiliary electrode (ppb mV−1) (accounts for temperature), c is the cross sensitivity with gas Y (ppb mV−1; c=0 for CO and NO), WEY is the raw signal of the working electrode of the cross-sensitive gas Y (mV), and d is the intercept (ppb).
To evaluate the performance of the linear model, the datasets were split into training (i.e. calibration) and validation periods to first extract the calibration parameters and then apply them to the validation set and compare the measurements with those from reference instruments (referred to as the “calibration–validation” method). The training sets ranged from 1 to 16 d, and the adjusted coefficient of determination () remained stable for training periods longer than 3 d. Therefore, approximately a third of the dataset was selected as a training set. As relationships in these linear models should ideally not be extrapolated beyond the range of the observations (including meteorological conditions), the calibration periods covered the temperature and concentration ranges in which the sensors were deployed (Cross et al., 2017). Once the performance of the model was established in diverse environments, we used the full co-location periods to determine the agreement between PAM sensors and reference instruments.
2.2 Particulate mass measurements
The operation of virtually all miniaturised particulate matter (PM) sensors that are currently commercially available is based on the light-scattering principle, either volume scattering devices or optical particle counters (OPCs) (Morawska et al., 2018). The PAM integrates a commercially available miniaturised OPC (Alphasense OPC-N2; Alphasense Ltd, 2018), which uses Mie scattering for real-time aerosol characterisation (Mie, 1908). Particles pass through a sampling volume illuminated by a light source (in this case a laser) and scatter light into a photodetector (Bohren and Huffman, 1983). The amplitudes of the detected scattering signal pulses are then related to particle size. The OPC counts these pulses and typically sorts them into different particle size bins (Walser et al., 2017). The OPC-N2 classifies particles in 16 sizes (bins) in the range 0.38–17 µm. The performance of this OPC in the laboratory (AQ-Spec, 2017; Sousan et al., 2016) showed a high degree of linearity. Similarly studies evaluating the OPC performance in outdoor static deployments (Di Antonio et al., 2018; Crilley et al., 2018) showed that once site- and season-specific calibrations were applied, the miniaturised sensor could be used to quantify number and mass concentrations of particles with a precision similar to other standard commercial reference optical PM instruments.
The complexity of evaluating PM sensor performance is much greater than that of gas sensors. Compared with standard instrumentation, optical PM instruments face four inherent limitations which introduce potential differences in mass estimations compared with reference gravimetric methods.
Exposure of the particles to relative humidity (RH) results in hygroscopic growth of particles and leads to mass overestimation (Di Antonio et al., 2018).
Small variations in the sensitivities of the photodetector and the intensity/angle of the laser may result in a systematic error specific to each OPC sensor. Additionally, as particles enter the optical chamber, they may deposit on internal surfaces and optics of the sensor, leading to a reduction in the measured scattered light and thus instrument sensitivity.
A further limitation of all optical methods is their inability to detect particles with diameters below a certain size, typically 200–400 nm (Morawska and Salthammer, 2003).
Finally, optical methods cannot distinguish the physical and chemical parameters of the aerosol (e.g. density, hygroscopicity, volatility), which might vary significantly as people move between different microenvironments with diverse emission sources, further increasing the uncertainty of mass estimation.
(a) To compensate for these limitations, this work first corrected for the effect of RH by applying an algorithm based on the particle size distribution which was developed for aerosols in urban environments (Di Antonio et al., 2018). (b) In the second step, a scaling factor for each OPC was determined to account for sensor–sensor variability. This scaling factor was determined from a linear fit between the RH-corrected mass and the reference measurements for each season independently and to compensate for instrument sensitivity that may change over time. (c) As the reference instruments (e.g. TEOM) include particles below the size range of the OPC in their mass estimations, the scaling factor partly addresses the under-prediction of mass due to undetected smaller particles which may vary between seasons. The varying aerosol composition (d) remains a challenge, and therefore a constant density of 1.65 g cm−3 was assumed. Although the OPC is able to measure PM1, PM2.5 and PM10, this paper focusses on the performance of the PM2.5 measurements because of the availability of reference instruments.
In the following three sections the performance of the PAM is assessed when measuring air pollution concentrations in different environments that are relevant for the quantification of total personal exposure (outdoor, indoor and in movement) in the UK and China. Sensor performance may vary significantly with season (e.g. temperature and RH artefacts) while meteorological conditions may affect the variation in outdoor air pollution levels directly (e.g. stability of the atmosphere) and indirectly by socioeconomic patterns (e.g. increased energy demand for heating). Similarly, indoor air may be directly affected by outdoor air pollution levels and indirectly through occupants' behavioural patterns (e.g. window adjustment to achieve thermal comfort). Taking into account the strong seasonal variation in air pollution levels, the performance of the PAM was evaluated by co-locating one or multiple PAMs with reference instruments during both the “heating” (when the majority of householders heat their home on a regular basis) and “non-heating” seasons. The residential central heating season in Beijing is from 15 November to 15 March (Beijing municipal government), while in the UK the equivalent heating season is 5.6 months (October–March/April) (BRE, 2013).
The description of the sites, principle of operation and models of certified reference instrumentation used can be found in Table 2. The co-locations in China involved 60 PAMs which had been previously deployed to 250 participants of a cardiopulmonary cohort for 1 month during the heating season and 1 month during the non-heating season (Han et al., 2019). The co-location in the UK involved 60 PAMs that have been previously deployed to 150 participants of a COPD cohort for 2 years continuously (Moore et al., 2016). The reproducibility between co-located sensors was very high even when the ambient concentrations were close to the LOD (mean R2≥0.80 for EC sensors and R2≥0.91 for the OPC; see Fig. 2 and Table S1 in the Supplement). Hence, the performance of the selected PAMs in static deployments as described in this section is representative and can be extrapolated to the entire sensor network.
* Due to malfunctioning of the TEOM in PKU during the non-heating season, measurements from a TEOM at a nearby governmental site (Haidianwanliu, time resolution 1 h) were used. NA: not available.
3.1 Outdoor performance of sensors in diverse urban environments with varying pollution profiles and meteorological parameters
In total, four outdoor co-location deployments have been evaluated to comprehensively characterise the performance of the sensors (in the UK and China during the heating and non-heating seasons; see Table 3). The PAMs were placed in protective shelters close to the inlets of the certified air pollution monitoring stations. The sensor measurements were converted to physical units following the methodology described in Sect. 2.1 and 2.2.
As an illustrative example, the outdoor co-location in Beijing, China (19 days, December 2016 to January 2017), is presented in Fig. 3 to demonstrate the previously mentioned calibration–validation method (Sect. 2.1). The time series of the pollutants measured by the PAM (blue) closely follow the reference instruments (red) in both the calibration (Fig. 3a) and validation (Fig. 3b) periods. Similarly, the time series and scatterplots of the other three co-locations (UK in the heating season, China and UK in the non-heating season) can be found in the Supplement (Figs. S2–S4).
Table 3 gives a quantitative overview of the agreement between the PAM measurements and the reference instruments in outdoor co-locations during the heating and non-heating seasons. Ambient temperature and RH (median, range: 5 %–95 %) as well as the mean and maximum pollutant concentration measured are presented to describe the ambient conditions of each co-location. Because the PAM internal temperature is on average 7 ∘C higher than the ambient temperature due to heat generated by the internal battery, the internal conditions the sensors were exposed to are also presented. The sensor performance was evaluated against the reference instruments using (1) of the linear regression between PAM and the reference and (2) the root-mean-square error (RMSE) using both the validation and calibration periods (Table 3). may be a misleading indicator of sensor performance when measurements are taken close to the LOD of the instruments. The RMSE can be a complementary parameter of for the evaluation of performance, as it summarises the mean difference between measurements from the sensor and certified instruments. The average values of and RMSE of all N sensors during all co-locations are given in Table 3.
a Due to unavailable data, PM mass measurements are not corrected for RH effects. b Comparison with governmental station ∼ 3 km away.
3.1.1 Outdoor performance of the PAM during the heating season co-locations
During the heating season outdoor co-locations of a number of PAMs next to certified reference instruments, ambient temperatures ranged from −4 to 6 ∘C in China and between 4 and 14 ∘C in the UK. Air pollution in China was characterised by elevated levels of CO and PM2.5 (Table 3) for extended time periods (haze events) partially driven by stagnant winds or a weak southerly wind circulation (Shi et al., 2019). Compared with pollutant levels in the UK, the concentrations of CO and PM2.5 were approximately 10 times higher while the contrast in ambient NO2 levels was less marked with levels in China only approximately 3-fold higher.
The O3, NO and NO2 sensors exhibited an excellent performance () in both geographical settings (Table 3). The median RMSE values were close to the LOD of the sensors (< 3 ppb) in the UK and slightly higher in China (< 12 ppb) (Fig. 3, Table 3). In both deployments, the RMSE values of these gaseous sensors were negligible compared to the ambient concentration ranges of the targeted pollutants (less than 16 % of the maximum mixing ratio recorded by the reference instruments).While the median between the CO sensor and the corresponding reference was reasonably high in both outdoor deployments (≥0.74), the median RMSE values were also quite large (< 32 ppb). In fact, this is due to the known high intrinsic noise and LOD of the reference instrumentation (> 40 ppb, Thermo Fischer Scientific, 2017), which is much higher compared to that of the electrochemical sensors (LOD < 4 ppb; see Sect. 2.1).
Following the correction of the size-segregated particle measurements for the effect of RH (Sect. 2.2), the PM mass quantification with the miniaturised OPC agrees with the TEOM reference instrument with an adjusted of 0.93. The low RMSE values (> 8.6 % of the maximum concentration) demonstrate that the scaling factor adequately addresses the under-prediction of mass due to undetected smaller particles when derived from field calibration in the local environment. Due to unavailable measurements, the PM measurements in the UK could not be corrected for RH effects, which resulted in only a moderate correlation with the reference instrument (, Fig. S2).
3.1.2 Outdoor performance of the PAM during the non-heating season co-locations
One outdoor co-location in China (Fig. S3) and one in the UK (Fig. S4) were performed during the non-heating season, both over periods of 2 weeks (Table 3). In the UK, seasonal variation in ambient temperatures, RH and pollution levels was relatively small. In contrast, in China, seasonal variation was large with ambient temperatures reaching up to 36.3 ∘C (median: 29.9 ∘C) and generally lower pollution levels compared to the heating season. However, in both geographical settings, O3 was significantly elevated. The performance of the O3 sensor remained reliable in all deployments with median 0.80 and RMSE values < 15 ppb, which might provide valuable insights into the health effects of this pollutant because (a) ozone is a strong oxidant with a high potential to affect the body (Nuvolone et al., 2018) and (b) has the highest concentrations during the non-heating season compared to other pollutants which usually peak during the heating season.
Due to a malfunction of the PM reference (TEOM) instrument during the non-heating season at PKU, the PAM PM measurements had to be compared with a TEOM installed at a nearby governmental site (Haidianwanliu). Although not closely co-located (∼ 3 km), the gradient between the PAMs and reference measurements was close to unity (average m=0.96, see example Fig. S3) and there was still a notable correlation () with a median RMSE of 25 µg m−3, indicating that away from direct sources PM concentrations are essentially homogenous over relatively large urban areas. Compared with the heating season, PM concentrations in China were significantly lower, whereas PM levels in the UK varied little with season. After correcting for the effects of RH on PM, the PAM performance in the UK during the non-heating season significantly improved compared with the heating season (RMSE = 2 µg m−3 within the particle size range 0.38–17 µm).
While the performance of the O3 and OPC sensors remained reliable across seasons and geographical settings, the performance of the CO, NO and NO2 sensors decreased significantly () during the hottest parts of the non-heating season in China due to extreme temperatures (internal median temperatures of the PAM: 40.2 ∘C, 5 %–95 %: 32.7–45.8 ∘C, Table 3). It should be noted that NO levels were close to the LOD of the sensor, which also affects the values. We conclude that the measurements of the CO, NO and NO2 sensors should be interpreted with caution when the sensors are exposed to temperatures above 40 ∘C. However, during the field deployment to participants, the sensors were exposed to lower temperatures (see Fig. S5) that did not impact on their performance (see Sect. 3.2).
3.2 Indoor performance of the NO2 and PM sensors
Low-cost air pollution sensors have generally been characterised outdoors next to reference instruments as described in the previous section. However, little is known about the performance of these sensors in indoor environments, where people spend most of their time (Klepeis et al., 2001), and environmental conditions (e.g. temperature, RH) and emission sources may be significantly different compared with nearby outdoor environments.
To evaluate the indoor performance of the NO2 and the OPC sensors, an experiment in an urban flat in central Beijing was performed during the non-heating season (May 2017). One PAM was deployed in the living area next to two commercial instruments that were used to provide reference measurements: (1) a cavity attenuated phase shift spectroscopy instrument (CAPS Teledyne T500U) for NO2 and (2) a portable commercial spectrometer (GRIMM 1.108) for particulate matter measurements (Table 2). During the experiment the occupants relied on natural ventilation, adjusting the windows freely to achieve thermal comfort. Median indoor temperatures were 26.0 ∘C (5 %–95 % range: 17.1–28.8 ∘C), and the median internal PAM temperature was 33.0 ∘C (5 %–95 % range: 24.3–36.2 ∘C), which is comparable with the temperature range during the non-heating season field deployment to participants (internal median temperature: 35.0 ∘C, 5 %–95 % range: 28.5–39.9 ∘C, Fig. S5).
The conversion of the raw measurements to parts per billion used the sensitivities extracted using outdoor co-locations during both the heating and non-heating seasons (Sect. 3.1) with the linear model (Sect. 2.1). The performance of the low-cost sensors in the indoor environment (Figs. 4 and S6) was comparable to the outdoor performance demonstrated in the previous section (, gradient m=1.1, RMSE = 3 ppb for NO2 (Fig. 4c) and , gradient m=0.86, RMSE = 7 µg m−3 for PM2.5 (Fig. 4d)), proving their suitability to quantify indoor air pollution levels for these species provided they have been adequately calibrated in the local environment.
Although this short experiment is only a “snapshot” of indoor exposure, it shows that the measurement error of the PAM relative to established commercial instruments is negligible compared with the error in indoor exposure estimates introduced from using inadequate exposure metrics, in this case outdoor measurements from the closest monitoring reference site. For example, using outdoor measurements from the closest monitoring station would have resulted in an over-prediction of indoor PM2.5 concentrations (moderated by attenuation effects of the building envelope) with an average difference of 30 µg m−3 (standard deviation: 29 µg m−3), which is significantly higher than the 7 µg m−3 RMSE value of the PAM (Fig. 4f). While indoor NO2 levels broadly followed outdoor levels, the range of the error in under-predicting and over-predicting exposure events is much broader (min–max range: −18 to 18 ppb; Fig. 4e) compared with the error introduced from measurement uncertainties (−7 to 5 ppb). Such peak exposure events might be important triggers for acute health responses.
3.3 Performance of the PAM in non-static configurations
The aim of this section is to evaluate the PAM reproducibility and accuracy while in movement, with pedestrian and in-vehicle deployments.
3.3.1 Reproducibility of the PAM when not static
Multiple (in this case nine) PAMs were carried by a pedestrian while keeping an activity diary and walking between two indoor environments via a highly trafficked road in Cambridge, UK (weekday in January). Using NO measurements (the main traceable component from combustion engines) as an illustrative example, Fig. 5a shows the simultaneous measurements of all PAMs as a time series and the scatterplots between the measurements of two of those PAMs separated into indoor (Fig. 5b) and outdoor data (Fig. 5c).
Significant changes of the pollution levels were observed when moving between the different environments, illustrating the high granularity of personal exposure in daily life. Compared with the indoor environments, walking in traffic resulted in elevated pollution exposure events. As illustrated in the time series of Fig. 5, the difference in pollution levels between the three micro-environments was significantly higher than the variability between PAM measurements.
Table 4 gives an overview of the correlations within the co-located moving network. In indoor environments an excellent agreement between all sensors (median R2>0.96) was found, indicating a high sensor reproducibility. An exception was the O3 sensor, which showed poor between-sensor reproducibility due to very low indoor and outdoor concentrations (< 5 ppb) near the LOD of the sensor. The between-sensor correlations in the road environment were lower than indoors (median R2>0.85) due to highly heterogeneous air pollution concentrations driven by complex factors (e.g. canyon air mixing, moving vehicle sources, topology). This signifies that in such environments air pollution concentrations might differ on such short spatial and temporal scales that even sensors that are less than 1 m apart from each other capture a slightly different exposure profile.
When moving rapidly between different environments with different temperatures (i.e. from outdoors to a warmer indoor microenvironment) false peaks were observed in the EC sensor measurements (Fig. S7) (Alphasense Ltd, 2013b). The response and recovery time following rapid temperature transitions was found to vary for different sensor types. To account for the false sensor responses, first an algorithm to identify those events was developed and then a 15 min window for CO and a 5 min window for NO, NO2 and O3 measurements was removed from the data (Figs. S7 and S8). Though it potentially excludes peak exposure events as rapid temperature changes often occur when people leave heated buildings and enter (colder) traffic environments to commute, this correction method typically removes less than 0.1 % of the exposure dataset under daily life conditions. The PM measurements are not affected by these temperature transitions.
3.4 Accuracy of the PAM when not static
A PAM was mounted on the roof of a battery-powered vehicle equipped with multiple commercial instruments (Table 2) mapping air pollution levels in London at speeds of up to 60 km h−1 for 1 d during the non-heating season (Fig. 6). The PAM was mounted on the roof with the OPC inlet facing forwards and the EC sensors facing to the sides. The reference instrument inlets were located on the car roof as well. There was no correlation between car speed and RMSE values in the gaseous and particulate measurements. The OPC contains an airflow measurement unit which compensates for any wind or internal flow dependence.
Considering the high spatial variability of air pollution in traffic environments (see Sect. 3.3.1), the accuracy of the PAM in a mobile configuration was high for all targeted pollutants (). To illustrate the large degree of variability of air pollution concentrations over time, the investigated area was mapped throughout the day multiple times with the highest concentrations of PM2.5 and NO2 recorded during the morning rush hour.
Mounting evidence points towards a causal link between exposure to air pollution and health outcomes. However, due to current limitations in cost, maintenance and availability of instrumentation, most large-scale health studies have focused on developed countries and have relied on low-spatial- and low-temporal-resolution (generally outdoor) air quality data as metrics of exposure, severely limiting causal inferences in epidemiological research worldwide. Emerging low-cost sensing technologies can offer a potential paradigm shift in capturing personal exposure of the population during daily life in addressing this critical shortcoming.
In this paper we demonstrated that, with suitable calibration and post-processing, the performance of currently available low-cost air quality sensors, in this case incorporated into a highly portable personal monitor (the PAM), is comparable with the performance of reference instrumentation across a wide range of conditions:
in diverse outdoor environments (urban background and traffic);
across seasons (over a wide temperature and RH range);
in two geographical settings with differing air pollution levels and meteorological profiles (UK and China);
in indoor environments (residential, laboratory, café)
with varying emission sources, and
in static and in non-static deployments.
A critical important outcome of this study is that the performance of the sensors substantially exceeds that needed to quantify the differences between indoor and outdoor pollution levels, and thus to quantify exposure levels in a reliable manner.
There are certain performance caveats with the low-cost sensors used in this study, which once identified are likely to be addressed in future generations of sensors.
The performances of the CO, NO and NO2 sensors were found to degrade at temperatures above 40 ∘C. In fact, such extreme environmental conditions were not encountered during the actual personal exposure sample periods for which the PAMs were used, and the performance criteria discussed above were met.
A limitation of all optical PM sensors, low-cost or reference, is that they cannot measure small particles below a critical size threshold (typically 200–400 nm). In this work we show that by appropriate local calibration, this shortcoming can be largely accounted for.
The toxicity of particles is also likely to depend on their chemical composition (Kelly and Fussell, 2015). Most national networks measure total mass only, and measuring particle chemical composition is currently largely the domain of the research community. A major challenge will be to develop techniques to allow routine PM composition measurements, for both the regulatory networks and applications such as personal monitoring.
The key conclusion is that when suitably operated, highly portable air pollution personal monitors can deliver traceable high-quality exposure metrics which can address scientific, health and policy questions for the indoor and outdoor environment in a way that has not been possible before. Mobile and static PAM networks have now been deployed in a range of health studies, and these will be the focus of future papers.
Research data supporting this paper are available at https://doi.org/10.17863/CAM.41918 (Chatzidiakou et al., 2019).
The supplement related to this article is available online at: https://doi.org/10.5194/amt-12-4643-2019-supplement.
LC and AK have contributed equally to this paper. It was conceptualised by LC, AK, BB and RLJ. The sensor platform was developed by LC and MK and deployed by LC, AK, YH, TW, HZ, QW and SF. The data curation was performed by LC, AK, OAMP, ADA, YH, FAS and SC. LC, AK, OAMP, ADA and RLJ contributed to the formal data analysis. Resources were provided by MH, JKQ, BB, FJK, TZ and RLJ. The software was developed by LC, AK and MK. Data were visualised by LC and AK. The original draft was written by LC and AK and reviewed and edited by OAMP, YH and RLJ.
The authors declare that they have no conflict of interest.
This article is part of the special issue “In-depth study of air pollution sources and processes within Beijing and its surrounding region (APHH-Beijing) (ACP/AMT inter-journal SI)”. It is not associated with a conference.
The authors would like to thank the following: Qiang Zhang and Kebin He (Tsinghua University) for PM outdoor data during the non-heating season, Paul Williams (University of Manchester) for providing the GRIMM instrument, and Envirotechnology Services for reference mobile measurements.
This research has been supported by the NERC (grant no. NE/N007085/1). This research has been jointly supported by the National Natural Science Foundation of China (NSFC grant 81571130100) as well as the Natural Environment Research Council (NERC grant NE/N007018/1) and the Medical Research Council of the UK (AIRLESS project). This research has also been supported by the Medical Research Council of the UK (MR/L019744/1) (COPE project).
This paper was edited by Yongjie Li and reviewed by three anonymous referees.
Alphasense Ltd: Alphasense Application Note AAN 104: How Electrochemical Gas Sensors Work, available at: http://www.alphasense.com/WEB1213/wp-content/uploads/2013/07/AAN_104.pdf (last access: 22 August 2019), 2013a.
Alphasense Ltd: Alphasense Application Note AAN 110 Environmental changes: temperature, pressure, humidity, available at: http://www.alphasense.com/WEB1213/wp-content/uploads/2013/07/AAN_110.pdf (last access: 22 August 2019), 2013b.
Alphasense Ltd: Technical specification, NO-A4 Nitric Oxide Sensor 4-Electrode, available at: http://www.alphasense.com/WEB1213/wp-content/uploads/2016/03/NO-A4.pdf (last access: 22 August 2019), 2016a.
Alphasense Ltd: Technical specification, NO2-A43F Nitrogen Dioxide Sensor 4-Electrode, available at: http://www.alphasense.com/WEB1213/wp-content/uploads/2018/12/NO2A43F.pdf (last access: 22 August 2019), 2016b.
Alphasense Ltd: Technical specification, CO-A4 Carbon Monoxide Sensor 4-Electrode, available at: http://www.alphasense.com/WEB1213/wp-content/uploads/2017/01/COA4.pdf (last access: 22 August 2019), 2017a.
Alphasense Ltd: Technical specification, OX-A431 Oxidising Gas Sensor Ozone and Nitrogen Dioxide 4-Electrode, available at: http://www.alphasense.com/WEB1213/wpcontent/uploads/2018/12/OXA431.pdf (last access: 22 August 2019), 2017b.
Alphasense Ltd: Technical Specification, OPC-N2, available at: http://www.alphasense.com/WEB1213/wp-content/uploads/2018/02/OPC-N2-1.pdf, last access: 19 November, 2018.
AQ-Spec: Air Quality Sensor Performance Evaluation Center (AQSPEC): Field evaluation of low-cost air quality sensors, available at: http://www.aqmd.gov/home (last access: 22 August 2019), 2017.
Bohren, C. F. and Huffman, D. R.: Absorption and scattering of light by small particles, Wiley, https://doi.org/10.1002/9783527618156, 1983.
BRE: Main heating systems (BRE report number 286733a), Building Research Establishment Ltd, 2013.
British Standards Institution: BS EN 50402:2017 Electrical apparatus for the detection and measurement of combustible or toxic gases or vapours or of oxygen, Requirements on the functional safety of gas detection systems, 2017.
Castell, N., Dauge, F. R., Schneider, P., Vogt, M., Lerner, U., Fishbain, B., Broday, D., and Bartonova, A.: Can commercial low-cost sensor platforms contribute to air quality monitoring and exposure estimates?, Environ. Int., 99, 293–302, https://doi.org/10.1016/J.ENVINT.2016.12.007, 2017.
CEN/TC 264/WG 42: Ambient air – Air quality sensors, VDI/DIN-Commission on Air Pollution Prevention (KRdL) – Standards Committee, Vienna, 2018.
Chatzidiakou, E., Krause, A., Popoola, O. A. M., Di Antonio, A., Kellaway, M., Han, Y., Squires, F. A., Wang, T., Zhang, H., Wang, Q., Fan, Y., Chen, S., Hu, M., Quint, J. K., Barratt, B., Kelly, F. J., and Zhu, T.: Research data supporting “Characterising low-cost sensors in highly portable platforms to quantify personal exposure in diverse environments”, Dataset, https://doi.org/10.17863/CAM.41918, 2019.
COMEAP: Committee on the Medical efeects of air pollutants, Long-term exposure to air pollution?: effect on mortality, Committee on the Medical Effects of Air Pollutants (COMEAP), Health Protection Agency, 2018.
Crilley, L. R., Shaw, M., Pound, R., Kramer, L. J., Price, R., Young, S., Lewis, A. C., and Pope, F. D.: Evaluation of a low-cost optical particle counter (Alphasense OPC-N2) for ambient air monitoring, Atmos. Meas. Tech., 11, 709–720, https://doi.org/10.5194/amt-11-709-2018, 2018.
Cross, E. S., Williams, L. R., Lewis, D. K., Magoon, G. R., Onasch, T. B., Kaminsky, M. L., Worsnop, D. R., and Jayne, J. T.: Use of electrochemical sensors for measurement of air pollution: correcting interference response and validating measurements, Atmos. Meas. Tech., 10, 3575–3588, https://doi.org/10.5194/amt-10-3575-2017, 2017.
Di Antonio, A., Popoola, O., Ouyang, B., Saffell, J., Jones, R., Di Antonio, A., Popoola, O. A. M., Ouyang, B., Saffell, J., and Jones, R. L.: Developing a Relative Humidity Correction for Low-Cost Sensors Measuring Ambient Particulate Matter, Sensors, 18, 2790, https://doi.org/10.3390/s18092790, 2018.
Feinberg, S., Williams, R., Hagler, G. S. W., Rickard, J., Brown, R., Garver, D., Harshfield, G., Stauffer, P., Mattson, E., Judge, R., and Garvey, S.: Long-term evaluation of air sensor technology under ambient conditions in Denver, Colorado, Atmos. Meas. Tech., 11, 4605–4615, https://doi.org/10.5194/amt-11-4605-2018, 2018.
Han, Y., Chen, W., Chatzidiakou, L., Yan, L., Wang, Y., Cai, S., Krause, A., Fan, Y., Wang, T., Hu, Y., Chen, X., Xue, T., Xie, W., Zhou, B., Han, X., Jin, A., Luo, Y., Zhu, Y., Xie, G., Lu, X., Hu, X., Tan, H., Wang, J., Fang, S., Qiu, X., Chan, Q., Barratt, B., Ezzati, M., Elliott, P., Jones, R., Zhao, M., Liu, J., Zhang, J., Wu, Y., Kelly, F. J., and Zhu, T.: Effects of AIR pollution on cardiopuLmonary disEaSe in urban and peri-urban reSidents in Beijing: protocol for the AIRLESS study, BMC Public Health, 2019.
Holstius, D. M., Pillarisetti, A., Smith, K. R., and Seto, E.: Field calibrations of a low-cost aerosol sensor at a regulatory monitoring site in California, Atmos. Meas. Tech., 7, 1121–1131, https://doi.org/10.5194/amt-7-1121-2014, 2014.
Karanasiou, A., Viana, M., Querol, X., Moreno, T., and de Leeuw, F.: Assessment of personal exposure to particulate air pollution during commuting in European cities – Recommendations and policy implications, Sci. Total Environ., 490, 785–797, https://doi.org/10.1016/J.SCITOTENV.2014.05.036, 2014.
Kelly, F. J. and Fussell, J. C.: Linking ambient particulate matter pollution effects with oxidative biology and immune responses, Ann. NY Acad. Sci., 1340, 84–94, https://doi.org/10.1111/nyas.12720, 2015.
Klepeis, N. E., Nelson, W. C., Ott, W. R., Robinson, J. P., Tsang, A.M., Switzer, P., Behar, J. V, Hern, S. C., and Engelmann, W. H.: The National Human Activity Pattern Survey (NHAPS): a resource for assessing exposure to environmental pollutants, J. Expo. Sci. Environ. Epidemiol., 11, 231–252, doi.org/10.1038/sj.jea.7500165, 2001.
Lin, C., Gillespie, J., Schuder, M. D., Duberstein, W., Beverland, I. J., and Heal, M. R.: Evaluation and calibration of Aeroqual series 500 portable gas sensors for accurate measurement of ambient ozone and nitrogen dioxide, Atmos. Environ., 100, 111–116, https://doi.org/10.1016/J.ATMOSENV.2014.11.002, 2015.
Long, R., Beaver, M., and Williams, R.: Procedures and Concepts of EPA's Ongoing Sensor Evaluation Efforts, in: Air And Waste Management Association'S Magazine For Environmental Managers, Pittsburgh, PA 2014.
Mead, M. I., Popoola, O. A. M., Stewart, G. B., Landshoff, P., Calleja, M., Hayes, M., Baldovi, J. J., McLeod, M. W., Hodgson, T. F., Dicks, J., Lewis, A., Cohen, J., Baron, R., Saffell, J.R., and Jones, R. L.: The use of electrochemical sensors for monitoring urban air quality in low-cost, high-density networks, Atmos. Environ., 70, 186–203, https://doi.org/10.1016/J.ATMOSENV.2012.11.060, 2013.
Mie, G.: Beiträge zur Optik trüber Medien, speziell kolloidaler Metallösungen, Ann. Phys., 330, 377–445, https://doi.org/10.1002/ANDP.19083300302, 1908.
Moore, E., Chatzidiakou, L., Jones, R. L., Smeeth, L., Beevers, S., Kelly, F. J., Quint, J. K., and Barratt, B.: Linking e-health records, patient-reported symptoms and environmental exposure data to characterise and model COPD exacerbations: protocol for the COPE study, BMJ Open, 6, e011330, https://doi.org/10.1136/bmjopen-2016-011330, 2016.
Morawska, L. and Salthammer, T.: Indoor environment?: airborne particles and settled dust, Wiley-VCH, https://doi.org/10.1002/9783527610013, 2003.
Morawska, L., Thai, P. K., Liu, X., Asumadu-Sakyi, A., Ayoko, G., Bartonova, A., Bedini, A., Chai, F., Christensen, B., Dunbabin, M., Gao, J., Hagler, G. S. W., Jayaratne, R., Kumar, P., Lau, A. K. H., Louie, P. K. K., Mazaheri, M., Ning, Z., Motta, N., Mullins, B., Rahman, M. M., Ristovski, Z., Shafiei, M., Tjondronegoro, D., Westerdahl, D., and Williams, R.: Applications of low-cost sensing technologies for air quality monitoring and exposure assessment: How far have they gone?, Environ. Int., 116, 286–299, doi.org/10.1016/J.ENVINT.2018.04.018, 2018.
Newell, K., Kartsonaki, C., Lam, K. B. H., and Kurmi, O. P.: Cardiorespiratory health effects of particulate ambient air pollution exposure in low-income and middle-income countries: a systematic review and meta-analysis, Lancet. Planet. Heal., 1, e368–e380, https://doi.org/10.1016/S2542-5196(17)30166-3, 2017.
Nuvolone, D., Petri, D., and Voller, F.: The effects of ozone on human health, Environ. Sci. Pollut. Res., 25, 8074–8088, https://doi.org/10.1007/s11356-017-9239-3, 2018.
Popoola, O. A. M., Stewart, G. B., Mead, M. I., and Jones, R. L.: Development of a baseline-temperature correction methodology for electrochemical sensors and its implications for long-term stability, Atmos. Environ., 147, 330–343, https://doi.org/10.1016/J.ATMOSENV.2016.10.024, 2016.
R Development Core Team: R: A language and environment for statistical computing, 2008.
Rai, A. C., Kumar, P., Pilla, F., Skouloudis, A. N., Di Sabatino, S., Ratti, C., Yasar, A., and Rickerby, D.: End-user perspective of low-cost sensors for outdoor air pollution monitoring, Sci. Total Environ., 607–608, 691–705, https://doi.org/10.1016/j.scitotenv.2017.06.266, 2017.
Shi, Z., Vu, T., Kotthaus, S., Harrison, R. M., Grimmond, S., Yue, S., Zhu, T., Lee, J., Han, Y., Demuzere, M., Dunmore, R. E., Ren, L., Liu, D., Wang, Y., Wild, O., Allan, J., Acton, W. J., Barlow, J., Barratt, B., Beddows, D., Bloss, W. J., Calzolai, G., Carruthers, D., Carslaw, D. C., Chan, Q., Chatzidiakou, L., Chen, Y., Crilley, L., Coe, H., Dai, T., Doherty, R., Duan, F., Fu, P., Ge, B., Ge, M., Guan, D., Hamilton, J. F., He, K., Heal, M., Heard, D., Hewitt, C. N., Hollaway, M., Hu, M., Ji, D., Jiang, X., Jones, R., Kalberer, M., Kelly, F. J., Kramer, L., Langford, B., Lin, C., Lewis, A. C., Li, J., Li, W., Liu, H., Liu, J., Loh, M., Lu, K., Lucarelli, F., Mann, G., McFiggans, G., Miller, M. R., Mills, G., Monk, P., Nemitz, E., O'Connor, F., Ouyang, B., Palmer, P. I., Percival, C., Popoola, O., Reeves, C., Rickard, A. R., Shao, L., Shi, G., Spracklen, D., Stevenson, D., Sun, Y., Sun, Z., Tao, S., Tong, S., Wang, Q., Wang, W., Wang, X., Wang, X., Wang, Z., Wei, L., Whalley, L., Wu, X., Wu, Z., Xie, P., Yang, F., Zhang, Q., Zhang, Y., Zhang, Y., and Zheng, M.: Introduction to the special issue “In-depth study of air pollution sources and processes within Beijing and its surrounding region (APHH-Beijing)”, Atmos. Chem. Phys., 19, 7519–7546, https://doi.org/10.5194/acp-19-7519-2019, 2019.
Sousan, S., Koehler, K., Hallett, L., and Peters, T. M.: Evaluation of the Alphasense optical particle counter (OPC-N2) and the Grimm portable aerosol spectrometer (PAS-1.108), Aerosol Sci. Technol., 50, 1352–1365, https://doi.org/10.1080/02786826.2016.1232859, 2016.
Spinelle, L., Aleixandre, M., Gerboles, M.: Protocol of evaluation and calibration of low-cost gas sensors for the monitoring of air pollution, European Commission, Joint Research Centre, Institute for Environment and Sustainability, Publications Office, 2013.
Steinle, S., Reis, S., and Sabel, C. E.: Quantifying human exposure to air pollution – Moving from static monitoring to spatio-temporally resolved personal exposure assessment, Sci. Total Environ., 443, 184–193, https://doi.org/10.1016/J.SCITOTENV.2012.10.098, 2013.
Stetter, J. R. and Li, J.: Amperometric Gas Sensors – A Review, Chem. Rev., 108, 352–366, https://doi.org/10.1021/CR0681039, 2008.
Thermo Fischer Scientific: Thermo Scientific Model 48i Carbon Monoxide Analyzer 2017, available at: https://assets.thermofisher.com/TFS-Assets/LSG/Specification-Sheets/EPM-48i-Datasheet.pdf (last access: 28 August 2019), 2017.
Thurston, G. D., Kipen, H., Annesi-Maesano, I., Balmes, J., Brook, R. D., Cromar, K., De Matteis, S., Forastiere, F., Forsberg, B., Frampton, M. W., Grigg, J., Heederik, D., Kelly, F. J., Kuenzli, N., Laumbach, R., Peters, A., Rajagopalan, S. T., Rich, D., Ritz, B., Samet, J. M., Sandstrom, T., Sigsgaard, T., Sunyer, J., and Brunekreef, B.: A joint ERS/ATS policy statement: what constitutes an adverse health effect of air pollution? An analytical framework, Eur. Respir. J., 49, 1600419, https://doi.org/10.1183/13993003.00419-2016, 2017.
Tonne, C.: A call for epidemiology where the air pollution is, Lancet, 1, e355–356, https://doi.org/10.1016/S2542-5196(17)30163-8, 2017.
Walser, A., Sauer, D., Spanu, A., Gasteiger, J., and Weinzierl, B.: On the parametrization of optical particle counter response including instrument-induced broadening of size spectra and a self-consistent evaluation of calibration measurements, Atmos. Meas. Tech., 10, 4341–4361, https://doi.org/10.5194/amt-10-4341-2017, 2017.
Zeger, S. L., Thomas, D., Dominici, F., Samet, J. M., Schwartz, J., Dockery, D., and Cohen, A.: Exposure measurement error in time-series studies of air pollution: concepts and consequences, Environ. Health Perspect., 108, 419–426, https://doi.org/10.1289/ehp.00108419, 2000.