Articles | Volume 15, issue 17
https://doi.org/10.5194/amt-15-5117-2022
https://doi.org/10.5194/amt-15-5117-2022
Research article
 | 
08 Sep 2022
Research article |  | 08 Sep 2022

Characterization of inexpensive metal oxide sensor performance for trace methane detection

Daniel Furuta, Tofigh Sayahi, Jinsheng Li, Bruce Wilson, Albert A. Presto, and Jiayu Li
Abstract

Methane, a major contributor to climate change, is emitted by a variety of natural and anthropogenic sources. Commercially available lab-grade instruments for sensing trace methane are expensive, and previous efforts to develop inexpensive, field-deployable trace methane sensors have had mixed results. Industrial and commercial metal oxide (MOx) methane sensors, which are intended for leak detection and safety monitoring, can potentially be repurposed and adapted for low-concentration sensing. As an initial step towards developing a low-cost sensing system, we characterize the performance of five off-the-shelf MOx sensors for 2–10 ppm methane detection in a laboratory setting (Figaro Engineering TGS2600, TGS2602, TGS2611-C00, TGS2611-E00, and Henan Hanwei Electronics MQ4). We identify TGS2611-C00, TGS2611-E00, and MQ4 as promising for trace methane sensing but show that variations in ambient humidity and temperature pose a challenge for the sensors in this application.

1 Introduction

Methane is a major greenhouse gas of increasing importance with a wide variety of natural and anthropogenic sources (Saunois et al., 2016). Commercially available instruments for measuring methane are expensive, limiting the spatiotemporal resolution of monitoring and leak detection (Siebenaler et al., 2016; Riddick et al., 2020a). High-resolution monitoring networks can aid in pollution mapping and source identification – for example, in reducing leaks and fugitive emissions from fossil fuel production and distribution, one of the main anthropogenic sources of methane emissions (US EPA, 2017). Accordingly, researchers are investigating several options for lower-cost trace methane sensing with the goal of developing inexpensive sensor networks (Cho et al., 2022; Riddick et al., 2020a), low-cost drone-based solutions (Liu et al., 2021), and similar monitoring methods.

One approach is to repurpose off-the-shelf methane sensors designed for industrial or residential safety use. These sensors are intended for leak detection and similar applications and are generally specified to measure methane concentrations above trace levels (>50 ppm). Atmospheric methane concentrations are currently close to 2 ppm (NOAA Global Monitoring Laboratory, 2022) and are outside of such sensors' design parameters. However, the low cost and easy availability of off-the-shelf sensors supports further investigation into their use for a broader range of applications.

Off-the-shelf methane sensors are built around several different technologies; Aldhafeeri et al. (2020) summarized the working principle of several common types of methane sensors. Infrared sensors measure the narrow-band absorption of infrared light by methane, with inexpensive sensors using simplified versions of the techniques discussed by Kamieniak et al. (2015) and Shemshad et al. (2012). Pellistor sensors measure the energy released by the combustion of gas on a catalytic surface, with challenges posed by selectivity, high energy consumption, and effects from environmental conditions such as wind speed (Kamieniak et al., 2015). Metal oxide (MOx) sensors measure the change in the electrical resistance of a semiconductor layer due to interactions with gas molecules and can be made inexpensively; difficulties with cross-sensitivities and lifespan can be addressed in part with different semiconductor formulations (Meixner and Lampe, 1996). Commercially available MOx sensors have shown promise for monitoring atmospheric levels of other air pollutants besides methane, including O3, CO, and NO2 (Piedrahita et al., 2014; Peterson et al., 2017).

Pellistor and optical sensors are available off the shelf from companies such as Amphenol SGX Sensortech at prices ranging from USD 80 to USD 300 from distributors (Mouser Electronics, Inc.). A typical example, the INIR-ME-5 % optical sensor, priced at USD 270, is specified with a lower limit of detection of 100 ppm and is designed for methane concentrations in the percent range (SGX Sensortech, 2018). MOx sensors are often less expensive still; the components we examine range in price from USD 5 to USD 20, ideal for developing very inexpensive sensor nodes. Due to their low cost and wide availability, we focus on MOx sensors in this study.

1.1 Previous studies

Other researchers have investigated MOx sensors for trace methane detection, with results summarized in Table 1. Eugster and Kling (2012) used a TGS2600 sensor (Figaro Engineering Inc.) to follow diurnal trends in methane concentrations in the 1.8–2 ppm range, though with an R2 of only 0.19. However, Riddick et al. (2020a) found the same method did not work with a wider concentration range and developed a different model with accuracy of 0.01 ppm. Collier-Oxandale et al. (2018) also found good results with TGS2600 sensors at two different sites, with RMSE better than 0.4 ppm; however, they found it necessary to use different calibration and regression models for the two sites and found that their models were somewhat overfitted to other gases and environmental parameters. Although TGS2600 had useful accuracy in these studies, different calibration models were required for different sites, possibly due to different sources or environmental conditions. In particular, temperature and humidity are known to affect MOx sensor response, as do cross-sensitivities to other gases (Wang et al., 2010; Huerta et al., 2016; Abdullah et al., 2020; Kim et al., 2021). It is possible that these studies were overfitted to site-specific phenomena such as interfering gases.

Van den Bossche et al. (2017) performed a laboratory calibration of a TGS2611-E00 sensor (Figaro Engineering Inc.), finding error around 1 ppm when corrected for humidity and temperature. Bastviken et al. (2020) reported similar errors with TGS2611-E00 in a laboratory calibration and field deployment. Taguem et al. (2021) studied the response of a sensor array including TGS2611, TGS2602 (Figaro Engineering Inc.), and other sensors for biogas detection, which includes methane as a component; however, their analysis did not characterize sensor response to methane alone.

Riddick et al. (2020b) found an MQ4 sensor to match their reference instrument between 100 ppm and 9 % concentrations with an R2 of 0.99. Honeycutt et al. (2019) determined a lower limit of detection for MQ4 of 82 ppm. Both studies found good performance in the higher concentration range, but neither study quantified sensor performance in the background to 10 ppm range.

The cited low-concentration studies used several algorithms to fit sensor response to methane levels. Eugster and Kling (2012) used a linear regression to fit a scaled sensor resistance, which was first corrected for relative humidity and temperature, to methane levels. Van den Bossche et al. (2017) followed the same method. As mentioned previously, Riddick et al. (2020a) did not find this algorithm to produce optimal results and instead developed a more complicated, non-linear regression to fit their data. Finally, Collier-Oxandale et al. (2018) evaluated 11 different regressions of varying complexity with different variables, including time, time of day, temperature, and humidity, finding that different models worked better at their different sites. Models for these studies were selected for performance rather than clarity or ease of interpretation. Although it may give worse performance, we believe a simpler model may better illustrate the effects of different conditions on sensor response in our comparative study.

The cited studies use different performance metrics, with some reporting differing results for the same sensors. Eugster and Kling (2012) found an unimpressive R2 of 0.19 for TGS2600, for example, while Riddick et al. (2020a) found an impressive accuracy of 0.01 ppm for the same sensor. As these varying results are difficult to interpret and compare, an evaluation of these inexpensive sensors with a consistent methodology will be helpful for future work in the field.

Table 1Summary of results of selected studies.

Download Print Version | Download XLSX

Background methane levels at our location are approximately 2 ppm, consistent with the low-concentration studies in Table 1. Eugster and Kling (2012) have a small concentration range of 1.85–2 ppm, while the other low-concentration studies have upper concentrations of 5.85 ppm (Riddick et al., 2020a), 7 ppm (Collier-Oxandale et al., 2018), and 9 ppm (Van den Bossche et al., 2017). To allow comparisons with these previous studies, we chose a similar concentration range of background to 10 ppm for our study. We chose a slightly higher upper concentration with the additional goal of evaluating suitability for detecting minor leaks and similar enhancements while focusing on the apparently difficult-to-sense low-concentration range.

1.2 Study goals

Previous studies suggest that some MOx sensors may be useful at ambient methane concentrations; however, as the studies use different experimental methods, algorithms, and concentration ranges, making direct comparisons between the sensors is difficult. In this study, we compare the performance of five MOx sensors for trace methane detection with the hope of clarifying the suitability of these low-cost devices for atmospheric and near-source applications. We characterize the effect of temperature and humidity on sensor response over a methane concentration range of background (2 ppm) to 10 ppm. By systematically examining the effect of environmental conditions on sensor performance and by providing a consistent methodology, we provide a direct comparison between the different sensors and an indication of their suitability for trace methane sensing use.

2 Methods

2.1 Sensor selection and configuration

We selected five inexpensive, off-the-shelf MOx sensors to test, as detailed in Table 2. Three of the sensors (TGS2611-C00, TGS2611-E00, and MQ4) are marketed specifically for methane response (Figaro, 2013; Henan Hanwei Electronics Co., 2008); one sensor, TGS2600, is marketed for general air pollutant response (Figaro, 2021a); and one sensor, TGS2602, is marketed primarily for volatile organic compound (VOC) detection (Figaro, 2021b). We chose to include TGS2602, which is not marketed as sensing methane, to confirm whether it could be used in sensor arrays to help account for cross sensitivities, as might be the case if it showed no response to methane.

The TGS2611 models are built on the same base sensor, with the TGS2611-E00 including an additional filter to block possible interfering gases, such as alcohols. The TGS2611-C00 does not include this filter and is marketed for fast response. We believe that the manufacturer has not publicly disclosed the specific material used in the filter. TGS2600 and TGS2611-E00 have been characterized for trace methane sensing by the studies listed in Table 1.

Table 2Sensors used in this study. Prices for the Figaro sensors and MQ4 are from the distributors Maritex Co. and Pololu Corp., respectively, and were collected in November 2021.

Download Print Version | Download XLSX

MOx sensors respond to gas concentrations with varying electrical resistances. To convert this to a voltage signal that our equipment could record, we placed each sensor in a voltage divider configuration with a 10  resistor. Since the sensor response to our range of conditions was unknown, we selected the resistance as a reasonable value based on manufacturer data sheets. The sensors have internal heaters, which are intended to provide the stable, elevated operating temperatures required for the metal oxide elements.

Our experiment tested three replicates of each sensor for a total of 15 sensors. The Figaro sensors of each type were from the same production batch; the MQ4 sensors were ordered from the distributor at the same time but did not have printed batch information. We designed a printed circuit board (PCB) for the sensors and associated electronics, as shown in Fig. 1. The PCB holds the sensors, voltage divider resistors, and connectors for sensor signals and power. The PCB also contains power supply bypass capacitors, which were not in the direct path of the measurement circuit, to reduce any power supply noise. We randomized the order in which the sensors were placed on the PCB to minimize possible thermal differences between the edge and center positions. The sensor board and sensors were burned in for several days before use.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f01

Figure 1Diagram of the experimental setup. One of each type of sensor is labeled on the circuit board: A = MQ4; B = TGS2602; C = TGS2611-E00; D = TGS2611-C00; E = TGS2600. In the actual experiment the data acquisition unit was placed inside the inner enclosure; for visual clarity it is shown outside in the diagram.

Download

2.2 Instrumentation and experimental setup

The sensor signals leaving the PCB were analog voltages that required digitization with a data acquisition unit (LabJack Corp. T7) connected to our host computer. The data acquisition unit has a 16-bit analog digital converter, which was further averaged internally to an effective bit depth of 19.1 bits, corresponding to a 37 µV resolution (LabJack Corp., 2022). We used a standalone device (VWR International LLC Traceable Logger-Trac) placed next to the sensor PCB to measure and record relative humidity and temperature. The humidity and temperature logger recorded an entry every 30 s, which we later averaged to 1 min.

We powered the sensor board with a regulated bench power supply (Keysight Technologies E3631A), with the data acquisition unit powered via USB from the host computer. The sensors were warmed up for 2 h prior to beginning data collection. The data acquisition unit digitized the analog sensor voltage divider signals and sent voltage readings to the host computer, as directed by a program running in Python 3.7 (Python Software Foundation). The host computer paused for five seconds between consecutive samples; including the time required to acquire data and small variations in system timing, this resulted in an entry of readings from all 15 sensors every five to six seconds, which we averaged later to 1 min resolution.

We used an LI-7810 optical trace gas analyzer (LI-COR Inc.) as a reference instrument. The LI-7810 measures methane with better than 1 ppb precision and water vapor with better than 50 ppm precision, with a methane response time specified as less than two seconds (LI-COR, 2021). The reference instrument produced readings every second, which we later averaged to the minute. The analyzer was still in its initial factory calibration period.

We built our test chamber inside a commercially available chest freezer, shown in the diagram in Fig. 1. We placed a heater (Vivosun 10in.×20.75in. seedling heat mat) at the bottom of the freezer, with both the freezer and heater being controlled by a temperature controller (Inkbird ITC-308). As our test chamber, we placed a plastic tub inside the freezer with the sensor PCB, data acquisition unit, and temperature and humidity logger enclosed. The host computer, reference instrument, and power supply were outside of the chamber, with connections made through the lids of the freezer and tub. The reference instrument continuously drew air from the test chamber by its internal sampling pump at a flow rate of 0.25 L min−1, sampling from the top of the test chamber, as seen in Fig. 1, and venting its exhaust to the laboratory. This sampling airflow was the only driver of air movement into or out of the chamber. Makeup air was provided from ambient laboratory air via an inlet tube, which also connected to the top of the test chamber. The sensor PCB was placed at the bottom of the test chamber, and a small fan inside the test chamber ensured mixing.

The reference instrument was connected to the test chamber by approximately four feet of tubing. We found that the instrument responded to methane pulses injected into the test chamber within seconds; as we later averaged all data to a minute timescale, we considered this lag to be negligible and did not synchronize the systems further beyond ensuring consistent system clocks.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f02

Figure 2Time series of the full dataset. The left plots show the entire experiment; the right plots show an expanded view of the 2 h inside the dotted lines. For visual clarity, only one replicate of each sensor type is shown.

Download

To generate methane pulses, we drew a small portion of gas from a 99.99 % methane cylinder (GASCO Affiliates, Ltd.) into a syringe and then injected the gas into the inlet tube, flushing the tube several times with ambient air. This caused a sharp spike in methane concentrations inside the test chamber, which then slowly decayed to background levels as the air was replaced with ambient air. With our chamber and reference instrument air flow, a 10 ppm concentration decayed to the background 2 ppm in around a day.

We examined sensor performance at five temperatures: 10, 15, 20, 25, and 30 C. We injected two methane pulses at each temperature for a total of 10 methane decay curves over 10 days. We recorded methane and water vapor concentrations with the LI-7810 reference instrument and temperature and relative humidity with the VWR logger. Due to high ambient humidity in the laboratory, we were unable to control humidity in our test chamber.

2.3 Data processing and analysis

We averaged all collected data to a 1 min timescale and then associated the data from the sensor PCB, reference instrument, and temperature/humidity logger by their timestamps. Since our interest is in sensor performance at background and near-source methane concentrations, we discarded data points with a reference instrument methane reading above 10 ppm.

MOx sensors convert gas concentrations into electrical resistances. Our sensor PCB converted these resistances to voltage signals with a voltage divider arrangement with a 10  fixed resistor and a 5 V voltage supply. To convert a recorded sensor voltage VOUT to its originating sensor resistance RS, we used the standard voltage divider equation Eq. (1). We used these resistances RS for our analyses.

(1) R S = ( 5 V ) ( 10 000 Ω ) V OUT - 10 000 Ω

Due to the decaying pulse approach used, the dataset is heavily biased towards lower methane concentrations. To better evaluate sensor performance across the entire concentration range of interest, we performed our analysis by stratifying the dataset. We divided the data into three equally-spaced bins according to methane concentration, spaced between the minimum recorded concentration and 10 ppm. We then randomly chose an equal number of samples from each bin, with the number chosen from each bin being equal to the size of the smallest bin, and used this sampled dataset for further analysis.

MOx sensors are sensitive to environmental conditions, particularly humidity and temperature (Abdullah et al., 2020). In our experiment, ambient temperature and water vapor concentrations were highly correlated (Pearson's r=0.95). Humidity directly affects MOx sensor response (Wang et al., 2010); the sensors we used all have internal heaters to provide elevated temperatures for their elements, and further work would be required to quantify the effect of ambient temperature on these operating conditions. As our experimental setup was poorly suited to differentiate between the effects of temperature and humidity, we accordingly chose to only include water vapor concentration – which had a slightly stronger correlation with most of the sensors than temperature did – as an environmental factor in our analysis. Water vapor concentrations were measured by the LI-7810 in ppm, which we converted to percent. Determining the different effects of temperature and humidity will be an important element of future work with these sensors.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f03

Figure 3The lower triangle shows pair plots between variables; the upper triangle shows correlation values (Pearson's r); the green plots on the diagonal show the distributions of each variable. 2600, 2602, 2611-C00, 2611-E00, and MQ4 are the MOx sensors; CH4 and H2O are methane and water vapor concentrations; T and RH are temperature and humidity. For clarity, only one of each type of sensor is shown.

Download

To compare the sensors' suitability for trace methane monitoring, we performed multi-variable linear regressions for each sensor individually. As our goal is to compare the performance of the different sensors in a systematic way rather than to develop a field-deployable system, we chose to use a simple, easily interpreted model rather than a higher-performing but more complex algorithm. Each regression used methane concentration measured by the reference instrument as the target. Sensor response, water vapor concentration, and the interaction between sensor response and water vapor were predictor variables. Equation (2) shows the regression equation, in which the α and β terms are least-square regression parameters and ε is the residual error:

(2) CH 4 = α + β 1 ( sensor resistance ) + β 2 ( H 2 O ) + β 3 ( H 2 O ) ( sensor resistance ) + ε .
3 Results

Figure 2 shows the time series of the full dataset. This dataset contains 14 065 entries, representing 1 min averaged data for 10 days. Gaps in the data represent periods with methane concentrations above 10 ppm due to overshooting the target concentration on pulse injections, which we removed from the dataset.

Due to high humidity variation in the ambient laboratory environment, the experimental setup was unable to maintain stable relative humidity levels. Although this behavior was not desired, our experimental design still provided a range of humidity levels for our analysis.

As can be seen in Fig. 2, relative humidity, water vapor levels, and temperature all show a regular cycle, with levels fluctuating several times per hour. This cycle was synchronized with the on/off period of our temperature control system. From observation of the system, we believe that the cycle in water vapor levels was caused by condensation and evaporation on the walls of the test chamber due to the cooling and heating temperature cycle. The temperature fluctuations also affected relative humidity via the associated changes in vapor pressure.

Figure 3 shows the sensors' response to methane concentration and environmental parameters, including absolute humidity, temperature, and relative humidity. This figure also demonstrates the correlations among the different sensors. Most of the MOx sensors show a strong correlation with temperature and water vapor concentration (|r|>0.8 for both parameters for all sensors except for TGS2602); temperature and water vapor concentrations were themselves highly correlated in our experiment. Sensor correlation with temperature and water vapor is stronger than their correlations with methane concentrations for all of the sensors, suggesting that accounting for environmental factors is critical to using these sensors. The MQ4 and TGS2611-E00 sensors are moderately correlated with methane (r=-0.46 and −0.52, respectively). TGS2600, TGS2602, and TGS2611-C00 show low correlation with methane concentrations (r=-0.20, −0.10, and −0.32 respectively).

The consistency of the measured resistance between replicates of the same type of sensor is summarized in Fig. 4. Pair and relative frequency plots are shown for each sensor type. The TGS2611-series sensors show good correlations between replicates (r=1.00). The other sensors also show good correlation (r≥0.97) but have greater variation in slopes between units, suggesting that individual, per-sensor calibration might be necessary.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f04

Figure 4The experiment contained three replicates of each sensor type; each subplot shows the relationship between the three replicates of a given sensor. The lower triangles show pair plots; the upper triangles show correlation values (Pearson's r) and the slope β of the best-fit line for each pair; the green plots on the diagonal show distributions. The x axes for all plots and the y axes for the lower triangles are electrical resistance values in .

Download

A comparison of the full and stratified sampled dataset is shown in Fig. 5. The stratified dataset provides a better balance among the number of observations at different concentrations. Nonetheless, low methane concentrations still had more observations. This bias could be reduced by using more bins in the sampling, at further cost to the overall dataset size.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f05

Figure 5Distributions of the full and sampled dataset. The full dataset has n=14 065 points. The sampled dataset has n=930 points.

Download

Regression parameters and goodness-of-fit statistics for the regression model of Eq. (2) are given in Table 3. Plots of predicted versus observed methane concentrations are shown in Fig. 6. The coefficients of determination for TGS2600 and TGS2602 are poor, and there are essentially no trends between predicted and observed values for these sensors. Regression statistics for the TGS2611 sensors suggest that the regression relationships are capturing key trends in the observed methane concentrations. In general, their regression analyses tend to overpredict the low concentrations and underpredict higher concentrations. A more advanced regression analysis may be successful in improving the performance of these sensors. The best regression relationships were obtained with the MQ4 and TGS2611-E00 sensors. Coefficients of determination were generally the largest, and the regression coefficients were significantly different from zero. However, the MQ4 sensors showed greater variability between units in goodness of fit than the TGS2611 sensors, with one of the three units performing worse than the TGS2611-E00 sensors. As previously mentioned, the MQ4 sensors did not have manufacturing batch information and may have been packaged together from different batches by the component distributor. We additionally fit the regression equation with log-transformed data but did not find improvement in the results.

Table 3Regression performance and coefficients for Eq. (2) CH4=α+β1(sensor resistance)+β2(H2O)+β3(H2O)(sensor resistance)+ε, with CH4 in ppm, H2O as percent, and sensor resistance in . Every cell shows values for each of the three replicates of the given sensor.

Statistical significance for each term is indicated with the following codes: p<0.1; p<0.05; p<0.001. The fit is evaluated for the 2–10 ppm methane range.

Download Print Version | Download XLSX

4 Discussion

4.1 Sensor performance

We tested five low-cost, off-the-shelf MOx sensors to determine their suitability for monitoring methane at concentrations close to atmospheric levels. We identified TGS2611-C00 and TGS2611-E00 (Figaro Engineering Inc.), and MQ4 (Henan Hanwei Electronics Co. Ltd.) as promising candidates, with the best R2 (>0.65) and RMSE (<1.5 ppm).

TGS2600 and TGS2602 sensors (Figaro Engineering Inc.) did not correlate well with methane levels in the analysis we performed. As TGS2602 is not marketed specifically for methane, this is unsurprising. TGS2600 is marketed as a general purpose sensor but has been used previously for methane work. Although it is possible that more complex algorithms could provide useful results, as in Eugster and Kling (2012), the inconsistent results of these algorithms in previous studies (Riddick et al., 2020a) and the availability of apparently better sensors for the same cost leaves little reason to use TGS2600 or TGS2602 for future trace methane work. However, their lack of response to methane suggests they may have potential if deployed alongside other sensors to differentiate between methane and other gases.

Our RMSE value of 1.2 ppm for TGS2611-E00 was close to the error of approximately 1 ppm reported by van den Bossche et al. (2017) and Bastviken et al. (2020). Our R2=0.16 for TGS2600 was close to the R2=0.19 reported by Eugster and Kling (2012). However, our RMSE of 2.3 ppm for TGS2600 was worse than the impressive 0.38 and 0.01 ppm errors reported by Collier-Oxendale et al. (2018) and Riddick et al. (2020a), respectively; unlike these previous studies, we did not find that TGS2600 was sensitive to methane at low levels. It is possible that these studies had site-specific effects – that were not present in our experiment – that led to better sensor performance, or our errors could be reduced with more sophisticated models.

We found that the TGS2611 sensors had similar performance between units of the same type but that the MQ4 units showed greater variability. The three MQ4 sensors we tested gave R2 values in our model from 0.70 to 0.82; by comparison, the three TGS2611-C00 had R2 values from 0.67 to 0.68, and the TGS2611-E00 sensors from 0.76 to 0.78. The slope of the response also varied more between units for the MQ4 units than for the TGS2611 sensors. As a result, individual calibration or sensor selection is likely necessary for MQ4, adding to the cost and labor required in assembling a sensor network. In contrast, other types of inexpensive electrochemical sensors have been shown to perform well for other air pollutants without individual calibration (Malings et al., 2019).

The 10  resistor value we used for our voltage dividers was not chosen optimally, as can be seen from the range of sensor resistances shown in Figs. 2 and 4. As the voltage divider would have the highest sensitivity when the fixed resistor is close to the sensor resistance, larger voltage divider resistors would perform better. Accordingly, for the range of conditions we studied, resistors closer to 20, 40, and 75  would be preferable for TGS2600, TGS2611-C00, and TGS2611-E00 and MQ4 respectively.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f06

Figure 6Regression performance using the coefficients given in Table 3, shown against the identity line. For visual clarity, only one replicate is shown for each sensor type.

Download

4.2 Suitability for atmospheric sensing and potential applications

As background methane levels are around 2 ppm, RMSE values of greater than 1 ppm suggest that these sensors are not suitable for detecting variations in methane levels around atmospheric concentrations without more sophisticated algorithms or sensing system designs. In particular, more precisely accounting for temperature and humidity response may improve performance. This could be achieved by regulating the temperature and humidity levels of the sampled air or by characterizing sensor response to temperature and humidity separately and developing a more complex algorithm to remove these interferences.

The level of accuracy we found from TGS2611 and MQ4 may be usable without further improvement in sensor networks for major leak detection in urban areas, which show methane enhancements above 1 ppm in surveys, with levels sometimes exceeding 10 ppm (Phillips et al., 2013; Defratyka et al., 2021). Leaks around natural gas infrastructure (Cho et al., 2022) should also be easily detectable, with even regional-scale enhancements exceeding 1.5 ppm around production sites (Caulton et al., 2014). Due to the low cost of these sensors, such leak detection sensor networks could provide an accessible method for identifying and correcting major fugitive emission sources.

4.3 Sensitivity to environmental conditions

Water vapor and temperature have a large effect on sensor response, as shown by previous studies (Wang et al., 2010; Huerta et al., 2016; Abdullah et al., 2020; Kim et al., 2021). Our results show a strong correlation between absolute humidity and sensor response (|r|>0.85 for the TGS2611 sensors and MQ4) but little correlation with relative humidity (|r|<0.1 for the same sensors).

Figure 7 emphasizes the importance of temperature and humidity by showing the responses of three sensors for subsets of the data, selected to show two disjunct ranges each for temperature and water vapor. At higher temperatures the sensors have lower resistance values than at lower temperatures; the same is true for water vapor levels. In the methane concentration range we examined, the change in sensor response due to these environmental conditions can exceed the change in sensor response due to methane levels. Accordingly, field deployments of these sensors will require system designs that control temperature and humidity, co-located measurements and algorithms to account for these factors, or both.

https://amt.copernicus.org/articles/15/5117/2022/amt-15-5117-2022-f07

Figure 7Sensor response (y axis) to environmental conditions can be greater than to methane (x axis) at low concentrations.

Download

4.4 Study limitations

Our study had several limitations that will need to be addressed for future development. Most importantly, our experimental setup was unable to accurately control humidity levels independently of temperature, leaving us unable to distinguish sensor sensitivities between the two factors. We also did not test for cross-sensitivities to other gases, such as VOCs or CO, which may be important factors in real-world deployments (Collier-Oxandale et al., 2018). The lack of response from TGS2600 and TGS2602 to methane suggests that they might be useful in detecting these interfering gases in a sensor array. Further development of this idea will require characterizing the sensors' responses to common interfering gases and then developing algorithms to account for cross-sensitivities using multiple sensors.

Our calibration equation was simpler than those used by previous studies and was chosen for clarity and ease of interpretation rather than for optimal performance. Accordingly, our expectations for sensor performance may be more pessimistic than they would possibly be with more sophisticated algorithms. However, the agreement of our conclusions with some previous work supports our general findings, and we think it is unlikely that the relative performance of these sensors will be significantly different with higher-performing models.

5 Conclusion

Environmental conditions have a large effect on MOx sensors, dominating the sensor response at low methane levels. Applications of these sensors for monitoring trace methane will require careful sensor calibration and algorithms to address humidity or system designs that reduce environmental variation. We believe that addressing environmental sensitivity is the main challenge to real-world applications with the studied sensors but that their potential to enable inexpensive sensor networks merits further development.

Monitoring background methane concentrations with the studied sensors will be difficult. It is likely that more advanced algorithms would allow for improved performance over our relatively simple model, but it remains to be seen if improvements in implementation will enable these sensors to perform adequately. However, we believe that the better-performing sensors (TGS2611, MQ4) have potential for immediate application in leak detection networks and similar settings and that the performance we found should be sufficient for use around fossil fuel production infrastructure, in urban leak detection, and in other similar applications.

Code availability

Code and circuit board design files are available by request.

Data availability

Data are available at https://conservancy.umn.edu/handle/11299/226714 (last access: 3 March 2022; Furuta et al.2022).

Author contributions

JiaL and AP conceived of the project; JiaL and DF designed and performed the experiment; JiaL, DF, TS, BW, and AP analyzed the data; DF and JinL wrote the manuscript draft; all authors reviewed and edited the manuscript.

Competing interests

At least one of the (co-)authors is a member of the editorial board of Atmospheric Measurement Techniques. The peer-review process was guided by an independent editor, and the authors also have no other competing interests to declare.

Disclaimer

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Acknowledgements

Randi Shandroski assisted in figure preparation.

Financial support

This research has been supported by the National Energy Technology Laboratory (grant no. S000663-USDOE).

Review statement

This paper was edited by Pierre Herckes and reviewed by three anonymous referees.

References

Aldhafeeri, T., Tran, M.-K., Vrolyk, R., Pope, M., and Fowler, M.: A Review of Methane Gas Detection Sensors: Recent Developments and Future Perspectives, Inventions, 5, 28, https://doi.org/10.3390/inventions5030028, 2020. 

Bastviken, D., Nygren, J., Schenk, J., Parellada Massana, R., and Duc, N. T.: Technical note: Facilitating the use of low-cost methane (CH4) sensors in flux chambers – calibration, data processing, and an open-source make-it-yourself logger, Biogeosciences, 17, 3659–3667, https://doi.org/10.5194/bg-17-3659-2020, 2020. 

Caulton, D. R., Shepson, P. B., Santoro, R. L., Sparks, J. P., Howarth, R. W., Ingraffea, A. R., Cambaliza, M. O. L., Sweeney, C., Karion, A., Davis, K. J., Stirm, B. H., Montzka, S. A., and Miller, B. R.: Toward a better understanding and quantification of methane emissions from shale gas development, P. Natl. Acad. Sci. USA, 111, 6237–6242, https://doi.org/10.1073/pnas.1316546111, 2014. 

Cho, Y., Smits, K. M., Riddick, S. N., and Zimmerle, D. J.: Calibration and field deployment of low-cost sensor network to monitor underground pipeline leakage, Sensor. Actuat. B-Chem., 355, 131276, https://doi.org/10.1016/j.snb.2021.131276, 2022. 

Collier-Oxandale, A., Casey, J. G., Piedrahita, R., Ortega, J., Halliday, H., Johnston, J., and Hannigan, M. P.: Assessing a low-cost methane sensor quantification system for use in complex rural and urban environments, Atmos. Meas. Tech., 11, 3569–3594, https://doi.org/10.5194/amt-11-3569-2018, 2018. 

Defratyka, S. M., Paris, J.-D., Yver-Kwok, C., Fernandez, J. M., Korben, P., and Bousquet, P.: Mapping Urban Methane Sources in Paris, France, Environ. Sci. Technol., 55, 8583–8591, https://doi.org/10.1021/acs.est.1c00859, 2021. 

Eugster, W. and Kling, G. W.: Performance of a low-cost methane sensor for ambient concentration measurements in preliminary studies, Atmos. Meas. Tech., 5, 1925–1934, https://doi.org/10.5194/amt-5-1925-2012, 2012. 

Figaro USA, Inc.: TGS 2611 – for the detection of Methane, https://www.figarosensor.com/product/docs/TGS%202611C00(1013).pdf (last access: 4 January 2022), 2013. 

Figaro USA, Inc.: TGS 2600 – for the detection of Air Contaminants, https://www.figarosensor.com/product/docs/TGS%202611C00(1013).pdf (last access: 4 January 2022), 2021a. 

Figaro USA, Inc.: TGS 2602 – for the detection of Air Contaminants, https://www.figarosensor.com/product/docs/TGS%202611C00(1013).pdf (last access: 4 January 2022), 2021b. 

Furuta, D., Sayahi, T., Li, J., Wilson, B., Presto, A., and Li, J.: Dataset for “Characterization of inexpensive MOx sensor performance for trace methane detection”, https://conservancy.umn.edu/handle/11299/226714 (last access: 3 March 2022), Libraries digial conservancy [data set], 2022. a

Henan Hanwei Electronics Co., Ltd: MQ-4 Semiconductor Sensor for Natural Gas, https://www.pololu.com/file/0J311/MQ4.pdf (last access: 4 January 2022). 

Honeycutt, W. T., Ley, M. T., and Materer, N. F.: Precision and Limits of Detection for Selected Commercially Available, Low-Cost Carbon Dioxide and Methane Gas Sensors, Sensors, 19, 3157, https://doi.org/10.3390/s19143157, 2019. 

Huerta, R., Mosqueiro, T., Fonollosa, J., Rulkov, N. F., and Rodriguez-Lujan, I.: Online decorrelation of humidity and temperature in chemical sensors for continuous monitoring, Chemometr. Intell. Lab., 157, 169–176, https://doi.org/10.1016/j.chemolab.2016.07.004, 2016. 

Kamieniak, J., Randviir, E. P., and Banks, C. E.: The latest developments in the analytical sensing of methane, TrAC Trend. Anal. Chem., 73, 146–157, https://doi.org/10.1016/j.trac.2015.04.030, 2015. 

Kim, S., Sung, H., Kim, S., Je, M., and Kim, J.-H.: ML-Based Humidity and Temperature Calibration System for Heterogeneous MOx Sensor Array in ppm-Level BTEX Monitoring, in: 2021 IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Korea, 22–28 May 2021, 1–5, https://doi.org/10.1109/ISCAS51556.2021.9401413, 2021. 

LabJack Corp.: T-Series Datasheet, https://labjack.com/support/datasheets/t-series, last access: 25 July 2022. 

LI-COR, Inc.: LI-7810 CH4/CO2/H2O Trace Gas Analyzer Specifications, https://www.licor.com/documents/yldtj3q6jykx3xnc8680ytx6i0afc9uu (last access: 4 January 2022), 2021. 

Liu, S., Yang, X., and Zhou, X.: Development of a low-cost UAV-based system for CH4 monitoring over oil fields, Environmental Technology, 42, 3154–3163, https://doi.org/10.1080/09593330.2020.1724199, 2021. 

Malings, C., Tanzer, R., Hauryliuk, A., Kumar, S. P. N., Zimmerman, N., Kara, L. B., Presto, A. A., and Subramanian, R.: Development of a general calibration model and long-term performance evaluation of low-cost sensors for air pollutant gas monitoring, Atmos. Meas. Tech., 12, 903–920, https://doi.org/10.5194/amt-12-903-2019, 2019. 

Meixner, H. and Lampe, U.: Metal oxide sensors, Sensor. Actuat. B-Chem., 33, 198–202, https://doi.org/10.1016/0925-4005(96)80098-0, 1996. 

Abdullah, A. N., Kamarudin, K., Muhammad Mamduh, S., Hamid Adom, A., and Hadi Mohd Juffry, Z.: Effect of Environmental Temperature and Humidity on Different Metal Oxide Gas Sensors at Various Gas Concentration Levels, IOP Conf. Ser.-Mat. Sci., 864, 012152, https://doi.org/10.1088/1757-899X/864/1/012152, 2020. 

NOAA Global Monitoring Laboratory – The NOAA Annual Greenhouse Gas Index (AGGI): https://gml.noaa.gov/aggi/aggi.html, last access: 11 January 2022. 

Peterson, P. J. D., Aujla, A., Grant, K. H., Brundle, A. G., Thompson, M. R., Vande Hey, J., and Leigh, R. J.: Practical Use of Metal Oxide Semiconductor Gas Sensors for Measuring Nitrogen Dioxide and Ozone in Urban Environments, Sensors, 17, 1653, https://doi.org/10.3390/s17071653, 2017. 

Phillips, N. G., Ackley, R., Crosson, E. R., Down, A., Hutyra, L. R., Brondfield, M., Karr, J. D., Zhao, K., and Jackson, R. B.: Mapping urban pipeline leaks: Methane leaks across Boston, Environ. Pollut., 173, 1–4, https://doi.org/10.1016/j.envpol.2012.11.003, 2013. 

Piedrahita, R., Xiang, Y., Masson, N., Ortega, J., Collier, A., Jiang, Y., Li, K., Dick, R. P., Lv, Q., Hannigan, M., and Shang, L.: The next generation of low-cost personal air quality sensors for quantitative exposure monitoring, Atmos. Meas. Tech., 7, 3325–3336, https://doi.org/10.5194/amt-7-3325-2014, 2014. 

Riddick, S. N., Mauzerall, D. L., Celia, M., Allen, G., Pitt, J., Kang, M., and Riddick, J. C.: The calibration and deployment of a low-cost methane sensor, Atmos. Environ., 230, 117440, https://doi.org/10.1016/j.atmosenv.2020.117440, 2020a. 

Riddick, S. N., Mauzerall, D. L., Celia, M. A., Kang, M., and Bandilla, K.: Variability observed over time in methane emissions from abandoned oil and gas wells, Int. J. Greenh. Gas Con., 100, 103116, https://doi.org/10.1016/j.ijggc.2020.103116, 2020b.  

Saunois, M., Jackson, R. B., Bousquet, P., Poulter, B., and Canadell, J. G.: The growing role of methane in anthropogenic climate change, Environ. Res. Lett., 11, 120207, https://doi.org/10.1088/1748-9326/11/12/120207, 2016. 

SGX Sensortech: Integrated IR Datasheet, https://www.mouser.com/datasheet/2/18/1/Amphenol_11212018_DS_0229__INIR_Datasheet__V8_Octo-1891908.pdf (last access: 11 January 2022), 2018. 

Shemshad, J., Aminossadati, S. M., and Kizil, M. S.: A review of developments in near infrared methane detection based on tunable diode laser, Sensor. Actuat. B-Chem., 171–172, 77–92, https://doi.org/10.1016/j.snb.2012.06.018, 2012. 

Siebenaler, S. P., Janka, A. M., Lyon, D., Edlebeck, J. P., and Nowlan, A. E.: Methane Detectors Challenge: Low-Cost Continuous Emissions Monitoring, 2016 11th International Pipeline Conference, https://doi.org/10.1115/IPC2016-64670, Calgary, Alberta, Canada, 26–30 September, V003T04A01, 2016. 

Taguem, E. M., Mennicken, L., and Romain, A.-C.: Quantile regression with a metal oxide sensors array for methane prediction over a municipal solid waste treatment plant, Sensor. Actuat. B-Chem., 334, 129590, https://doi.org/10.1016/j.snb.2021.129590, 2021. 

US EPA: Inventory of U. S. Greenhouse Gas Emissions and Sinks: 1990–2014: https://www.epa.gov/ghgemissions/inventory-us-greenhouse-gas-emissions-and-sinks-1990-2014, last access: 29 January 2022. 

van den Bossche, M., Rose, N. T., and De Wekker, S. F. J.: Potential of a low-cost gas sensor for atmospheric methane monitoring, Sensor. Actuat. B-Chem., 238, 501–509, https://doi.org/10.1016/j.snb.2016.07.092, 2017. 

Wang, C., Yin, L., Zhang, L., Xiang, D., and Gao, R.: Metal Oxide Gas Sensors: Sensitivity and Influencing Factors, Sensors-Basel, 10, 2088–2106, https://doi.org/10.3390/s100302088, 2010. 

Download
Short summary
Methane is a major greenhouse gas and contributor to climate change with various human-caused and natural sources. Currently, atmospheric methane is expensive to sense. We investigate repurposing cheap methane safety sensors for atmospheric sensing, finding several promising sensors and identifying some of the challenges in this approach. This work will help in developing inexpensive sensor networks for methane monitoring, which will aid in reducing methane leaks and emissions.