Characterization of inexpensive MOx sensor performance for trace methane detection
- 1Department of Bioproducts and Biosystems Engineering, University of Minnesota, 1390 Eckles Ave., St. Paul, MN 55108
- 2Department of Mechanical Engineering, Carnegie Mellon University, 5000 Forbes Ave., Pittsburgh, PA 15213
- 1Department of Bioproducts and Biosystems Engineering, University of Minnesota, 1390 Eckles Ave., St. Paul, MN 55108
- 2Department of Mechanical Engineering, Carnegie Mellon University, 5000 Forbes Ave., Pittsburgh, PA 15213
Abstract. Methane, a major contributor to climate change, is emitted by a variety of natural and anthropogenic sources. Commercially available lab-grade instruments for sensing trace methane are expensive, and previous efforts to develop inexpensive field-deployable trace methane sensors have had mixed results. Industrial and commercial metal oxide semiconductor (MOx) methane sensors, which are intended for leak detection and safety monitoring, can potentially be repurposed and adapted for low-concentration sensing. As an initial step towards developing a low-cost sensing system, we characterize the performance of five off-the-shelf MOx sensors for 2–10 ppm methane detection in a laboratory setting (Figaro Engineering TGS2600, TGS2602, TGS2611-C00, TGS2611-E00, and Henan Hanwei Electronics MQ4). We identify TGS2611-C00, TGS2611-E00, and MQ4 as promising for trace methane sensing, but show that variations in ambient humidity and temperature pose a challenge for the sensors in this application.
Daniel Furuta et al.
Status: open (extended)
-
RC1: 'Comment on amt-2022-110', Anonymous Referee #1, 24 May 2022
reply
It is an interesting manuscript, especially to researchers who’re building distributed or airborne monitoring systems with MOx gas sensors. Several similar papers have been published in AMT. So, the manuscript is a good fit to the journal. As a former user of TGS26XX sensors, I don’t see major technical problems. My specific comments are as follow:
- Why did the authors select a 10-kΩ voltage divider (resistor)? As shown in Figure 2, most MOx sensors had a resistance (Rs) far greater than 10 kΩ during the experiment. From a circuit standpoint, a voltage divider with resistance close to typical Rs values would make the measurement more sensitive or accurate. A relevant question is – why 10-kΩ for all sensors?
- Figure 1: What was the inlet airflow rate? To my understanding, the LI-7810 analyzer has a sampling airflow rate of 0.25 LPM. Did this go back to the testing chamber?
- (Again) Figure 1: What was the response time of the LI-7810 analyzer, considering the length of tubing, averaging time, and so on? Did the authors synchronize the readings from MOx sensors and the LI-7810 by considering response time differences?
- (Again) Figure 1: I saw quite a few capacitors on the PCB. Please briefly explain their purpose (to avoid unnecessary confusion regarding the measurement circuit).
- Please provide the ADC’s bit info for LabJack T7. As per the company, a LabJack T7 may use an ADC from 12 to 24-bit. The number of bits can have a large influence on the resolution of acquired data, especially for high Rs
- Line 149: Vs is a bit misleading. It is the voltage drop across the 10-kΩ voltage divider instead of the sensor (Rs). I suggest the authors use a different subscript.
- Equation 2: Even though the sensors are heated, they still suffer from temperature variation, which in turn would influence the sensors’ resistance. That being said, why was temperature not included in the calibration equation?
- Figure 2: A side note – The highest Rs we observed for TGS2600 at ~2 ppm was close to 800 kΩ. That was achieved by filtering out all VOCs and water vapors.
- Line 187: As per Figure 2, the relative humidity decreased with an increase in temperature. To me, this is related to the temperature dependency of vapor pressure. I would suggest the authors remove “likely as the result of a condensation and evaporation cycle.”
- Line 195-196: I suggest the use of r instead of R for Pearson’s correlation coefficients, to avoid unnecessary confusion (R versus R2).
- Figure 4: Were all the three sensors of the same model coming from the same batch of products? Different batches of sensors could differ in response factors.
- I would suggest the authors offer a discussion about the potential application scenarios of those CH4 sensors for ambient air and source measurement towards the end of the manuscript.
- A final thought: As per the Figaro Company, the TGS26XX sensors’ response is nearly linear (Rs/R0 versus gas concentration) on a log-log graph. I just feel there could be a calibration equation better fitting the experimental data than equation 2. Here comes a question – why was general linear regression used to build the calibration curve?
-
AC1: 'Reply on RC1', Daniel Furuta, 06 Jun 2022
reply
Thank you for your perceptive and thorough comments. For the most part, we agree with your notes and requests for clarification. We respond point-by-point.
- Why did the authors select a 10-kΩ voltage divider (resistor)? As shown in Figure 2, most MOx sensors had a resistance (Rs) far greater than 10 kΩ during the experiment. From a circuit standpoint, a voltage divider with resistance close to typical Rs values would make the measurement more sensitive or accurate. A relevant question is – why 10-kΩ for all sensors?
We agree that 10 kΩ may not be an optimal resistance. As Fig. 4 illustrates, we found Rs for TGS2600 and TGS2602 in the 10 to 30 kΩ; TGS2611-C00 in the 20 to 40 kΩ range, and TGS2611-E00 and MQ4 in the 40 to 125 kΩ range. We selected the voltage divider values as a best guess for a reasonable resistance from manufacturer datasheets and a quick initial test. Interestingly and, we believe, coincidentally, the measurements with the worst sensitivity (MQ4 and TGS2611-E00) showed the best performance.
Figures 2 and 4 provides enough information to pick better resistance values for future work, as they show the expected resistance ranges for the sensors in these conditions; we will add a note to this extent in the discussion.
- Figure 1: What was the inlet airflow rate? To my understanding, the LI-7810 analyzer has a sampling airflow rate of 0.25 LPM. Did this go back to the testing chamber?
As the reviewer notes, the reference instrument has a flow rate of 0.25 LPM. We had no other pump in the system, and so airflow into the test chamber was the same 0.25 LPM. The outlet of the LI-7810 was vented to the outside laboratory, causing the gradual decrease in methane concentration in the test chamber for each pulse.
- (Again) Figure 1: What was the response time of the LI-7810 analyzer, considering the length of tubing, averaging time, and so on? Did the authors synchronize the readings from MOx sensors and the LI-7810 by considering response time differences?
The reference analyzer was connected to the test chamber by a short length of small-diameter tubing. We found that the LI-7810 responded to the methane pulse injections into the test chamber within seconds. As we averaged all measurements to the minute and the pulse decay to background took place over a relatively long time scale, we considered this error negligible and did not synchronize the readings beyond aligning system clocks for the various devices.
- (Again) Figure 1: I saw quite a few capacitors on the PCB. Please briefly explain their purpose (to avoid unnecessary confusion regarding the measurement circuit).
The capacitors in Fig. 1 (the small red and brown components seen on the PCB) were for power supply bypassing, to reduce the effect of power supply noise and to isolate the effects of any transients. As we were using a bench power supply for this experiment these components were likely unnecessary. As the reviewer suggests, the capacitors were not in the direct path of the measurement circuit.
- Please provide the ADC’s bit info for LabJack T7. As per the company, a LabJack T7 may use an ADC from 12 to 24-bit. The number of bits can have a large influence on the resolution of acquired data, especially for high Rs
Our setup used the default T7 settings, which correspond to an effective bit depth of 19.1 bits, and an effective resolution of 37 μV as per the company (https://labjack.com/support/datasheets/t-series/appendix-a-3-2-2-t7-noise-and-resolution). The largest Rs we observed was less than 150 kΩ; at a 150 kΩ resistance, a 37 μV change corresponds to a resistance change of around 0.013%. We believe that errors due to ADC resolution are likely insignificant compared to the uncertainty of the sensor itself, and likely even compared to overall electrical system noise.
As our measurements were also averaged to a longer time scale for analysis (from approximately one reading every five seconds to the minute scale), the actual accuracy may be somewhat better than this simple calculation.
- Line 149: Vs is a bit misleading. It is the voltage drop across the 10-kΩ voltage divider instead of the sensor (Rs). I suggest the authors use a different subscript.
We agree; VOUT would be more suitable.
- Equation 2: Even though the sensors are heated, they still suffer from temperature variation, which in turn would influence the sensors’ resistance. That being said, why was temperature not included in the calibration equation?
Due to limitations of our experimental setup, temperature and absolute humidity were highly correlated (Pearson’s r = 0.95, see Fig. 3). Accordingly, to avoid a non-generalizable improvement in R2 we chose to only include one of the two in our calibration equation, selecting absolute humidity for the stated reasons. As you correctly note, ambient temperature will also have an effect on sensor response. As we mentioned in our manuscript, these effects will need to be untangled in future work, and this should be a priority for further calibration work using these sensors.
- Figure 2: A side note – The highest Rs we observed for TGS2600 at ~2 ppm was close to 800 kΩ. That was achieved by filtering out all VOCs and water vapors.
Thank you for the interesting note. This very high resistance likely emphasizes further the importance of environmental conditions in the sensor response (as compared to 10 to 30 kΩ we found in normal humidity levels).
- Line 187: As per Figure 2, the relative humidity decreased with an increase in temperature. To me, this is related to the temperature dependency of vapor pressure. I would suggest the authors remove “likely as the result of a condensation and evaporation cycle.”
We agree that this effect is responsible for some of the change in relative humidity. However, we also saw a cycle in absolute humidity levels along with temperature. We believe this was the result of some moisture condensing on and evaporating from the walls of the test chamber as the temperature cycled.
- Line 195-196: I suggest the use of r instead of R for Pearson’s correlation coefficients, to avoid unnecessary confusion (R versus R2).
We agree.
- Figure 4: Were all the three sensors of the same model coming from the same batch of products? Different batches of sensors could differ in response factors.
The Figaro sensors of each type were taken from the same batch. The MQ4 does not appear to have a batch code printed on it; the MQ4 sensors were ordered from the distributor at the same time, but they were individually packaged and so we are unsure whether they were from the same batch. This could be a possible influence on the greater variability for the MQ4 than for the Figaro sensors. We agree that evaluating the sensors for batch-to-batch consistency can be an important addition to future work.
- I would suggest the authors offer a discussion about the potential application scenarios of those CH4 sensors for ambient air and source measurement towards the end of the manuscript.
Thank you for this suggestion. Other reviewers mentioned the same issue. Prior to the preprint we revised the discussion section to emphasize this important question. In particular, we believe some of these sensors may be usable as-is for natural gas leak detection in urban areas or around fossil fuel infrastructure; it is also possible that more sophisticated algorithms or system design that reduces environmental influences may allow ambient air measurement around atmospheric levels.
- A final thought: As per the Figaro Company, the TGS26XX sensors’ response is nearly linear (Rs/R0 versus gas concentration) on a log-log graph. I just feel there could be a calibration equation better fitting the experimental data than equation 2. Here comes a question – why was general linear regression used to build the calibration curve?
We did try fitting log-transformed data, and did not find meaningful performance improvement. The manufacturer curves for most of the sensors (excepting TGS2600) lack data in the methane concentration range we examined; possibly the sensor response in this very low range (relative to design parameters) is not linear.
We agree that Equation 2 is a crude calibration equation, and we do not propose it as necessarily the best option for a sensing system using these sensors. As our goal was to compare these devices and their sensitivity to environmental conditions, we thought a simple linear model was suited to roughly evaluating sensor response to methane and humidity/temperature, while being relatively robust with a low risk of overfitting. For real-world use, a more sophisticated model (whether non-linear regression, machine learning, or something else) might provide better performance, but we think it unlikely that a better algorithm will upend the relative performance of these sensors.
As we note in Section 4.1, our RMSE and R2 values are similar to those found in some previous studies. Two previous studies found better error values for TGS2600. Riddick et al. (2020a) had uncertainty of 0.01 ppm, but only an R2 of 0.23 for their best model, as compared to our R2 of 0.16. Collier-Oxendale et al. (2018) also found good performance for TGS2600 in a field study with more sophisticated algorithms, but found different algorithms to perform better at their two sites - due to the complexities of real-world deployments, there may be more influence from site-specific effects or overfitting than in our relatively controlled laboratory environment. Although we agree with the reviewer that more sophisticated algorithms could perform better, we feel that the general “ballpark” agreement of our results with previously published work supports our overall conclusions.
-
RC2: 'Reply on AC1', Anonymous Referee #1, 14 Jun 2022
reply
The authors have properly addressed most of my comments – Great work! (Not intend to be picky) I have a few further comments on their response.
Original comment and response #1:
- (Again) Figure 1: What was the response time of the LI-7810 analyzer, considering the length of tubing, averaging time, and so on? Did the authors synchronize the readings from MOx sensors and the LI-7810 by considering response time differences?
The reference analyzer was connected to the test chamber by a short length of small-diameter tubing. We found that the LI-7810 responded to the methane pulse injections into the test chamber within seconds. As we averaged all measurements to the minute and the pulse decay to background took place over a relatively long time scale, we considered this error negligible and did not synchronize the readings beyond aligning system clocks for the various devices.
Comments: I would suggest the authors list the response time of LI-7810 since it is an optical gas meter. As per the instrument supplier, LI-7810 has a response time of 2 sec for CH4 between 0-2 ppm (without considering the transfer time in tubing’s). This is in fact very fast for an optical gas meter. Providing such information won’t hurt (but rather help) the manuscript.
Original comment and response #2:
- Please provide the ADC’s bit info for LabJack T7. As per the company, a LabJack T7 may use an ADC from 12 to 24-bit. The number of bits can have a large influence on the resolution of acquired data, especially for high Rs
Our setup used the default T7 settings, which correspond to an effective bit depth of 19.1 bits, and an effective resolution of 37 μV as per the company (https://labjack.com/support/datasheets/t-series/appendix-a-3-2-2-t7-noise-and-resolution). The largest Rs we observed was less than 150 kΩ; at a 150 kΩ resistance, a 37 μV change corresponds to a resistance change of around 0.013%. We believe that errors due to ADC resolution are likely insignificant compared to the uncertainty of the sensor itself, and likely even compared to overall electrical system noise.
As our measurements were also averaged to a longer time scale for analysis (from approximately one reading every five seconds to the minute scale), the actual accuracy may be somewhat better than this simple calculation.
Comments: The authors talked about noise-free bits. Such information is useful but not usually required as the bits are related to many factors such as sampling rates. Please simply provide the ADC bit information. Based on the authors’ response, I guess it could be 24-bits, which is adequate for the sensor comparison experiments.
-
AC2: 'Reply on RC2', Daniel Furuta, 17 Jun 2022
reply
Thanks again for your detailed comments and suggestions. We agree with both points and will incorporate them into the final revision.
- I would suggest the authors list the response time of LI-7810 since it is an optical gas meter. As per the instrument supplier, LI-7810 has a response time of 2 sec for CH4 between 0-2 ppm (without considering the transfer time in tubing’s). This is in fact very fast for an optical gas meter. Providing such information won’t hurt (but rather help) the manuscript.
We agree. The very fast response time for the instrument is another useful detail with regards to concerns about synchronization. We will add this information to the revision.
- The authors talked about noise-free bits. Such information is useful but not usually required as the bits are related to many factors such as sampling rates. Please simply provide the ADC bit information. Based on the authors’ response, I guess it could be 24-bits, which is adequate for the sensor comparison experiments.
We agree about concisely specifying bit information. The hardware ADC operates at 16 bits; the noise floor is lowered further by averaging, giving the effective bit rate we mentioned previously. The manufacturer discusses the noise and resolution at length (https://labjack.com/support/datasheets/t-series/appendix-a-3-2-2-t7-noise-and-resolution); we will simply state the 16-bit hardware depth with averaging for 37 µV nominal effective resolution in the revision, and cite the datasheet for the details.
Daniel Furuta et al.
Data sets
Dataset for "Characterization of inexpensive MOx sensor performance for trace methane detection" Furuta, Daniel; Sayahi, Tofigh; Li, Jinsheng; Wilson, Bruce; Presto, Albert; Li, Jiayu https://conservancy.umn.edu/handle/11299/226714
Daniel Furuta et al.
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
311 | 71 | 9 | 391 | 1 | 1 |
- HTML: 311
- PDF: 71
- XML: 9
- Total: 391
- BibTeX: 1
- EndNote: 1
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1