White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Improving data quality for low-cost environmental sensors

FANG, XINWEI (2018) Improving data quality for low-cost environmental sensors. PhD thesis, University of York.

This is the latest version of this item.

XINWIFANG_PHD_Thesis.pdf - Examined Thesis (PDF)
Available under License Creative Commons Attribution-Noncommercial-No Derivative Works 2.0 UK: England & Wales.

Download (14Mb) | Preview


Using low-cost sensors to monitor the urban environment has become increasingly popular, as they can provide better data resolution than current practices. However, these low-cost sensors often produce poorer data quality, and so the data may not be utilised directly without processing. This thesis presents a two-phase solution for improving the data quality of low-cost environmental sensors. The solution consists of a novel method for anomaly detection and removal, and a process of sensor calibration. In the first phase, an anomaly model is utilised to identify the anomalies, which is constructed using a Bayesian-based approach. New contextual information is used to build the anomaly model, that is to the best of our knowledge the first time it has been used for such purpose. The result shows that this solution is more practical and robust than the existing approaches. In the second phase, a systematic comparison of the state-of-the-art calibration approaches is performed. The comparison aims to understand the difference between the methods, and the result shows a regression based method could provide a more predicable result and require much less computational resources. As a result, a regression based method is used for calibrating sensors in this work. In contrast to the existing approaches, the proposed method for calibration is able to systematically and automatically select the calibration parameters. The parameter selection ensures the best set of parameters are used in the model, which makes the calibration process less sensitive to different environmental conditions. The overall evaluations are performed using real datasets. The results show the data quality in terms of general accuracy against the reference instruments can be significantly improved, especially for sensors at roadside.

Item Type: Thesis (PhD)
Academic Units: The University of York > Computer Science (York)
Identification Number/EthosID: uk.bl.ethos.752638
Depositing User: Dr. XINWEI FANG
Date Deposited: 28 Aug 2018 14:52
Last Modified: 19 Feb 2020 13:03
URI: http://etheses.whiterose.ac.uk/id/eprint/21259

Available Versions of this Item

  • Improving data quality for low-cost environmental sensors. (deposited 28 Aug 2018 14:52) [Currently Displayed]

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)