Issue 4, 2019

Outlier detection and gap filling methodologies for low-cost air quality measurements

Abstract

Air pollution is a major environmental health problem around the world, which needs to be monitored. In recent years, a new generation of low-cost air pollution sensors has emerged. Poor or unknown data quality, resulting from the intrinsic properties of the sensor as well as the lack of a consensus on data processing methodologies for these sensors, has, among other factors, prevented widespread adoption of these sensors. To contribute to the creation of this consensus, we reviewed the available methodologies for quality control, outlier detection and gap filling and applied two outlier detection methodologies and five gap filling methodologies to a case study (consisting of an 11-month long air quality data set from a low-cost sensor). We showed that erroneous data can be detected in a fully automated way, and that point and contextual outlier detection methodologies can be applied to low-cost air pollution data and yield meaningful results. The linear interpolation showed the best performance for gap filling for low-cost air pollution sensors. In conclusion, data cleaning procedures are important, and the presented methods can form part of a generalised data processing methodology for low-cost air pollution sensors.

Graphical abstract: Outlier detection and gap filling methodologies for low-cost air quality measurements

Supplementary files

Article information

Article type
Paper
Submitted
26 Dec 2018
Accepted
19 Feb 2019
First published
22 Feb 2019

Environ. Sci.: Processes Impacts, 2019,21, 701-713

Outlier detection and gap filling methodologies for low-cost air quality measurements

T. Ottosen and P. Kumar, Environ. Sci.: Processes Impacts, 2019, 21, 701 DOI: 10.1039/C8EM00593A

To request permission to reproduce material from this article, please go to the Copyright Clearance Center request page.

If you are an author contributing to an RSC publication, you do not need to request permission provided correct acknowledgement is given.

If you are the author of this article, you do not need to request permission to reproduce figures and diagrams provided correct acknowledgement is given. If you want to reproduce the whole article in a third-party publication (excluding your thesis/dissertation for which permission is not required) please go to the Copyright Clearance Center request page.

Read more about how to correctly acknowledge RSC content.

Social activity

Spotlight

Advertisements