Unsupervised Anomaly Detection in Spatio-Temporal Stream Network Sensor Data

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Santos-Fernandez, E
Ver Hoef, JM
Peterson, EE
McGree, J
Villa, CA
Leigh, C
Turner, R
Roberts, C
Mengersen, K
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2024
Size
File type(s)
Location
Abstract

The use of in-situ digital sensors for water quality monitoring is becoming increasingly common worldwide. While these sensors provide near real-time data for science, the data are prone to technical anomalies that can undermine the trustworthiness of the data and the accuracy of statistical inferences, particularly in spatial and temporal analyses. Here we propose a framework for detecting anomalies in sensor data recorded in stream networks, which takes advantage of spatial and temporal autocorrelation to improve detection rates. The proposed framework involves the implementation of effective data imputation to handle missing data, alignment of time-series to address temporal disparities, and the identification of water quality events. We explore the effectiveness of a suite of state-of-the-art statistical methods including posterior predictive distributions, finite mixtures, and Hidden Markov Models (HMM). We showcase the practical implementation of automated anomaly detection in near-real time by employing a Bayesian recursive approach. This demonstration is conducted through a comprehensive simulation study and a practical application to a substantive case study situated in the Herbert River, located in Queensland, Australia, which flows into the Great Barrier Reef. We found that methods such as posterior predictive distributions and HMM produce the best performance in detecting multiple types of anomalies. Utilizing data from multiple sensors deployed relatively near one another enhances the ability to distinguish between water quality events and technical anomalies, thereby significantly improving the accuracy of anomaly detection. Thus, uncertainty and biases in water quality reporting, interpretation, and modeling are reduced, and the effectiveness of subsequent management actions improved.

Journal Title

Water Resources Research

Conference Title
Book Title
Edition
Volume

60

Issue

11

Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2024. The Author(s). This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Item Access Status
Note
Access the data
Related item(s)
Subject

Hydrology

Civil engineering

Environmental engineering

Persistent link to this record
Citation

Santos-Fernandez, E; Ver Hoef, JM; Peterson, EE; McGree, J; Villa, CA; Leigh, C; Turner, R; Roberts, C; Mengersen, K, Unsupervised Anomaly Detection in Spatio-Temporal Stream Network Sensor Data, Water Resources Research, 2024, 60 (11), pp. e2023WR035707

Collections