Abstract | ||
---|---|---|
Performing predictive modelling, such as anomaly detection, in Big Data is a difficult task. This problem is compounded as more and more sources of Big Data are generated from environmental sensors, logging applications, and the Internet of Things. Further, most current techniques for anomaly detection only consider the content of the data source, i.e. the data itself, without concern for the context of the data. As data becomes more complex it is increasingly important to bias anomaly detection techniques for the context, whether it is spatial, temporal, or semantic. The work proposed in this paper outlines a contextual anomaly detection technique for use in streaming sensor networks. The technique uses a well-defined content anomaly detection algorithm for real-time point anomaly detection. Additionally, we present a post-processing context-aware anomaly detection algorithm based on sensor profiles, which are groups of contextually similar sensors generated by a multivariate clustering algorithm. Our proposed research has been implemented and evaluated with real-world data provided by Powersmiths, located in Brampton, Ontario, Canada. |
Year | DOI | Venue |
---|---|---|
2014 | 10.1109/BigData.Congress.2014.19 | BigData Congress |
Keywords | Field | DocType |
big data analytics, contextual anomaly detection, predictive modelling, multivariate clustering,big data analytics,predictive modelling | Data source,Anomaly detection,Data mining,Computer science,Internet of Things,Predictive modelling,Cluster analysis,Big data,Detector,Wireless sensor network | Conference |
ISSN | Citations | PageRank |
2379-7703 | 10 | 0.55 |
References | Authors | |
9 | 2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Michael A. Hayes | 1 | 23 | 1.13 |
Miriam A. M. Capretz | 2 | 10 | 0.55 |