Title
Active Learning with Rationales for Identifying Operationally Significant Anomalies in Aviation.
Abstract
A major focus of the commercial aviation community is discovery of unknown safety events in flight operations data. Data-driven unsupervised anomaly detection methods are better at capturing unknown safety events compared to rule-based methods which only look for known violations. However, not all statistical anomalies that are discovered by these unsupervised anomaly detection methods are operationally significant (e.g., represent a safety concern). Subject Matter Experts (SMEs) have to spend significant time reviewing these statistical anomalies individually to identify a few operationally significant ones. In this paper we propose an active learning algorithm that incorporates SME feedback in the form of rationales to build a classifier that can distinguish between uninteresting and operationally significant anomalies. Experimental evaluation on real aviation data shows that our approach improves detection of operationally significant events by as much as 75% compared to the state-of-the-art. The learnt classifier also generalizes well to additional validation data sets.
Year
DOI
Venue
2016
10.1007/978-3-319-46131-1_25
Lecture Notes in Artificial Intelligence
Field
DocType
Volume
Warning system,Data mining,Anomaly detection,Data set,Active learning,Subject-matter expert,Computer science,Aviation,Classifier (linguistics),Commercial aviation
Conference
9853
ISSN
Citations 
PageRank 
0302-9743
2
0.46
References 
Authors
9
6
Name
Order
Citations
PageRank
Manali Sharma1363.15
Kamalika Das216813.46
Mustafa Bilgic363129.31
Bryan L. Matthews4806.15
David Nielsen520.46
nikunj c oza669454.32