Title
Filter Large-Scale Engine Data Using Apache Spark
Abstract
This paper introduces a minimum viable software product to filter large datasets of engine data recorded during laboratory experiments of combustion engines. The aim is to support analysts in the identification and analysis of specific physical phenomenon within hours of recorded engine experimental data. Specifically, the tool has been designed considering the use case of identifying Low Speed Pre-Ignition events. This work describes the tool's graphical user interface and its scalable architecture based on mainstream web and big-data technologies as well as the practical application to pre-ignition events identification. The paper provides details on the architecture's performance, providing evidence of its scalability by increasing the number of available computing workers.
Year
Venue
Keywords
2016
2016 IEEE 14TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN)
Data Visualisation, Data Exploration, Combustion Engine Experimental Data, Big-data Technologies
Field
DocType
ISSN
Information system,Data visualization,Search engine,Spark (mathematics),Real-time computing,Software,Graphical user interface,Engineering,Big data,Scalability
Conference
1935-4576
Citations 
PageRank 
References 
0
0.34
0
Authors
6
Name
Order
Citations
PageRank
Donato Pirozzi1439.28
Vittorio Scarano260971.49
Steven Begg361.52
Guillaume de Sercey401.01
A. Fish524722.48
Andrew Harvey600.34