Automating Root Cause Analysis via Machine Learning in Agile Software Testing Environments

Julen Kahles, Juha Torronen, Timo Huuhtanen, Alexander Jung

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

215 Downloads (Pure)

Abstract

We apply machine learning to automate the root cause analysis in agile software testing environments. In particular, we extract relevant features from raw log data after interviewing testing engineers (human experts). Initial efforts are put into clustering the unlabeled data, and despite obtaining weak correlations between several clusters and failure root causes, the vagueness in the rest of the clusters leads to the consideration of labeling. A new round of interviews with the testing engineers leads to the definition of five ground-truth categories. Using manually labeled data, we train artificial neural networks that either classify the data or pre-process it for clustering. The resulting method achieves an accuracy of 88.9%. The methodology of this paper serves as a prototype or baseline approach for the extraction of expert knowledge and its adaptation to machine learning techniques for root cause analysis in agile environments.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE 12th International Conference on Software Testing, Verification and Validation, ICST 2019
PublisherIEEE
Pages379-390
Number of pages12
ISBN (Electronic)9781728117355
DOIs
Publication statusPublished - 1 Apr 2019
MoE publication typeA4 Article in a conference publication
EventIEEE International Conference on Software Testing, Verification and Validation - Xi'an, China
Duration: 22 Apr 201927 Apr 2019
Conference number: 12

Conference

ConferenceIEEE International Conference on Software Testing, Verification and Validation
Abbreviated titleICST
CountryChina
CityXi'an
Period22/04/201927/04/2019

Keywords

  • Artificial neural networks
  • Automation
  • Classification
  • Clustering
  • Log data analysis
  • Machine learning
  • Root cause analysis
  • Software testing

Fingerprint Dive into the research topics of 'Automating Root Cause Analysis via Machine Learning in Agile Software Testing Environments'. Together they form a unique fingerprint.

  • Cite this

    Kahles, J., Torronen, J., Huuhtanen, T., & Jung, A. (2019). Automating Root Cause Analysis via Machine Learning in Agile Software Testing Environments. In Proceedings - 2019 IEEE 12th International Conference on Software Testing, Verification and Validation, ICST 2019 (pp. 379-390). [8730163] IEEE. https://doi.org/10.1109/ICST.2019.00047