A metric for determining the significance of failures and its use in anomaly detection case study: Mobile network management data from lte network

In big data analytics and machine learning applications on telecom network measurement data, accuracy of findings during the analysis phase greatly depends on the quality of the training data set. If the training data set contains data from Network Elements (NEs) with high number of failures and high failure rates, such behavior will be assumed as normal. As a result, the analysis phase will fail to detect NEs with such behavior. High failure ratios have traditionally been considered as signs of faults in NEs. Operators use wellknown Key Performance Indicators (KPIs), such as, e. g., Drop Call Ratio and Handover failure ratio to identify misbehaving NEs. The main problem with these KPIs based on failure ratios is their unstable nature. This paper proposes a method of measuring the significance of failures and its use in training set filtering.