Context-aware, Composable Anomaly Detection in Large-scale Mobile Networks

Nguyen Ngoc Nhu Trang, Linh Truong

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

199 Downloads (Pure)

Abstract

In a large-scale mobile network, due to the diversity of data characteristics, detection purposes of operation teams, and analytics and machine learning algorithm abilities, building big data anomaly detection pipelines without considering different analytics and team situations may not yield expected quality of analytics, including detection relevancy, performance and quality. This is especially for analytics subjects, such as mobile network zones, of which characteristics are dynamic and contextual. Moreover, due to the lack of labeled data and the high cost of creating labeled data, building anomaly detection analytics models based on (supervised) deep learning or advanced models is even more challenging from various aspects of effort, cost and deployment. In this paper, we present a novel framework that enables anomaly detection through context-aware, composable components to provide efficient detection pipelines suitable for lightweight, resource constrained and geographical operation teams. First, we identify and categorize different types of analytics feature contexts and evaluate existing algorithms suitable for these contexts, mapping anomaly detection algorithms, patterns and configurations for data pre-processing and unsupervised detection tasks in individual analytics functionality. These context-specific pipelines detect anomalies and their relevancy for dynamic analytics subjects such as mobile network zones. Then we develop dynamic configuration and combination techniques for such pipelines to produce highly relevant, multi-context detection of anomalies. Our framework provides flexibility and configurations for team contexts to carry out the anomaly detection in the team’s operations. We will demonstrate our work through real data gathered for a large-scale mobile network covering multiple types of sites with different geographical zones and equipment. We especially focus on district zones and user-defined zones as analytics subjects that must be managed by teams in our experiments.
Original languageEnglish
Title of host publicationProceedings - 2023 IEEE 47th Annual Computers, Software, and Applications Conference, COMPSAC 2023
EditorsHossain Shahriar, Yuuichi Teranishi, Alfredo Cuzzocrea, Moushumi Sharmin, Dave Towey, AKM Jahangir Alam Majumder, Hiroki Kashiwazaki, Ji-Jiang Yang, Michiharu Takemoto, Nazmus Sakib, Ryohei Banno, Sheikh Iqbal Ahamed
PublisherIEEE
Pages183-192
Number of pages10
ISBN (Electronic)979-8-3503-2697-0
DOIs
Publication statusPublished - 2023
MoE publication typeA4 Conference publication
EventIEEE Annual Computer Software and Applications Conference - Torino, Italy
Duration: 26 Jun 202330 Jun 2023
Conference number: 47

Publication series

Name Proceedings : International Computer Software & Applications Conference
ISSN (Print)0730-3157

Conference

ConferenceIEEE Annual Computer Software and Applications Conference
Abbreviated titleCOMPSAC
Country/TerritoryItaly
CityTorino
Period26/06/202330/06/2023

Fingerprint

Dive into the research topics of 'Context-aware, Composable Anomaly Detection in Large-scale Mobile Networks'. Together they form a unique fingerprint.

Cite this