Ranking episodes using a partition model

Nikolaj Tatti*

*Corresponding author for this work

    Research output: Contribution to journalArticleScientificpeer-review

    8 Citations (Scopus)

    Abstract

    One of the biggest setbacks in traditional frequent pattern mining is that overwhelmingly many of the discovered patterns are redundant. A prototypical example of such redundancy is a freerider pattern where the pattern contains a true pattern and some additional noise events. A technique for filtering freerider patterns that has proved to be efficient in ranking itemsets is to use a partition model where a pattern is divided into two subpatterns and the observed support is compared to the expected support under the assumption that these two subpatterns occur independently. In this paper we develop a partition model for episodes, patterns discovered from sequential data. An episode is essentially a set of events, with possible restrictions on the order of events. Unlike with itemset mining, computing the expected support of an episode requires surprisingly sophisticated methods. In order to construct the model, we partition the episode into two subepisodes. We then model how likely the events in each subepisode occur close to each other. If this probability is high—which is often the case if the subepisode has a high support—then we can expect that when one event from a subepisode occurs, then the remaining events occur also close by. This approach increases the expected support of the episode, and if this increase explains the observed support, then we can deem the episode uninteresting. We demonstrate in our experiments that using the partition model can effectively and efficiently reduce the redundancy in episodes.

    Original languageEnglish
    Pages (from-to)1312-1342
    Number of pages31
    JournalData Mining and Knowledge Discovery
    Volume29
    Issue number5
    DOIs
    Publication statusPublished - 22 Sep 2015
    MoE publication typeA1 Journal article-refereed

    Keywords

    • Episode mining
    • Partition model
    • Pattern ranking

    Fingerprint Dive into the research topics of 'Ranking episodes using a partition model'. Together they form a unique fingerprint.

  • Cite this