Data discovery method for Extract- Transform-Load

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Researchers

Research units

Abstract

Information Systems (ISs) are fundamental to streamline operations and support processes of any modern enterprise. Being able to perform analytics over the data managed in various enterprise ISs is becoming increasingly important for organisational growth. Extract, Transform, and Load (ETL) are the necessary pre-processing steps of any data mining activity. Due to the complexity of modern IS, extracting data is becoming increasingly complicated and time-consuming. In order to ease the process, this paper proposes a methodology and a pilot implementation, that aims to simplify data extraction process by leveraging the end-users' knowledge and understanding of the specific IS. This paper first provides a brief introduction and the current state of the art regarding existing ETL process and techniques. Then, it explains in details the proposed methodology. Finally, test results of typical data-extraction tasks from four commercial ISs are reported.

Details

Original languageEnglish
Title of host publication2019 IEEE 10th International Conference on Mechanical and Intelligent Manufacturing Technologies, ICMIMT 2019
Publication statusPublished - 9 May 2019
MoE publication typeA4 Article in a conference publication
EventIEEE International Conference on Mechanical and Intelligent Manufacturing Technologies - Cape Town, South Africa
Duration: 15 Feb 201917 Feb 2019
Conference number: 10

Conference

ConferenceIEEE International Conference on Mechanical and Intelligent Manufacturing Technologies
Abbreviated titleICMIMT
CountrySouth Africa
CityCape Town
Period15/02/201917/02/2019

    Research areas

  • Data Discovery, Data Warehouse, Database, ETL, Information Retrieval, Information System, Process Mapping, Reverse Engineering, Trigger

Download statistics

No data available

ID: 34749773