Multiagent-based processing and integration of system data

Khamisi Kalegele, Johan Sveholm, Hideyuki Takahashi, Kazuto Sasai, Gen Kitagata, Tetsuo Kinoshita

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

This paper presents a multiagent-based ETL (Extract, Transform, Load) unit for the processing and integration of system operational data in order to improve its value. Operational data plays a vital role in managing and optimising systems. Although KDD (Knowledge Discovery and Data Mining) techniques and concepts have long existed, it is only now that we are seeing real applications being extended onto network and systems management. However, the massive data pre-processing (e.g. feature extraction and data integration) which is needed prior to putting KDD tools in action, is still limiting the extent of exploitation. We propose and design the multiagent-based ETL unit which uses Support Vector Machine and Natural Language Processing techniques to efficiently extract information features from operational data. The unit uses an mSPIDER algorithm to discover INclusion Dependencies (INDs) which are used to integrate data across its peers within the system. We demonstrate efficiency of the unit and the used approaches using operational data from a mailing system.

Original languageEnglish
Pages (from-to)128-155
Number of pages28
JournalInternational Journal of Intelligent Systems Technologies and Applications
Volume12
Issue number2
DOIs
Publication statusPublished - 2013

Keywords

  • Data integration
  • Multiagent system
  • Network and systems management

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Multiagent-based processing and integration of system data'. Together they form a unique fingerprint.

Cite this