Skip to main navigation Skip to search Skip to main content

Schema Integration on Massive Data Sources

  • Harbin Institute of Technology
  • ConDB

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As the fundamental phrase of collecting and analyzing data, data integration is used in many applications, such as data cleaning, bioinformatics and pattern recognition. In big data era, one of the major problems of data integration is to obtain the global schema of data sources since the global schema could be hardly derived from massive data sources directly. In this paper, we attempt to solve such schema integration problem. For different scenarios, we develop batch and incremental schema integration algorithms. We consider the representation difference of attribute names in various data sources and propose ED Join and Semantic Join algorithms to integrate attributes with different representations. Extensive experimental results demonstrate that the proposed algorithms could integrate schemas efficiently and effectively.

Original languageEnglish
Title of host publicationAlgorithms and Architectures for Parallel Processing - 23rd International Conference, ICA3PP 2023, Proceedings
EditorsZahir Tari, Keqiu Li, Hongyi Wu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages186-206
Number of pages21
ISBN (Print)9789819708000
DOIs
StatePublished - 2024
Event23rd International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2023 - Tianjin, China
Duration: 20 Oct 202322 Oct 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14488 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference23rd International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2023
Country/TerritoryChina
CityTianjin
Period20/10/2322/10/23

Keywords

  • Information integration
  • Schema integration
  • Schema mapping

Fingerprint

Dive into the research topics of 'Schema Integration on Massive Data Sources'. Together they form a unique fingerprint.

Cite this