Skip to main navigation Skip to search Skip to main content

Join query processing in data quality management

  • School of Computer Science and Technology, Harbin Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Data quality management is the essential problem for information systems. As a basic operation of Data quality management, joins on large-scale data play an important role in document clustering. MapReduce is a programming model which is usually applied to process large-scale data. Many tasks can be implemented under the framework, such as data processing of search engines and machine learning. However, there is no efficient support for join operation in current implementations of MapReduce. In this paper, we present a strategies to build the extend bloom filter for the large dataset using MapReduce. We use the extend bloom filter to improve the performance of two-way and multi-way joins.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - DASFAA 2016 International Workshops
Subtitle of host publicationBDMS, BDQM, MoI, and SeCoP, Proceedings
EditorsJinho Kim, Hong Gao, Yasushi Sakurai
PublisherSpringer Verlag
Pages329-342
Number of pages14
ISBN (Print)9783319320540
DOIs
StatePublished - 2016
Externally publishedYes
EventInternational Workshop on Database Systems for Advanced Applications, DASFAA 2016 - Dallas, United States
Duration: 16 Apr 201619 Apr 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9645
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Workshop on Database Systems for Advanced Applications, DASFAA 2016
Country/TerritoryUnited States
CityDallas
Period16/04/1619/04/16

Keywords

  • Bloom filter
  • Data quality management
  • Join
  • MapReduce

Fingerprint

Dive into the research topics of 'Join query processing in data quality management'. Together they form a unique fingerprint.

Cite this