Skip to main navigation Skip to search Skip to main content

pq-Hash: An Efficient method for approximate XML joins

  • Fei Li*
  • , Hongzhi Wang
  • , Liang Hao
  • , Jianzhong Li
  • , Hong Gao
  • *Corresponding author for this work
  • School of Computer Science and Technology, Harbin Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Approximate matching between large tree sets is broadly used in many applications such as data integration and XML de-duplication. However, most existing methods suffer for low efficiency, thus do not scale to large tree sets. pq-gram is a widely-used method with high quality of matches. In this paper, we propose pq-hash as an improvement to pq-gram. As the base of pq-hash, a randomized data structure, pq-array, is developed. With pq-array, large trees are represented as small fixed sized arrays. Sort-merge and hash join technique is applied based on these pq-arrays to avoid nested-loop join. From theoretical analysis and experimental results, retaining high join quality, pq-hash gains much higher efficiency than pq-gram.

Original languageEnglish
Title of host publicationWeb-Age Information Management - WAIM 2010 International Workshops
Subtitle of host publicationIWGD 2010, XMLDM 2010, WCMT 2010, Revised Selected Papers
Pages125-134
Number of pages10
DOIs
StatePublished - 2010
Externally publishedYes
Event1st International Workshop on Graph Database, IWGD 2010, 1st International Workshop on Advanced Techniques on XML Data Management, XMLDM 2010, 2nd International Workshop on WCMT 2010, Held in Conj. with WAIM 2010 - Jiuzhaigou, China
Duration: 15 Jul 201017 Jul 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6185 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st International Workshop on Graph Database, IWGD 2010, 1st International Workshop on Advanced Techniques on XML Data Management, XMLDM 2010, 2nd International Workshop on WCMT 2010, Held in Conj. with WAIM 2010
Country/TerritoryChina
CityJiuzhaigou
Period15/07/1017/07/10

Fingerprint

Dive into the research topics of 'pq-Hash: An Efficient method for approximate XML joins'. Together they form a unique fingerprint.

Cite this