Skip to main navigation Skip to search Skip to main content

Clustering image search results by entity disambiguation

  • Kaiqi Zhao
  • , Zhiyuan Cai
  • , Qingyu Sui
  • , Enxun Wei
  • , Kenny Q. Zhu*
  • *Corresponding author for this work
  • Shanghai Jiao Tong University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Existing key-word based image search engines return images whose title or immediate surrounding text contains the search term as a keyword. When the search term is ambiguous and means different things, the results often come in a mixed bag of different entities. This paper proposes a novel framework that understands the context and thus infers the most likely entity in the given image by disambiguating the terms in the context into the corresponding concepts from external knowledge in a process called conceptualization. The images can subsequently be clustered by the most likely associated entities. This approach outperforms the best competing image clustering techniques by 29.2% in NMI score. In addition, the framework automatically annotates each cluster of images by its key entities which allows users to quickly identify the images they want.

Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases - European Conference, ECML PKDD 2014, Proceedings
PublisherSpringer Verlag
Pages369-384
Number of pages16
EditionPART 3
ISBN (Print)9783662448441
DOIs
StatePublished - 2014
Externally publishedYes
Event14th Joint European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2014 - Nancy, France
Duration: 15 Sep 201419 Sep 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 3
Volume8726 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th Joint European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2014
Country/TerritoryFrance
CityNancy
Period15/09/1419/09/14

Fingerprint

Dive into the research topics of 'Clustering image search results by entity disambiguation'. Together they form a unique fingerprint.

Cite this