Skip to main navigation Skip to search Skip to main content

Cross-modal search on social networking systems by exploring Wikipedia concepts

  • Wei Wang*
  • , Xiaoyan Yang
  • , Shouxu Jiang
  • *Corresponding author for this work
  • National University of Singapore
  • Advanced Digital Sciences Center

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The increasing popularity of social networking systems (SNSs) has created large quantities of data from multiple modalities such as text and image. Retrieval of data, however, is constrained to a specific modality. Moreover, text on SNSs is usually short and noisy, and remains active for a (short) period. Such characteristics, conflicting with settings of traditional text search techniques, render them ineffective in SNSs. To alleviate these problems and bridge the gap between searches over different modalities, we propose a new algorithm that supports cross-modal search about social documents as text and images on SNSs. By exploiting Wikipedia concepts, text and images are transformed into a set of common concepts, based on which searches are conducted. A new ranking algorithm is designed to rank social documents based on their informativeness and semantic relevance to a query. We evaluate our ranking algorithm on both Twitter and Facebook datasets. The results confirm the effectiveness of our approach.

Original languageEnglish
Title of host publicationDigital Libraries
Subtitle of host publicationKnowledge, Information, and Data in an Open Access Society - 18th International Conference on Asia-Pacific Digital Libraries, ICADL 2016, Proceedings
EditorsAtsuyuki Morishima, Andreas Rauber, Chern li Liew
PublisherSpringer Verlag
Pages381-393
Number of pages13
ISBN (Print)9783319493039
DOIs
StatePublished - 2016
Event18th International Conference on Asia-Pacific Digital Libraries, ICADL 2016 - Tsukuba, Japan
Duration: 7 Dec 20169 Dec 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10075 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th International Conference on Asia-Pacific Digital Libraries, ICADL 2016
Country/TerritoryJapan
CityTsukuba
Period7/12/169/12/16

Fingerprint

Dive into the research topics of 'Cross-modal search on social networking systems by exploring Wikipedia concepts'. Together they form a unique fingerprint.

Cite this