Skip to main navigation Skip to search Skip to main content

Answer selection in community question answering by normalizing support answers

  • Zhihui Zheng
  • , Daohe Lu
  • , Qingcai Chen*
  • , Haijun Yang
  • , Yang Xiang
  • , Youcheng Pan
  • , Wei Zhong
  • *Corresponding author for this work
  • Harbin Institute of Technology Shenzhen
  • WeBank Co. Ltd.

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Answer selection in community question answering (cQA) is a common task in natural language processing. Recent progress focuses on not only pure question-answer (QA) match but also support answers [4]. In this paper, we argue that the performance can drop dramatically if noisy support answers are selected. To tackle the above issue, we propose a novel way to leverage the contributions of support answers: the match scores which are firstly normalized by the correlations between the question and the corresponding similar questions, such that the negative effect from the noisy answers can be reduced. The model applies word-to-word attention to improve QA match and employs cosine similarity as the normalization factor for support answers. Compared with previous work, experiments on the Yahoo! Answers L4 dataset show that our model achieves superior P@1 and MRR results.

Original languageEnglish
Title of host publicationNatural Language Processing and Chinese Computing - 6th CCF International Conference, NLPCC 2017, Proceedings
EditorsXuanjing Huang, Jing Jiang, Dongyan Zhao, Yansong Feng, Yu Hong
PublisherSpringer Verlag
Pages672-682
Number of pages11
ISBN (Print)9783319736174
DOIs
StatePublished - 2018
Externally publishedYes
Event6th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2017 - Dalian, China
Duration: 8 Nov 201712 Nov 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10619 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2017
Country/TerritoryChina
CityDalian
Period8/11/1712/11/17

Keywords

  • Answer selection
  • Attention
  • Normalization
  • Support answer

Fingerprint

Dive into the research topics of 'Answer selection in community question answering by normalizing support answers'. Together they form a unique fingerprint.

Cite this