Skip to main navigation Skip to search Skip to main content

A transition-based model for joint segmentation, POS-tagging and normalization

  • Tao Qian
  • , Yue Zhang
  • , Meishan Zhang*
  • , Yafeng Ren
  • , Donghong Ji
  • *Corresponding author for this work
  • Wuhan University
  • Hubei University of Science and Technology
  • Singapore University of Technology and Design

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We propose a transition-based model for joint word segmentation, POS tagging and text normalization. Different from previous methods, the model can be trained on standard text corpora, overcoming the lack of annotated microblog corpora. To evaluate our model, we develop an annotated corpus based on microblogs. Experimental results show that our joint model can help improve the performance of word segmentation on microblogs, giving an error reduction in segmentation accuracy of 12.02%, compared to the traditional approach.

Original languageEnglish
Title of host publicationConference Proceedings - EMNLP 2015
Subtitle of host publicationConference on Empirical Methods in Natural Language Processing
PublisherAssociation for Computational Linguistics (ACL)
Pages1837-1846
Number of pages10
ISBN (Electronic)9781941643327
DOIs
StatePublished - 2015
Externally publishedYes
EventConference on Empirical Methods in Natural Language Processing, EMNLP 2015 - Lisbon, Portugal
Duration: 17 Sep 201521 Sep 2015

Publication series

NameConference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Conference

ConferenceConference on Empirical Methods in Natural Language Processing, EMNLP 2015
Country/TerritoryPortugal
CityLisbon
Period17/09/1521/09/15

Fingerprint

Dive into the research topics of 'A transition-based model for joint segmentation, POS-tagging and normalization'. Together they form a unique fingerprint.

Cite this