Abstract
Character-based and word-based methods are two different solutions for Chinese word segmentation, the former exploiting sequence labeling models over characters and the latter using word-level features. Neural models have been exploited for character-based Chinese word segmentation, giving high accuracies by making use of external character embeddings, yet requiring less feature engineering. In this paper, we study a neural model for word-based Chinese word segmentation, by replacing the manually-designed discrete features with neural features in a transition-based word segmentation framework. Experimental results demonstrate that word features lead to comparable performance to the best systems in the literature, and a further combination of discrete and neural features obtains top accuracies on several benchmarks.
| Original language | English |
|---|---|
| Pages (from-to) | 923-953 |
| Number of pages | 31 |
| Journal | Journal of Artificial Intelligence Research |
| Volume | 63 |
| DOIs | |
| State | Published - Dec 2018 |
| Externally published | Yes |
Fingerprint
Dive into the research topics of 'Transition-based neural word segmentation using word-level features'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver