Learning Morphology for Open-Vocabulary Neural Machine Translation

State-of-the-art neural machine translation systems typically have low accuracy in translating rare or unseen words due to the requirement of using a fixed-size word vocabulary during training. In addition to controlling the model complexity, this limitation is also related to the difficulty of learning accurate word representations under conditions of high data sparsity. This problem is an important bottleneck on performance, especially in morphologically-rich languages, where the word vocabulary tends to be huge and sparse. In this dissertation, we propose to solve the vocabulary limitation problem in neural machine translation by integrating morphology learning within the translation model, aiding to learn richer word representations in terms of phonological and morphological information. Our model improves the accuracy while translating into low-resource and morphologically-rich languages and shows better generalization capability over varieties of languages with different morphological characteristics.

Grantor dc:publisher

Università degli studi di Trento

Year dc:date

2019

Author dc:creator

• Ataman, Duygu

Contributors dc:contributor

• Federico, Marcello

• Settore INF/01 - Informatica
• Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni

Statement dc:rights

• info:eu-repo/semantics/openAccess
• license:Tutti i diritti riservati (All rights reserved)
• license uri:iris.PRI01

Language dc:language

eng

Identifier

http://dx.doi.org/10.15168/11572_368927
10.15168/11572_368927

OAI identifier oai:identifier

oai:iris.unitn.it:11572/368927