Title:
|
Neural network language models to select the best translation
|
Author:
|
Khalilov, Maxim; Rodríguez Fonollosa, José Adrián; Zamora Martínez, Francisco; Castro Bleda, María José; España Boquera, Salvador
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions; Universitat Politècnica de Catalunya. VEU - Grup de Tractament de la Parla |
Abstract:
|
The quality of translations produced by statistical machine translation (SMT) systems crucially
depends on the generalization ability provided by the statistical models involved in the process.
While most modern SMT systems use n-gram models to predict the next element in a sequence
of tokens, our system uses a continuous space language model (LM) based on neural networks
(NN). In contrast to works in which the NN LM is only used to estimate the probabilities of
shortlist words (Schwenk 2010), we calculate the posterior probabilities of out-of-shortlist words
using an additional neuron and unigram probabilities. Experimental results on a small Italian-
to-English and a large Arabic-to-English translation task, which take into account di erent word
history lengths (n-gram order), show that the NN LMs are scalable to small and large data and
can improve an n-gram-based SMT system. For the most part, this approach aims to improve
translation quality for tasks that lack translation data, but we also demonstrate its scalability to
large-vocabulary tasks. |
Abstract:
|
Peer Reviewed |
Subject(s):
|
-Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural -Natural language processing (Computer science) -Automatic speech recognition -Tractament del llenguatge natural (Informàtica) -Reconeixement automàtic de la parla |
Rights:
|
Attribution-NonCommercial-NoDerivs 3.0 Spain
http://creativecommons.org/licenses/by-nc-nd/3.0/es/ |
Document type:
|
Article - Published version Article |
Share:
|
|