|
Title:
|
UPF-cobalt submission to WMT15 metrics task
|
|
Author:
|
Fomicheva, Marina; Bel Rafecas, Núria; Da Cunha Fanego, Iria; Malinovskiy, Anton
|
|
Abstract:
|
Comunicació presentada a: 10th Workshop on Statistical Machine Translation, celebrat a Lisboa, Portugal, del 17 al 18 de setembre de 2015. |
|
Abstract:
|
An important limitation of automatic evaluation metrics is that, when comparing Machine Translation (MT) to a human reference, they are often unable to discriminate between acceptable variation and the differences that are indicative of MT errors. In this paper we present UPF-Cobalt evaluation system that addresses this issue by penalizing the differences in the syntactic contexts of aligned candidate and reference words. We evaluate our metric using the data from WMT workshops of the recent years and show that it performs competitively both at segment and at system levels. |
|
Abstract:
|
This work was supported by IULA (UPF) and the FIDGR grant program of the Generalitat de Catalunya. |
|
Subject(s):
|
-Statistical Machine Translation
-Evaluation metrics |
|
Rights:
|
© ACL, Creative Commons Attribution 3.0 License
https://creativecommons.org/licenses/by/3.0/
|
|
Document type:
|
Conference Object
Article - Published version |
|
Published by:
|
ACL (Association for Computational Linguistics)
|
|
Share:
|
|
