2026-04-13T15:21:19Zhttps://recercat.cat/oai/request

oai:recercat.cat:2117/1048082026-02-11T04:45:29Zcom_2072_1033col_2072_452950

00925njm 22002777a 4500 dc Ruiz Costa-Jussà, Marta author Farrus, Mireia author 2013-12-01 When evaluating machine translation outputs, linguistics is usually taken into account implicitly. Annotators have to decide whether a sentence is better than another or not, using, for example, adequacy and fluency criteria or, as recently proposed, editing the translation output so that it has the same meaning as a reference translation, and it is understandable. Therefore, the important fields of linguistics of meaning (semantics) and grammar (syntax) are indirectly considered. In this study, we propose to go one step further towards a linguistic human evaluation. The idea is to introduce linguistics implicitly by formulating precise guidelines. These guidelines strictly mark the difference between the sub-fields of linguistics such as: morphology, syntax, semantics, and orthography. We show our guidelines have a high inter-annotation agreement and wide-error coverage. Additionally, we examine how the linguistic human evaluation data correlate with: among different types of machine translation systems (rule and statistical-based); and with adequacy and fluency. Peer Reviewed Postprint (published version) Àrees temàtiques de la UPC::Informàtica Automatic speech recognition Percepció del llenguatge Traducció automàtica Towards human linguistic machine translation evaluation