To access the full text documents, please follow this link: http://hdl.handle.net/2117/11279

Automatic and human evaluation study of a rule-based and a statistical Catalan-Spanish machine translation systems
Ruiz Costa-Jussà, Marta; Farrús Cabeceran, Mireia; Mariño Acebal, José Bernardo; Rodríguez Fonollosa, José Adrián
Universitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions; Universitat Politècnica de Catalunya. VEU - Grup de Tractament de la Parla
Machine translation systems can be classified into rule-based and corpus-based approaches, in terms of their core technology. Since both paradigms have largely been used during the last years, one of the aims in the research community is to know how these systems differ in terms of translation quality. To this end, this paper reports a study and comparison of a rule-based and a corpus-based (particularly, statistical) Catalan-Spanish machine translation systems, both of them freely available in the web. The translation quality analysis is performed under two different domains: journalistic and medical. The systems are evaluated by using standard automatic measures, as well as by native human evaluators. Automatic results show that the statistical system performs better than the rule-based system. Human judgements show that in the Spanishto- Catalan direction the statistical system also performs better than the rule-based system, while in the Catalan-to-Spanish direction is the other way round. Although the statistical system obtains the best automatic scores, its errors tend to be more penalized by human judgements than the errors of the rule-based system. This can be explained because statistical errors are usually unexpected and they do not follow any pattern.
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació
Machine translation
Rule-based machine translation
Statistical machine translation
Signal theory (Telecommunication)
info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/conferenceObject
         

Show full item record

Related documents

Other documents of the same author

Mariño Acebal, José Bernardo; Farrús Cabeceran, Mireia; Ruiz Costa-Jussà, Marta; Poch, Marc; Hernández Huerta, Adolfo; Herníquez, Carlos; Rodríguez Fonollosa, José Adrián
Poch, M; Farrús Cabeceran, Mireia; Ruiz Costa-Jussà, Marta; Mariño Acebal, José Bernardo; Hernández, Adolfo; Henríquez Quintana, Carlos Alberto; Rodríguez Fonollosa, José Adrián
Farrús Cabeceran, Mireia; Ruiz Costa-Jussà, Marta; Mariño Acebal, José Bernardo; Rodríguez Fonollosa, José Adrián
Li, H.; Aw, A.; Zhang, M.; Khalilov, Maxim; Ruiz Costa-Jussà, Marta; Henríquez Quintana, Carlos Alberto; Rodríguez Fonollosa, José Adrián; Hernández, A.; Mariño Acebal, José Bernardo; Banchs Martínez, Rafael Enrique; Chen, B.
Mariño Acebal, José Bernardo; Banchs Martínez, Rafael Enrique; Crego Clemente, Josep Maria; Gispert Brosa, Adrian de; Lambert, Patrik; Rodríguez Fonollosa, José Adrián; Ruiz Costa-Jussà, Marta
 

Coordination

 

Supporters