Results 11 to 20 of about 8,020,890 (290)

MATEO: MAchine Translation Evaluation Online.

open access: yes, 2023
We present MAchine Translation Evaluation Online (MATEO), a project that aims to facilitate machine translation (MT) evaluation by means of an easy-to-use interface that can evaluate given machine translations with a battery of automatic metrics.
Vanroy, Bram   +2 more
core   +5 more sources

Discourse Structure in Machine Translation Evaluation [PDF]

open access: yesComputational Linguistics, 2017
In this article, we explore the potential of using sentence-level discourse structure for machine translation evaluation. We first design discourse-aware similarity measures, which use all-subtree kernels to compare discourse parse trees in accordance ...
Shafiq Joty   +3 more
doaj   +5 more sources

(Meta-) evaluation of machine translation [PDF]

open access: yesProceedings of the Second Workshop on Statistical Machine Translation - StatMT '07, 2007
This paper evaluates the translation quality of machine translation systems for 8 language pairs: translating French, German, Spanish, and Czech to English and back. We carried out an extensive human evaluation which allowed us not only to rank the different MT systems, but also to perform higher-level analysis of the evaluation process.
Callison-Burch, Chris   +4 more
openaire   +3 more sources

On The Evaluation of Machine Translation Systems Trained With Back-Translation [PDF]

open access: yesProceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020
ACL ...
Sergey Edunov   +3 more
openaire   +4 more sources

Difficulty-Aware Machine Translation Evaluation [PDF]

open access: yesProceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), 2021
The high-quality translation results produced by machine translation (MT) systems still pose a huge challenge for automatic evaluation. Current MT evaluation pays the same attention to each sentence component, while the questions of real-world examinations (e.g., university examinations) have different difficulties and weightings.
Runzhe Zhan   +3 more
openaire   +4 more sources

Multi-Hypothesis Machine Translation Evaluation [PDF]

open access: yesProceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020
Reliably evaluating Machine Translation (MT) through automated metrics is a long-standing problem. One of the main challenges is the fact that multiple outputs can be equally valid. Attempts to minimise this issue include metrics that relax the matching of MT output and reference strings, and the use of multiple references. The latter has been shown to
Fomicheva, M., Specia, L., Guzmán, F.
openaire   +2 more sources

Extrinsic Evaluation of Machine Translation Metrics

open access: yesProceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023
Automatic machine translation (MT) metrics are widely used to distinguish the translation qualities of machine translation systems across relatively large test sets (system-level evaluation). However, it is unclear if automatic metrics are reliable at distinguishing good translations from bad translations at the sentence level (segment-level evaluation)
Moghe, Nikita   +3 more
openaire   +3 more sources

Machine translation evaluation with neural networks [PDF]

open access: yesComputer Speech & Language, 2017
We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework, lexical, syntactic and semantic information from the reference and the two hypotheses is embedded into compact ...
Francisco Guzmán   +3 more
openaire   +2 more sources

An Overview on Machine Translation Evaluation

open access: yesCoRR, 2022
Since the 1950s, machine translation (MT) has become one of the important tasks of AI and development, and has experienced several different periods and stages of development, including rule-based methods, statistical methods, and recently proposed neural network-based learning methods.
openaire   +3 more sources

On the Evaluation of Machine Translation for Terminology Consistency

open access: yesCoRR, 2021
As neural machine translation (NMT) systems become an important part of professional translator pipelines, a growing body of work focuses on combining NMT with terminologies. In many scenarios and particularly in cases of domain adaptation, one expects the MT output to adhere to the constraints provided by a terminology.
Md Mahfuz Ibn Alam   +6 more
openaire   +2 more sources

Home - About - Disclaimer - Privacy