Results 11 to 20 of about 8,020,890 (290)
MATEO: MAchine Translation Evaluation Online.
We present MAchine Translation Evaluation Online (MATEO), a project that aims to facilitate machine translation (MT) evaluation by means of an easy-to-use interface that can evaluate given machine translations with a battery of automatic metrics.
Vanroy, Bram +2 more
core +5 more sources
Discourse Structure in Machine Translation Evaluation [PDF]
In this article, we explore the potential of using sentence-level discourse structure for machine translation evaluation. We first design discourse-aware similarity measures, which use all-subtree kernels to compare discourse parse trees in accordance ...
Shafiq Joty +3 more
doaj +5 more sources
(Meta-) evaluation of machine translation [PDF]
This paper evaluates the translation quality of machine translation systems for 8 language pairs: translating French, German, Spanish, and Czech to English and back. We carried out an extensive human evaluation which allowed us not only to rank the different MT systems, but also to perform higher-level analysis of the evaluation process.
Callison-Burch, Chris +4 more
openaire +3 more sources
On The Evaluation of Machine Translation Systems Trained With Back-Translation [PDF]
ACL ...
Sergey Edunov +3 more
openaire +4 more sources
Difficulty-Aware Machine Translation Evaluation [PDF]
The high-quality translation results produced by machine translation (MT) systems still pose a huge challenge for automatic evaluation. Current MT evaluation pays the same attention to each sentence component, while the questions of real-world examinations (e.g., university examinations) have different difficulties and weightings.
Runzhe Zhan +3 more
openaire +4 more sources
Multi-Hypothesis Machine Translation Evaluation [PDF]
Reliably evaluating Machine Translation (MT) through automated metrics is a long-standing problem. One of the main challenges is the fact that multiple outputs can be equally valid. Attempts to minimise this issue include metrics that relax the matching of MT output and reference strings, and the use of multiple references. The latter has been shown to
Fomicheva, M., Specia, L., Guzmán, F.
openaire +2 more sources
Extrinsic Evaluation of Machine Translation Metrics
Automatic machine translation (MT) metrics are widely used to distinguish the translation qualities of machine translation systems across relatively large test sets (system-level evaluation). However, it is unclear if automatic metrics are reliable at distinguishing good translations from bad translations at the sentence level (segment-level evaluation)
Moghe, Nikita +3 more
openaire +3 more sources
Machine translation evaluation with neural networks [PDF]
We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework, lexical, syntactic and semantic information from the reference and the two hypotheses is embedded into compact ...
Francisco Guzmán +3 more
openaire +2 more sources
An Overview on Machine Translation Evaluation
Since the 1950s, machine translation (MT) has become one of the important tasks of AI and development, and has experienced several different periods and stages of development, including rule-based methods, statistical methods, and recently proposed neural network-based learning methods.
openaire +3 more sources
On the Evaluation of Machine Translation for Terminology Consistency
As neural machine translation (NMT) systems become an important part of professional translator pipelines, a growing body of work focuses on combining NMT with terminologies. In many scenarios and particularly in cases of domain adaptation, one expects the MT output to adhere to the constraints provided by a terminology.
Md Mahfuz Ibn Alam +6 more
openaire +2 more sources

