OPUS-MT Language Models Port Thread

I went through the Firefox translation performance testing data (BLEU and COMET scores) to find models where Opus-MT has better performance than Argos Translate. These Opus-MT models could be good candidates to port to Argos Translate to replace the existing models.

Opus-MT model has better performance than the Argos Translate model

cs-en, tr-en, sk-en, en-fi, hu-en, en-hu, fi-en, en-da, en-ar, ko-en, uk-en, en-es, en-uk, en-cs, id-en, da-en, en-id, en-sk, en-de, de-en

Argos Translate model has better performance than the Opus-MT model

en-ru, en-bg (Argos Translate is using the Opus-MT Bulgarian model so this is strange), ca-en, en-hi, hi-en, pl-en

Similar Performance

ar-en, en-it, fr-en, ru-en, en-sv, sy-en, it-en, en-fr, es-en, ja-en

Argos is already using the Opus-MT model

en-et, en-zh, en-el, en-nl, et-en, en-ca, nl-en, bg-en, zh-en

1 Like