New Argos model en_ky

Argos Translate
1

Hello,

Here are models I trained on en > ky and ky > en.

A few notes on them: the opus data would not train over ~45% accurate, and we checked some data in there, and it was not good… so we took the sentences (over 20M) and retranslated them through facebooks nllb data. NSFW content was filtered out.

The en > ky model training came out with accuracy 81.1 and ppl of 7.4, the bleu accuracy was 75.6, but translations came out pretty decent. It does well on format text, but not so well on short conversational text. However, it does not hallucinate and generally give a good output.

The ky > en model training came out with accuracy of 70 and ppl of 13.1, but was 65.6. It was just a reverse training, but the stanza model didn’t exist so I substituted russian. Maybe there would have been a better choice.

Here’s a link to the models: GitHub - christopherpickering/argos_models

2 Likes
2

This is awesome @christopherpickering , thanks for sharing. :folded_hands:

I’ve bumped your account’s trust level, in the future you should be able to post links.

1 Like
3

The French invasion of Malta (Maltese: Invażjoni Franċiża ta’ Malta , French: Débarquement Français à Malte ) was the successful invasion of the islands of Malta and Gozo, then ruled by the Order of St. John, by the French First Republic led by Napoleon Bonaparte in June 1798 as part of the Mediterranean campaign of the French Revolutionary Wars.

Франциянын Мальтага кол салуусу (Мальтезия: Invażjoni Franqueiża ta’ Malta, французча: Débarquement Français à Malte) Мальта жана Гозо аралдарына ийгиликтүү кол салуу болгон, андан кийин 1798-жылдын июнь айында Наполеон Бонапарт жетектеген Франциянын Биринчи Республикасы тарабынан Франциянын революциялык согуштарынын Жер Ортолук деңиз кампаниясынын алкагында башкарылган.

Backtranslation:

Couldn’t run the backtranslation as-is because there’s an issue with the stanza model configuration for ky => en :

  File "/Users/pt/Documents/LibreTranslate/venv/lib/python3.9/site-packages/stanza/pipeline/core.py", line 85, in __init__
    if len(self.load_list) == 0: raise Exception('No processor to load. Please check if your language or package is correctly set.')
Exception: No processor to load. Please check if your language or package is correctly set.

After changing the “ru” key in stanza/resources.json to “ky” and renaming the folder from “ru” to “ky” in stanza/ the model runs fine:

The French invasion of Malta (Maltesia: Invażjoni Franqueiża ta’ Malta, French: Débarquement Français à Malte) was a successful attack on Malta and the Gozo Islands, followed by the First Republic of France led by Napoleon Bonaparte in June 1798 under the Mediterranean Campaign of French Revolutionary Wars.

1 Like
4

thanks! I updated w/ the link.

5

thanks for catching that, I’m pushing that update to github.

2 Likes