I’ve been working on uploading these OPUS-MT models to argospm. Here are some notes I have from testing them:
- Stanza broken. Argos Translate crashes when I try to run this model
2023-10-22 09:08:53 ERROR: Cannot load model from /home/pj/.local/share/argos-translate/packages/translate-sl_en-1_9/stanza/sl/tokenize/ssj.pt
Traceback (most recent call last):
FileNotFoundError: [Errno 2] No such file or directory: '/home/pj/.local/share/argos-translate/packages/translate-sl_en-1_9/stanza/sl/tokenize/ssj.pt'
- Partially broken
- Frequently generates this specific sentence instead of translating the source English text: “= = Odkritje = = Asteroid je odkril avstrijski astronom Johann Palisa (1877 - 1962) 17. novembra 1892 v Karlu.”
According to Google Translate this translates to: “= = Discovery = = The asteroid was discovered by the Austrian astronomer Johann Palisa (1877 - 1962) on November 17, 1892 in Karl.”
For example all of these three different English source sentences are translated to the same Slovenian sentence about the asteroid (approximatly 5% of sentences have this issue in my tests):
He began running during the first COVID-19 lockdown in March 2020, having been motivated by an American athlete who had run every street in San Francisco in 30 days.
Daniel Roy Gilchrist Noboa Azín (born 30 November 1987) is an Ecuadorian business administrator, politician and businessman in the banana industry, who is the president-elect of Ecuador after winning the 2023 general election.
In March 2023, he was in favor of the muerte cruzada, in the face of the rejection and filing of the Investment Law, presented by the government of Guillermo Lasso. On 17 May 2023,
- Partially broken
Most translations are correct but ~15% of them have gibberish, for example:
Daniel Roy-Gilchrist Noboa Azín was born on 30 November 1987 in the city of Guayaquil. He is the son of businessman Álvaro Noboa and physician Anabella Azín.
Daniel Roychrist christ Nowas was was ble født 30. november 87 87 i byen il il il. Han er sønn av forretningsmann. o o Noo og lege bella Bella Azín.
Back translation with Google Translate
Daniel Roychrist christ Nowas was was born on 30 November 87 87 in the city of il il il. He is the son of a businessman. o o Noo and doctor bella Bella Azín.
2023-10-22 09:25:52 ERROR: Cannot load model from /home/pj/.local/share/argos-translate/packages/translate-ro_en-1_9/stanza/ro/tokenize/rrt.pt
- Works very well, much better than the current Chinese model
- Works very well, a major improvement over the current Chinese model