firefox-translations-models/evaluation/en-ko
Marco Castelluccio c8c896d640
Add some languages we are planning to support to the comparison (#130)
* Support evaluating languages that do not yet have a Bergamot model available

Fixes #106

* Move cached results to top level evaluation directory

* Add Indonesian

* Find right NLLB lang code dynamically

Fixes #103

* Decrease partition size for Google translate

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Bosnian

* Add Danish

* Add Swedish

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Galician

* Add Hindi

* Add Croatian

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Japanese

* Install dependencies required for Japanese tokenization in sacrebleu

* Install dependencies required for Korean tokenization in sacrebleu

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Romanian

* Retry up to 7 times when Google translate's service is unavailable

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Build a single report with all models and results

* Add Slovak

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Vietnamese

* Update evaluation results [skip ci]

* Add Latvian

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Serbian

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Thai

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Korean

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Chinese

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Move logic to fill Bergamot supported languages in a separate function
2024-01-30 21:39:07 +01:00
..
flores-dev.argos.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.argos.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.argos.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.en Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.en-ko.cometcompare Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.google.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.google.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.google.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.microsoft.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.microsoft.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.microsoft.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.nllb.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.nllb.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.nllb.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.argos.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.argos.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.argos.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.en Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.en-ko.cometcompare Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.google.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.google.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.google.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.microsoft.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.microsoft.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.microsoft.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.nllb.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.nllb.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.nllb.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.argos.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.argos.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.argos.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.en Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.en-ko.cometcompare Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.google.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.google.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.google.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.microsoft.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.microsoft.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.microsoft.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.nllb.ko Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.nllb.ko.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
iwslt17.nllb.ko.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00