firefox-translations-models/evaluation/en-hi
Marco Castelluccio c8c896d640
Add some languages we are planning to support to the comparison (#130)
* Support evaluating languages that do not yet have a Bergamot model available

Fixes #106

* Move cached results to top level evaluation directory

* Add Indonesian

* Find right NLLB lang code dynamically

Fixes #103

* Decrease partition size for Google translate

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Bosnian

* Add Danish

* Add Swedish

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Galician

* Add Hindi

* Add Croatian

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Japanese

* Install dependencies required for Japanese tokenization in sacrebleu

* Install dependencies required for Korean tokenization in sacrebleu

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Romanian

* Retry up to 7 times when Google translate's service is unavailable

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Build a single report with all models and results

* Add Slovak

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Vietnamese

* Update evaluation results [skip ci]

* Add Latvian

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Serbian

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Thai

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Korean

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Add Chinese

* Update evaluation results [skip ci]

* Update model registry [skip ci]

* Move logic to fill Bergamot supported languages in a separate function
2024-01-30 21:39:07 +01:00
..
flores-dev.argos.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.argos.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.argos.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.en Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.en-hi.cometcompare Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.google.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.google.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.google.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.microsoft.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.microsoft.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.microsoft.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.nllb.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.nllb.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.nllb.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.opusmt.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.opusmt.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-dev.opusmt.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.argos.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.argos.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.argos.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.en Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.en-hi.cometcompare Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.google.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.google.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.google.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.microsoft.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.microsoft.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.microsoft.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.nllb.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.nllb.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.nllb.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.opusmt.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.opusmt.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
flores-test.opusmt.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.argos.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.argos.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.argos.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.en Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.en-hi.cometcompare Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.google.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.google.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.google.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.microsoft.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.microsoft.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.microsoft.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.nllb.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.nllb.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.nllb.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.opusmt.hi Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.opusmt.hi.bleu Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00
wmt14.opusmt.hi.comet Add some languages we are planning to support to the comparison (#130) 2024-01-30 21:39:07 +01:00