* Add English to Greek
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Move English to Greek to prod
---------
Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
* Move caen from dev to prod
* Move enca from dev to prod
* Update README.md
* Update evaluation results [skip ci]
* Update model registry [skip ci]
---------
Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
* Update the model downloading script to use Taskcluster
* Update Lithuanian to English with a more robust model
* Fix output directory
* Remove Bergamot evals for lt-en
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Update docs [skip ci]
---------
Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
* Move modes from dev to prod for release
* el-en
* et-en & en-et
* fi-en
* hu-en
* ru-en
* sl-en
* tr-en
* uk-en
* Update README.md for new prod languages
* Represent new records internally as a list
* Add --lang-pair flag
* Write test for --lang-pair
* Add README.md to remote_settings
* Add help message for no files found
* Add top-level example to README
* Add test for empty directory given language pair
* Support evaluating languages that do not yet have a Bergamot model available
Fixes#106
* Move cached results to top level evaluation directory
* Add Indonesian
* Find right NLLB lang code dynamically
Fixes#103
* Decrease partition size for Google translate
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Bosnian
* Add Danish
* Add Swedish
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Galician
* Add Hindi
* Add Croatian
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Japanese
* Install dependencies required for Japanese tokenization in sacrebleu
* Install dependencies required for Korean tokenization in sacrebleu
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Romanian
* Retry up to 7 times when Google translate's service is unavailable
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Build a single report with all models and results
* Add Slovak
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Vietnamese
* Update evaluation results [skip ci]
* Add Latvian
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Serbian
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Thai
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Korean
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Add Chinese
* Update evaluation results [skip ci]
* Update model registry [skip ci]
* Move logic to fill Bergamot supported languages in a separate function
* Fix python scripts to act as a package, with relative imports
* Use absolute paths instead of relative paths in remote_settings
* Add pytest to the poetry lock file
* Reorganize remote_settings tests directory
* Rewrite remote_settings tests using pytest
* Update CI to run python pytest as a module
* Update README to describe the current state of model deployment
* Update evaluation results [skip ci]
* Update model registry [skip ci]
---------
Co-authored-by: Eemeli Aro <eemeli@gmail.com>
Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
* Add Poetry to project
Reworks the project to utilize Poetry.
This is modeled after the same Poetry setup that exists
in the firefox-translations-training repository.
* Run Black on all Python scripts
Runs the Black formatter on all existing Python code.
* Run black in CI
Runs the black formatter in CI to ensure there are no code format changes.
* Update Poetry dependencies for RemoteSettings script
Updates the Poetry toml and lock files to include all
of the current dependencies for the Remote Settings
script.
* Add main script entry point
Adds the main script entry point using argparse
* Add Error/Help print support
Adds a module to help with printing formatted
error and help messages.
* Add RemoteSettingsClient class implementation
Adds a class implementation for a RemoteSettingsClient
which is currently capable of connecting to the server
and uploading new records with attachments, but is designed
in a way that it will be able to be extended by future subcommands
that will support more CRUD operations.
* Add `create` subcommand
Adds the `create` subcommand to the main CLI interface.
The `create` subcommand is responsible fore creating a new
record with a file attachment on a Remote Settings server.
* Add mocked client and testing
Adds a way to mock the connection to the server for testing.
Adds test cases for error values and happy paths in the `create` command.
* Run remote-settings tests in CI
Runs the tests for the remote-settings.py create command in CI.
* Add more supported languages for Argos
They are supported, even if they are not listed in argos' readme.
* Update evaluation results [skip ci]
* Update model registry [skip ci]
---------
Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
* Add argos translator to the comparison
Part of https://github.com/mozilla/firefox-translations-training/issues/179
* Skip 'is' for argos
* Use GPU for argos translations
* List supported languages rather than unsupported languages
* Update evaluation results [skip ci]
---------
Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
Evgeny Pavlov
Erik Nordin
Greg Tatum
Marco Castelluccio
dependabot[bot]