Add Dutch to English (#60)

* Add Dutch to English

* Add Dutch to English models

* Update evaluation results [skip ci]

* Update model registry [skip ci]

Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>

README.md

@@ -90,7 +90,5 @@ Suffix of the model file in the registry:
 - Icelandic -> English
 - Norwegian Nynorsk -> English
 - Ukrainian <-> English
-- Dutch <- English
+- Dutch <-> English
 
-## Upcoming
-- Dutch -> English

evaluation/dev/nl-en/flores-dev.bergamot.en.bleu

@@ -0,0 +1 @@
+29.5

evaluation/dev/nl-en/flores-dev.google.en.bleu

@@ -0,0 +1 @@
+32.3

evaluation/dev/nl-en/flores-dev.microsoft.en.bleu

@@ -0,0 +1 @@
+32.5

evaluation/dev/nl-en/flores-test.bergamot.en.bleu

@@ -0,0 +1 @@
+29.8

evaluation/dev/nl-en/flores-test.google.en.bleu

@@ -0,0 +1 @@
+32.6

evaluation/dev/nl-en/flores-test.microsoft.en.bleu

@@ -0,0 +1 @@
+32.3

evaluation/dev/results.md

@@ -57,11 +57,11 @@ Both absolute and relative differences in BLEU scores between Bergamot and other
 
 ## avg
 
-| Translator/Dataset | en-uk | fa-en | ru-en | en-ru | uk-en | en-fa | en-nl | is-en |
-| --- | --- | --- | --- | --- | --- | --- | --- | --- |
-| bergamot | 28.00 | 28.70 | 33.37 | 30.47 | 35.65 | 17.30 | 27.40 | 23.50 |
-| google | 32.40 (+4.40, +15.71%) | 36.05 (+7.35, +25.61%) | 36.53 (+3.15, +9.45%) | 33.72 (+3.25, +10.67%) | 38.90 (+3.25, +9.12%) | 27.70 (+10.40, +60.12%) | 29.25 (+1.85, +6.75%) | 34.95 (+11.45, +48.72%) |
-| microsoft | 31.05 (+3.05, +10.89%) | 36.15 (+7.45, +25.96%) | 36.87 (+3.50, +10.49%) | 33.68 (+3.21, +10.53%) | 39.00 (+3.35, +9.40%) | 20.50 (+3.20, +18.50%) | 28.95 (+1.55, +5.66%) | 34.90 (+11.40, +48.51%) |
+| Translator/Dataset | en-uk | fa-en | ru-en | en-ru | uk-en | en-fa | en-nl | nl-en | is-en |
+| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
+| bergamot | 28.00 | 28.70 | 33.37 | 30.47 | 35.65 | 17.30 | 27.40 | 29.65 | 23.50 |
+| google | 32.40 (+4.40, +15.71%) | 36.05 (+7.35, +25.61%) | 36.53 (+3.15, +9.45%) | 33.72 (+3.25, +10.67%) | 38.90 (+3.25, +9.12%) | 27.70 (+10.40, +60.12%) | 29.25 (+1.85, +6.75%) | 32.45 (+2.80, +9.44%) | 34.95 (+11.45, +48.72%) |
+| microsoft | 31.05 (+3.05, +10.89%) | 36.15 (+7.45, +25.96%) | 36.87 (+3.50, +10.49%) | 33.68 (+3.21, +10.53%) | 39.00 (+3.35, +9.40%) | 20.50 (+3.20, +18.50%) | 28.95 (+1.55, +5.66%) | 32.40 (+2.75, +9.27%) | 34.90 (+11.40, +48.51%) |
 
 ![Results](img/avg.png)
 
@@ -135,6 +135,16 @@ Both absolute and relative differences in BLEU scores between Bergamot and other
 
 ![Results](img/en-nl.png)
 
+## nl-en
+
+| Translator/Dataset | flores-dev | flores-test |
+| --- | --- | --- |
+| bergamot | 29.50 | 29.80 |
+| google | 32.30 (+2.80, +9.49%) | 32.60 (+2.80, +9.40%) |
+| microsoft | 32.50 (+3.00, +10.17%) | 32.30 (+2.50, +8.39%) |
+
+![Results](img/nl-en.png)
+
 ## is-en
 
 | Translator/Dataset | flores-dev | flores-test |

models/dev/nlen/lex.50.50.nlen.s2t.bin.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4ad562e6ec4b97e25140166ce712822920ebc3445bf3b7fc634f2ada8b404ce
+size 2744604

models/dev/nlen/model.nlen.intgemm.alphas.bin.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc8d4e06246e57fa69714ec40dbee3fdda400a117a864076f55bd49937faf23d
+size 13117435

models/dev/nlen/vocab.nlen.spm.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:149400e943a1ff65967c0f250f513ae75e253d8a9cc7664754367f53d875911b
+size 411834

registry.json

@@ -602,6 +602,29 @@
       "modelType": "dev"
     }
   },
+  "nlen": {
+    "model": {
+      "name": "model.nlen.intgemm.alphas.bin",
+      "size": 17140899,
+      "estimatedCompressedSize": 13117435,
+      "expectedSha256Hash": "187f9c8f1ffbcc8ecf0724b608ffed9f15bde262b9de5c4754f8d763b585969d",
+      "modelType": "dev"
+    },
+    "lex": {
+      "name": "lex.50.50.nlen.s2t.bin",
+      "size": 4940304,
+      "estimatedCompressedSize": 2744604,
+      "expectedSha256Hash": "15c473e6e5aef1fa3fe5cc804844e19a2c671d2e39169dcbc06f456ca4f9b2c0",
+      "modelType": "dev"
+    },
+    "vocab": {
+      "name": "vocab.nlen.spm",
+      "size": 807730,
+      "estimatedCompressedSize": 411834,
+      "expectedSha256Hash": "48a6331cb8a69d21dd24c6c2a15de44a07bcfd4a4470eaf4616849d77945f6b9",
+      "modelType": "dev"
+    }
+  },
   "nnen": {
     "model": {
       "name": "model.nnen.intgemm.alphas.bin",