Skip to content

Commit 48b0e04

Browse files
eu9eneCircleCI evaluation job
and
CircleCI evaluation job
authored
Add en-it model (#24)
* Add en-it model * Update evaluation results [skip ci] Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
1 parent 5ff404f commit 48b0e04

15 files changed

+33
-5
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
28.4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
29.0
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
31.0
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
29.2
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
30.1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
32.0
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
31.0
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
29.3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
33.6

evaluation/dev/img/avg.png

237 Bytes
Loading

evaluation/dev/img/en-it.png

23.8 KB
Loading

evaluation/dev/results.md

+15-5
Original file line numberDiff line numberDiff line change
@@ -57,14 +57,24 @@ Both absolute and relative differences in BLEU scores between Bergamot and other
5757

5858
## avg
5959

60-
| Translator/Dataset | en-pt | ru-en | en-ru | it-en | pt-en |
61-
| --- | --- | --- | --- | --- | --- |
62-
| bergamot | 46.55 | 33.37 | 28.40 | 32.30 | 43.43 |
63-
| google | 56.05 (+9.50, +20.41%) | 36.53 (+3.15, +9.45%) | 33.72 (+5.32, +18.73%) | 34.50 (+2.20, +6.81%) | 45.77 (+2.33, +5.37%) |
64-
| microsoft | 50.25 (+3.70, +7.95%) | 36.87 (+3.50, +10.49%) | 33.68 (+5.28, +18.59%) | 34.55 (+2.25, +6.97%) | 46.43 (+3.00, +6.91%) |
60+
| Translator/Dataset | en-it | en-pt | ru-en | en-ru | it-en | pt-en |
61+
| --- | --- | --- | --- | --- | --- | --- |
62+
| bergamot | 29.53 | 46.55 | 33.37 | 28.40 | 32.30 | 43.43 |
63+
| google | 29.47 (-0.07, -0.23%) | 56.05 (+9.50, +20.41%) | 36.53 (+3.15, +9.45%) | 33.72 (+5.32, +18.73%) | 34.50 (+2.20, +6.81%) | 45.77 (+2.33, +5.37%) |
64+
| microsoft | 32.20 (+2.67, +9.03%) | 50.25 (+3.70, +7.95%) | 36.87 (+3.50, +10.49%) | 33.68 (+5.28, +18.59%) | 34.55 (+2.25, +6.97%) | 46.43 (+3.00, +6.91%) |
6565

6666
![Results](img/avg.png)
6767

68+
## en-it
69+
70+
| Translator/Dataset | flores-test | flores-dev | wmt09 |
71+
| --- | --- | --- | --- |
72+
| bergamot | 29.20 | 28.40 | 31.00 |
73+
| google | 30.10 (+0.90, +3.08%) | 29.00 (+0.60, +2.11%) | 29.30 (-1.70, -5.48%) |
74+
| microsoft | 32.00 (+2.80, +9.59%) | 31.00 (+2.60, +9.15%) | 33.60 (+2.60, +8.39%) |
75+
76+
![Results](img/en-it.png)
77+
6878
## en-pt
6979

7080
| Translator/Dataset | flores-test | flores-dev |
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
version https://git-lfs.github.com/spec/v1
2+
oid sha256:b6d2d78773c4cd051bf8c7848dab785a2eba7b83f81d2c12996054151b25be33
3+
size 2409986
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
version https://git-lfs.github.com/spec/v1
2+
oid sha256:2fc56d22cfd10bd940f472a78f1f16bef2201b4488eade0a70202856df464e1c
3+
size 13283223

models/dev/enit/vocab.enit.spm.gz

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
version https://git-lfs.github.com/spec/v1
2+
oid sha256:791ca68001028e39e20e2414b72301040be468b8bc5084523bb68e0a6768c3b4
3+
size 405338

0 commit comments

Comments
 (0)