@@ -57,14 +57,24 @@ Both absolute and relative differences in BLEU scores between Bergamot and other
57
57
58
58
## avg
59
59
60
- | Translator/Dataset | en-pt | ru-en | en-ru | it-en | pt-en |
61
- | --- | --- | --- | --- | --- | --- |
62
- | bergamot | 46.55 | 33.37 | 28.40 | 32.30 | 43.43 |
63
- | google | 56.05 (+9.50, +20.41%) | 36.53 (+3.15, +9.45%) | 33.72 (+5.32, +18.73%) | 34.50 (+2.20, +6.81%) | 45.77 (+2.33, +5.37%) |
64
- | microsoft | 50.25 (+3.70, +7.95%) | 36.87 (+3.50, +10.49%) | 33.68 (+5.28, +18.59%) | 34.55 (+2.25, +6.97%) | 46.43 (+3.00, +6.91%) |
60
+ | Translator/Dataset | en-it | en- pt | ru-en | en-ru | it-en | pt-en |
61
+ | --- | --- | --- | --- | --- | --- | --- |
62
+ | bergamot | 29.53 | 46.55 | 33.37 | 28.40 | 32.30 | 43.43 |
63
+ | google | 29.47 (-0.07, -0.23%) | 56.05 (+9.50, +20.41%) | 36.53 (+3.15, +9.45%) | 33.72 (+5.32, +18.73%) | 34.50 (+2.20, +6.81%) | 45.77 (+2.33, +5.37%) |
64
+ | microsoft | 32.20 (+2.67, +9.03%) | 50.25 (+3.70, +7.95%) | 36.87 (+3.50, +10.49%) | 33.68 (+5.28, +18.59%) | 34.55 (+2.25, +6.97%) | 46.43 (+3.00, +6.91%) |
65
65
66
66
![ Results] ( img/avg.png )
67
67
68
+ ## en-it
69
+
70
+ | Translator/Dataset | flores-test | flores-dev | wmt09 |
71
+ | --- | --- | --- | --- |
72
+ | bergamot | 29.20 | 28.40 | 31.00 |
73
+ | google | 30.10 (+0.90, +3.08%) | 29.00 (+0.60, +2.11%) | 29.30 (-1.70, -5.48%) |
74
+ | microsoft | 32.00 (+2.80, +9.59%) | 31.00 (+2.60, +9.15%) | 33.60 (+2.60, +8.39%) |
75
+
76
+ ![ Results] ( img/en-it.png )
77
+
68
78
## en-pt
69
79
70
80
| Translator/Dataset | flores-test | flores-dev |
0 commit comments