-
Notifications
You must be signed in to change notification settings - Fork 17
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Adding Catalan to English models (#72)
* Adding Catalan to English models * Update evaluation results [skip ci] * Update model registry [skip ci] --------- Co-authored-by: CircleCI evaluation job <ci-models-evaluation@firefox-translations>
- Loading branch information
1 parent
c652b86
commit 89ef02f
Showing
75 changed files
with
1,262 additions
and
1,038 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 38.7 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 0.6699 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,61 @@ | ||
| ========================== | ||
| x_name: flores-dev.bergamot.en | ||
| y_name: flores-dev.microsoft.en | ||
|
|
||
| Bootstrap Resampling Results: | ||
| x-mean: 0.6700 | ||
| y-mean: 0.7980 | ||
| ties (%): 0.0000 | ||
| x_wins (%): 0.0000 | ||
| y_wins (%): 1.0000 | ||
|
|
||
| Paired T-Test Results: | ||
| statistic: -18.8769 | ||
| p_value: 0.0000 | ||
| Null hypothesis rejected according to t-test. | ||
| Scores differ significantly across samples. | ||
| flores-dev.microsoft.en outperforms flores-dev.bergamot.en. | ||
| ========================== | ||
| x_name: flores-dev.bergamot.en | ||
| y_name: flores-dev.google.en | ||
|
|
||
| Bootstrap Resampling Results: | ||
| x-mean: 0.6700 | ||
| y-mean: 0.8228 | ||
| ties (%): 0.0000 | ||
| x_wins (%): 0.0000 | ||
| y_wins (%): 1.0000 | ||
|
|
||
| Paired T-Test Results: | ||
| statistic: -21.5915 | ||
| p_value: 0.0000 | ||
| Null hypothesis rejected according to t-test. | ||
| Scores differ significantly across samples. | ||
| flores-dev.google.en outperforms flores-dev.bergamot.en. | ||
| ========================== | ||
| x_name: flores-dev.microsoft.en | ||
| y_name: flores-dev.google.en | ||
|
|
||
| Bootstrap Resampling Results: | ||
| x-mean: 0.7980 | ||
| y-mean: 0.8228 | ||
| ties (%): 0.0000 | ||
| x_wins (%): 0.0000 | ||
| y_wins (%): 1.0000 | ||
|
|
||
| Paired T-Test Results: | ||
| statistic: -6.7390 | ||
| p_value: 0.0000 | ||
| Null hypothesis rejected according to t-test. | ||
| Scores differ significantly across samples. | ||
| flores-dev.google.en outperforms flores-dev.microsoft.en. | ||
|
|
||
| Summary | ||
| If system_x is better than system_y then: | ||
| Null hypothesis rejected according to t-test with p_value=0.05. | ||
| Scores differ significantly across samples. | ||
| system_x \ system_y flores-dev.bergamot.en flores-dev.microsoft.en flores-dev.google.en | ||
| ----------------------- ------------------------ ------------------------- ---------------------- | ||
| flores-dev.bergamot.en False False | ||
| flores-dev.microsoft.en True False | ||
| flores-dev.google.en True True |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 49.6 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 0.8218 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 46.8 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 0.7979 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 37.3 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 0.6381 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,61 @@ | ||
| ========================== | ||
| x_name: flores-test.bergamot.en | ||
| y_name: flores-test.microsoft.en | ||
|
|
||
| Bootstrap Resampling Results: | ||
| x-mean: 0.6383 | ||
| y-mean: 0.7878 | ||
| ties (%): 0.0000 | ||
| x_wins (%): 0.0000 | ||
| y_wins (%): 1.0000 | ||
|
|
||
| Paired T-Test Results: | ||
| statistic: -17.4826 | ||
| p_value: 0.0000 | ||
| Null hypothesis rejected according to t-test. | ||
| Scores differ significantly across samples. | ||
| flores-test.microsoft.en outperforms flores-test.bergamot.en. | ||
| ========================== | ||
| x_name: flores-test.bergamot.en | ||
| y_name: flores-test.google.en | ||
|
|
||
| Bootstrap Resampling Results: | ||
| x-mean: 0.6383 | ||
| y-mean: 0.8105 | ||
| ties (%): 0.0000 | ||
| x_wins (%): 0.0000 | ||
| y_wins (%): 1.0000 | ||
|
|
||
| Paired T-Test Results: | ||
| statistic: -18.9692 | ||
| p_value: 0.0000 | ||
| Null hypothesis rejected according to t-test. | ||
| Scores differ significantly across samples. | ||
| flores-test.google.en outperforms flores-test.bergamot.en. | ||
| ========================== | ||
| x_name: flores-test.microsoft.en | ||
| y_name: flores-test.google.en | ||
|
|
||
| Bootstrap Resampling Results: | ||
| x-mean: 0.7878 | ||
| y-mean: 0.8105 | ||
| ties (%): 0.0000 | ||
| x_wins (%): 0.0000 | ||
| y_wins (%): 1.0000 | ||
|
|
||
| Paired T-Test Results: | ||
| statistic: -6.1132 | ||
| p_value: 0.0000 | ||
| Null hypothesis rejected according to t-test. | ||
| Scores differ significantly across samples. | ||
| flores-test.google.en outperforms flores-test.microsoft.en. | ||
|
|
||
| Summary | ||
| If system_x is better than system_y then: | ||
| Null hypothesis rejected according to t-test with p_value=0.05. | ||
| Scores differ significantly across samples. | ||
| system_x \ system_y flores-test.bergamot.en flores-test.microsoft.en flores-test.google.en | ||
| ------------------------ ------------------------- -------------------------- ----------------------- | ||
| flores-test.bergamot.en False False | ||
| flores-test.microsoft.en True False | ||
| flores-test.google.en True True |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 48.3 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 0.8103 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 46.2 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| 0.7877 |
Oops, something went wrong.