-
Notifications
You must be signed in to change notification settings - Fork 297
Model gemma3 27b
Ollama Model ID: gemma3:27b
| Metric | Value |
|---|---|
| Average Score | 🟡 7.5/10 |
| Accuracy | 7.8/10 |
| Fluency | 8.2/10 |
| Style | 7.2/10 |
| Languages Tested | 23 |
| Total Translations | 227 |
| Best Language | Italian (8.0) |
| Worst Language | Japanese (7.0) |
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Italian | 🟡 8.0 | 8.2 | 8.6 | 7.7 |
| 2 | Swedish | 🟡 7.9 | 8.2 | 8.6 | 7.6 |
| 3 | Indonesian | 🟡 7.8 | 8.1 | 8.4 | 7.4 |
| 4 | Hindi | 🟡 7.7 | 8.2 | 8.3 | 7.3 |
| 5 | Danish | 🟡 7.7 | 8.1 | 8.5 | 7.3 |
| 6 | Portuguese | 🟡 7.7 | 8.2 | 8.2 | 7.3 |
| 7 | Spanish | 🟡 7.7 | 8.0 | 8.2 | 7.5 |
| 8 | Vietnamese | 🟡 7.7 | 7.9 | 8.5 | 7.3 |
| 9 | Dutch | 🟡 7.6 | 8.2 | 7.9 | 7.2 |
| 10 | French | 🟡 7.6 | 7.8 | 8.1 | 7.2 |
View all 23 languages
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Italian | 🟡 8.0 | 8.2 | 8.6 | 7.7 |
| 2 | Swedish | 🟡 7.9 | 8.2 | 8.6 | 7.6 |
| 3 | Indonesian | 🟡 7.8 | 8.1 | 8.4 | 7.4 |
| 4 | Hindi | 🟡 7.7 | 8.2 | 8.3 | 7.3 |
| 5 | Danish | 🟡 7.7 | 8.1 | 8.5 | 7.3 |
| 6 | Portuguese | 🟡 7.7 | 8.2 | 8.2 | 7.3 |
| 7 | Spanish | 🟡 7.7 | 8.0 | 8.2 | 7.5 |
| 8 | Vietnamese | 🟡 7.7 | 7.9 | 8.5 | 7.3 |
| 9 | Dutch | 🟡 7.6 | 8.2 | 7.9 | 7.2 |
| 10 | French | 🟡 7.6 | 7.8 | 8.1 | 7.2 |
| 11 | Tamil | 🟡 7.5 | 7.8 | 8.2 | 7.1 |
| 12 | German | 🟡 7.5 | 7.8 | 8.2 | 7.2 |
| 13 | Greek | 🟡 7.5 | 7.7 | 8.0 | 7.2 |
| 14 | Arabic | 🟡 7.5 | 7.8 | 8.2 | 7.2 |
| 15 | Polish | 🟡 7.4 | 7.7 | 8.0 | 7.1 |
| 16 | Chinese (Simplified) | 🟡 7.3 | 7.8 | 7.8 | 7.2 |
| 17 | Thai | 🟡 7.3 | 7.5 | 8.3 | 7.2 |
| 18 | Korean | 🟡 7.3 | 7.3 | 8.2 | 7.0 |
| 19 | Russian | 🟡 7.2 | 7.6 | 8.1 | 6.8 |
| 20 | Hebrew | 🟡 7.2 | 7.7 | 7.6 | 6.8 |
| 21 | Bengali | 🟡 7.0 | 7.5 | 7.5 | 6.8 |
| 22 | English | 🟡 7.0 | 7.2 | 8.2 | 6.6 |
| 23 | Japanese | 🟠 7.0 | 7.1 | 8.0 | 6.8 |
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Italian | 🟡 8.0 | 8.2 | 8.6 | 7.7 |
| Swedish | 🟡 7.9 | 8.2 | 8.6 | 7.6 |
| Danish | 🟡 7.7 | 8.1 | 8.5 | 7.3 |
| Portuguese | 🟡 7.7 | 8.2 | 8.2 | 7.3 |
| Spanish | 🟡 7.7 | 8.0 | 8.2 | 7.5 |
| Dutch | 🟡 7.6 | 8.2 | 7.9 | 7.2 |
| French | 🟡 7.6 | 7.8 | 8.1 | 7.2 |
| German | 🟡 7.5 | 7.8 | 8.2 | 7.2 |
| Greek | 🟡 7.5 | 7.7 | 8.0 | 7.2 |
| Polish | 🟡 7.4 | 7.7 | 8.0 | 7.1 |
| English | 🟡 7.0 | 7.2 | 8.2 | 6.6 |
Category Average: 🟡 7.6
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Indonesian | 🟡 7.8 | 8.1 | 8.4 | 7.4 |
| Hindi | 🟡 7.7 | 8.2 | 8.3 | 7.3 |
| Vietnamese | 🟡 7.7 | 7.9 | 8.5 | 7.3 |
| Tamil | 🟡 7.5 | 7.8 | 8.2 | 7.1 |
| Chinese (Simplified) | 🟡 7.3 | 7.8 | 7.8 | 7.2 |
| Thai | 🟡 7.3 | 7.5 | 8.3 | 7.2 |
| Korean | 🟡 7.3 | 7.3 | 8.2 | 7.0 |
| Bengali | 🟡 7.0 | 7.5 | 7.5 | 6.8 |
| Japanese | 🟠 7.0 | 7.1 | 8.0 | 6.8 |
Category Average: 🟡 7.4
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Arabic | 🟡 7.5 | 7.8 | 8.2 | 7.2 |
| Hebrew | 🟡 7.2 | 7.7 | 7.6 | 6.8 |
Category Average: 🟡 7.3
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Russian | 🟡 7.2 | 7.6 | 8.1 | 6.8 |
Category Average: 🟡 7.2
Italian - Relativity: The Special and General Theory Score: 🟡 8.8/10
View Translation
Original:
Now before the advent of the theory of relativity it had always tacitly been assumed in physics that the statement of time had an absolute significance, i.e. that it is independent of the state of motion of the body of reference. But we have just seen that this assumption is incompatible with the most natural definition of simultaneity; if we discard this assumption, then the conflict between the law of the propagation of light in vacuo and the principle of relativity (developed in Section VII)
Translation:
Fino all’avvento della teoria della relatività, in fisica si era sempre dato per scontato, tacitamente, che l’indicazione del tempo avesse un significato assoluto, cioè fosse indipendente dallo stato di moto del sistema di riferimento. Ma abbiamo appena visto che questa supposizione è incompatibile con la definizione più naturale di simultaneità; se abbandoniamo questa supposizione, allora il conflitto tra la legge di propagazione della luce nel vuoto e il principio di relatività (sviluppato nel
Feedback: Accurate and fluent rendering. 'body of reference' rendered as 'sistema di riferimento' (slight drift from 'corpo'), otherwise faithful and natural in register.
Japanese - Pride and Prejudice Score: 🔴 4.5/10
View Translation
Original:
It is a truth universally acknowledged, that a single man in possession of a good fortune, must be in want of a wife. However little known the feelings or views of such a man may be on his first entering a neighbourhood, this truth is so well fixed in the minds of the surrounding families, that he is considered as the rightful property of some one or other of their daughters.
Translation:
既婚男性であれば、それなりの財産を持っている独身男は、必ず妻を必要とするものと広く認められています。そのような男が初めて地域社会に足を踏み入れた時、彼の感情や考えはほとんど知られていないかもしれませんが、この事実は周辺の人々の心に深く根付いており、彼は必ず誰かの娘の物とみなされるのです。
Feedback: Major contresens at opening: 'single man' rendered as 'married man' (kikon dansei), inverting the famous premise. Irony and period register largely lost; 'neighbourhood families' flattened to 'surrounding people'.
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 0 | 0.0% |
| 🟡 Good (7-8) | 197 | 86.8% |
| 🟠 Acceptable (5-6) | 29 | 12.8% |
| 🔴 Poor (3-4) | 1 | 0.4% |
| ⚫ Failed (1-2) | 0 | 0.0% |
| Metric | Value |
|---|---|
| Average Translation Time | 3386.0ms |
| Success Rate | 100.0% |