-
Notifications
You must be signed in to change notification settings - Fork 294
Model gemma4 e2b
Ollama Model ID: gemma4:e2b
| Metric | Value |
|---|---|
| Average Score | 🟠 6.2/10 |
| Accuracy | 6.6/10 |
| Fluency | 6.5/10 |
| Style | 5.9/10 |
| Languages Tested | 23 |
| Total Translations | 227 |
| Best Language | Indonesian (7.0) |
| Worst Language | Greek (3.8) |
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Indonesian | 🟡 7.0 | 7.5 | 7.2 | 6.6 |
| 2 | Spanish | 🟠 7.0 | 7.4 | 7.1 | 6.6 |
| 3 | Thai | 🟠 7.0 | 7.4 | 7.3 | 6.5 |
| 4 | Vietnamese | 🟠 7.0 | 7.3 | 7.3 | 6.7 |
| 5 | Portuguese | 🟠 6.8 | 7.1 | 7.0 | 6.5 |
| 6 | Chinese (Simplified) | 🟠 6.7 | 6.9 | 7.2 | 6.4 |
| 7 | Korean | 🟠 6.7 | 7.2 | 7.2 | 6.4 |
| 8 | Hindi | 🟠 6.6 | 6.8 | 7.1 | 6.5 |
| 9 | Arabic | 🟠 6.6 | 6.8 | 7.0 | 6.4 |
| 10 | French | 🟠 6.6 | 7.1 | 6.8 | 6.2 |
View all 23 languages
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Indonesian | 🟡 7.0 | 7.5 | 7.2 | 6.6 |
| 2 | Spanish | 🟠 7.0 | 7.4 | 7.1 | 6.6 |
| 3 | Thai | 🟠 7.0 | 7.4 | 7.3 | 6.5 |
| 4 | Vietnamese | 🟠 7.0 | 7.3 | 7.3 | 6.7 |
| 5 | Portuguese | 🟠 6.8 | 7.1 | 7.0 | 6.5 |
| 6 | Chinese (Simplified) | 🟠 6.7 | 6.9 | 7.2 | 6.4 |
| 7 | Korean | 🟠 6.7 | 7.2 | 7.2 | 6.4 |
| 8 | Hindi | 🟠 6.6 | 6.8 | 7.1 | 6.5 |
| 9 | Arabic | 🟠 6.6 | 6.8 | 7.0 | 6.4 |
| 10 | French | 🟠 6.6 | 7.1 | 6.8 | 6.2 |
| 11 | Italian | 🟠 6.4 | 7.1 | 6.3 | 6.1 |
| 12 | Japanese | 🟠 6.3 | 6.6 | 7.0 | 6.0 |
| 13 | Bengali | 🟠 6.1 | 6.7 | 6.4 | 6.0 |
| 14 | Swedish | 🟠 6.0 | 6.5 | 6.0 | 5.8 |
| 15 | German | 🟠 6.0 | 6.3 | 6.3 | 5.8 |
| 16 | Dutch | 🟠 6.0 | 6.3 | 6.2 | 5.6 |
| 17 | Tamil | 🟠 6.0 | 6.3 | 6.3 | 5.9 |
| 18 | Danish | 🟠 5.8 | 6.2 | 6.2 | 5.8 |
| 19 | Russian | 🟠 5.8 | 6.0 | 6.2 | 5.5 |
| 20 | English | 🟠 5.5 | 5.5 | 6.9 | 5.4 |
| 21 | Polish | 🟠 5.3 | 6.0 | 5.2 | 5.0 |
| 22 | Hebrew | 🔴 4.8 | 5.2 | 4.8 | 4.5 |
| 23 | Greek | 🔴 3.8 | 4.2 | 3.5 | 3.6 |
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Indonesian | 🟡 7.0 | 7.5 | 7.2 | 6.6 |
| Thai | 🟠 7.0 | 7.4 | 7.3 | 6.5 |
| Vietnamese | 🟠 7.0 | 7.3 | 7.3 | 6.7 |
| Chinese (Simplified) | 🟠 6.7 | 6.9 | 7.2 | 6.4 |
| Korean | 🟠 6.7 | 7.2 | 7.2 | 6.4 |
| Hindi | 🟠 6.6 | 6.8 | 7.1 | 6.5 |
| Japanese | 🟠 6.3 | 6.6 | 7.0 | 6.0 |
| Bengali | 🟠 6.1 | 6.7 | 6.4 | 6.0 |
| Tamil | 🟠 6.0 | 6.3 | 6.3 | 5.9 |
Category Average: 🟠 6.6
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Spanish | 🟠 7.0 | 7.4 | 7.1 | 6.6 |
| Portuguese | 🟠 6.8 | 7.1 | 7.0 | 6.5 |
| French | 🟠 6.6 | 7.1 | 6.8 | 6.2 |
| Italian | 🟠 6.4 | 7.1 | 6.3 | 6.1 |
| Swedish | 🟠 6.0 | 6.5 | 6.0 | 5.8 |
| German | 🟠 6.0 | 6.3 | 6.3 | 5.8 |
| Dutch | 🟠 6.0 | 6.3 | 6.2 | 5.6 |
| Danish | 🟠 5.8 | 6.2 | 6.2 | 5.8 |
| English | 🟠 5.5 | 5.5 | 6.9 | 5.4 |
| Polish | 🟠 5.3 | 6.0 | 5.2 | 5.0 |
| Greek | 🔴 3.8 | 4.2 | 3.5 | 3.6 |
Category Average: 🟠 5.9
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Arabic | 🟠 6.6 | 6.8 | 7.0 | 6.4 |
| Hebrew | 🔴 4.8 | 5.2 | 4.8 | 4.5 |
Category Average: 🟠 5.7
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Russian | 🟠 5.8 | 6.0 | 6.2 | 5.5 |
Category Average: 🟠 5.8
German - Relativity: The Special and General Theory Score: 🟡 8.3/10
View Translation
Original:
Now before the advent of the theory of relativity it had always tacitly been assumed in physics that the statement of time had an absolute significance, i.e. that it is independent of the state of motion of the body of reference. But we have just seen that this assumption is incompatible with the most natural definition of simultaneity; if we discard this assumption, then the conflict between the law of the propagation of light in vacuo and the principle of relativity (developed in Section VII)
Translation:
Bevor die Relativitätstheorie aufkam, wurde in der Physik stets stillschweigend angenommen, dass die Aussage über die Zeit eine absolute Bedeutung hat, d.h. dass sie unabhängig vom Bewegungszustand des Bezugssystems ist. Aber wir haben gerade gesehen, dass diese Annahme mit der natürlichsten Definition der Gleichzeitigkeit unvereinbar ist; wenn wir diese Annahme verwerfen, verschwindet der Konflikt zwischen dem Gesetz der Lichtausbreitung im Vakuum und dem Relativitätsprinzip (entwickelt in Absc
Feedback: Accurate and fluent. Minor drift: 'body of reference' rendered as 'Bezugssystem' (reference system) rather than 'Bezugskoerper'. Otherwise faithful and natural.
Greek - The Picture of Dorian Gray Score: ⚫ 2.0/10
View Translation
Original:
The studio was filled with the rich odour of roses, and when the light summer wind stirred amidst the trees of the garden, there came through the open door the heavy scent of the lilac, or the more delicate perfume of the pink-flowering thorn. From the corner of the divan of Persian saddle-bags on which he was lying, smoking, as was his custom, innumerable cigarettes, Lord Henry Wotton could just catch the gleam of the honey-sweet and honey-coloured blossoms of a laburnum.
Translation:
Τοสตูดіо ήταν γεμάτο με την πλούσια μυρωδιά των λουλουδιών, και όταν ο ζεστός άνεμος του καλοκαιριού αναδύθηκε ανάμεσα στους δέντρους του κήπου, από την ανοιχτή πόρτα έφτασε η βαριά μυρωδιά του λiléκου, ή το πιο απαλό άρωμα του κόκκινου荆δρού. Από την γωνία του καναπέ των περσικών τσάντσαων πάνω στα οποία στέρεফে, καπνίζοντας, όπως ήταν η συνήθειά του, άπειρες σιγάροδες, ο ลόρδος Henry Wotton μπορούσε απλώς να συλλάβει το λάμψη των μελιτοωρών και μελιτοχρωμίων λουλουδιών του laburnum.
Feedback: Severely corrupted output: mixed scripts (Latin, CJK characters inside Greek words), numerous non-words, untranslated source terms (laburnum, Henry Wotton), broken morphology, 'roses' mistranslated as generic flowers, 'pink-flowering thorn' lost.
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 0 | 0.0% |
| 🟡 Good (7-8) | 67 | 29.5% |
| 🟠 Acceptable (5-6) | 140 | 61.7% |
| 🔴 Poor (3-4) | 17 | 7.5% |
| ⚫ Failed (1-2) | 3 | 1.3% |
| Metric | Value |
|---|---|
| Average Translation Time | 930.0ms |
| Success Rate | 100.0% |