New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate translating mixed Simplified/Traditional script #965

Open

Tracked by

eu9ene opened this issue Dec 18, 2024 · 0 comments

Open

Tracked by

Investigate translating mixed Simplified/Traditional script #965

eu9ene opened this issue Dec 18, 2024 · 0 comments

Labels

language-coverage

Collaborator

eu9ene commented Dec 18, 2024 •

edited

Loading

The options are:

To train a joint zh-en model with a larger vocabulary. It would also require making sure we have enough data in Traditional for training and it's not Cantonese
Transliterate Traditional -> Simplified on the fly on the inference side

eu9ene mentioned this issue

[meta] Train harder to segment languages, like CJK languages #425

Open

eu9ene added the language-coverage label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment