Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow for split vocabs #913

Open
Tracked by #425
gregtatum opened this issue Oct 30, 2024 · 1 comment
Open
Tracked by #425

Allow for split vocabs #913

gregtatum opened this issue Oct 30, 2024 · 1 comment
Labels
language-coverage Issues related to covering specific languages quality Improving robustness and translation quality

Comments

@gregtatum
Copy link
Member

Currently there are many hard coded areas that assume a single vocab. If we want to experiment with split vocabs we'll need to add the functionality. I'll mark this as quality, as it may help train certain models.
@gregtatum gregtatum added the quality Improving robustness and translation quality label Oct 30, 2024
This was referenced Nov 6, 2024
Merged
Open
@eu9ene
Copy link
Collaborator

eu9ene commented Nov 6, 2024

It now might be important for CJK. See Jaume's comment: #906 (comment)

@eu9ene eu9ene added the language-coverage Issues related to covering specific languages label Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
language-coverage Issues related to covering specific languages quality Improving robustness and translation quality
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gregtatum @eu9ene