Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the flow model trained with half-precision works well? #446

Closed
JohnHerry opened this issue Sep 27, 2024 · 3 comments
Closed

Is the flow model trained with half-precision works well? #446

JohnHerry opened this issue Sep 27, 2024 · 3 comments

Comments

@JohnHerry
Copy link

In the pretained opensource stack, the llm support half inference but not flow model. If I train the flow with deepspeed and get a half-precision float model, will it works well? will it get good speech quality?

@aluminumbox
Copy link
Collaborator

not amp trained, we will update cosyvoice-300m and coysvoice-300m-25hz with amp training later

@JohnHerry
Copy link
Author

ok, thank you for the help

@JohnHerry
Copy link
Author

ok, thank you for the help
by the way, what I mean is to train the base model from scratch. not to fine tune on the released pretraines.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants