Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Finetune Composer model with Streaming dataset example #3621

Open
zhouhao001832050 opened this issue Sep 20, 2024 · 1 comment
Open

Finetune Composer model with Streaming dataset example #3621

zhouhao001832050 opened this issue Sep 20, 2024 · 1 comment
Labels
enhancement New (engineering) enhancements, such as features or API changes.

Comments

@zhouhao001832050
Copy link

Could you please provide the script of using streaming data to complete finetune task if possible. I tried to do it but the result showed that the the model did not converge when using streaming data.
Thank you.
@zhouhao001832050 zhouhao001832050 added the enhancement New (engineering) enhancements, such as features or API changes. label Sep 20, 2024
@XiaohanZhangCMU
Copy link
Contributor

@zhouhao001832050 before StreamingDataset (SD), what did you try and make the model converge?
I wonder if your SD configuration has a mistake. Can you post here the code snippet or the yml section you used to create a SD instance?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New (engineering) enhancements, such as features or API changes.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@XiaohanZhangCMU @zhouhao001832050