Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The model learns very badly #17

Open
nikuson opened this issue Dec 24, 2022 · 1 comment
Open

The model learns very badly #17

nikuson opened this issue Dec 24, 2022 · 1 comment

Comments

@nikuson
Copy link

nikuson commented Dec 24, 2022

Good model results are very often mixed with random noise and getting good results is not constant even after many hours of training.
Maybe someone has found a solution to what needs to be changed in the model?

@PlantUser
Copy link

The random initalization of the timesteps in sample_timesteps(self, n) is not ideal.We do not have control over the randomness of the timestep,hence some timesteps might not be sampled ,thus resulting to the model not being trained to predict noise on this time excluded steps.
Solution: Try look for a way to control the randomness of the sample times steps

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants