Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Result dimension and audio speed #15

Open
vyalovvldmr opened this issue Jul 5, 2019 · 7 comments
Open

Result dimension and audio speed #15

vyalovvldmr opened this issue Jul 5, 2019 · 7 comments

Comments

@vyalovvldmr
Copy link

vyalovvldmr commented Jul 5, 2019

Hi! I've just run the code and generated video successfully. But I've got a copule of questions.

  1. The result video dimension is very small despite of source image dimension which is much bigger. Is there any ability to increase result video dimension?

  2. Audio in the result mp4 is slowed down dramatically. Why is it so?

@DinoMan
Copy link
Owner

DinoMan commented Jul 5, 2019

Hi the model is trained to generate images at 96x128. I'm afraid it can't do larger images unless we retrain it with larger videos in the training set.

Have you manually provided the sampling rate of your audio? it sounds to me like there is a mismatch between the actual audio sampling rate and the one provided to the animator

@DLSeed
Copy link

DLSeed commented Jul 5, 2019

what I found in Q2: the wav track must be mono channel, if input a stereo track, output will slow down and double the playtime...

@DinoMan
Copy link
Owner

DinoMan commented Jul 5, 2019

Oh yes I forgot to mention that I guess in the documentation. The track should be mono. I presume this causes it to have 2x the samples when reshaping takes place.

@vyalovvldmr
Copy link
Author

Wow! Thank you! I'll try mono.
Do you have any plans for retraining net in order to get larger dimension?

@vyalovvldmr
Copy link
Author

vyalovvldmr commented Jul 5, 2019

Yep, mono fixed the issue!

@DinoMan
Copy link
Owner

DinoMan commented Jul 5, 2019

To be honest it was of a memory and time restriction than anything else. The model takes 11GB on the GPU to train and trains for 1-2 weeks (depending on the dataset size). If we have an update in the future I'll post about it here.

@ustc-baize
Copy link

@wooloodya hello,i meet the question
va = sda.VideoAnimator(gpu=0) # Instantiate the animator
has been running for over an hour. it keeps showing "Downloading the face detection CNN. Please wait..." and result nothing else.
There is noting wrong with my GPU, would you tell me how to solve this problem?
thank you so much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants