Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproduction on LSMDC DataSet #105

Open
JingXiaolun opened this issue Jun 16, 2023 · 6 comments
Open

Reproduction on LSMDC DataSet #105

JingXiaolun opened this issue Jun 16, 2023 · 6 comments

Comments

@JingXiaolun
Copy link

Sorry to disturb you. When I reproduce the results on LSMDC dataset, I get worse results than those in paper. In the meanP experiment, the meanR is always around 200, rather than around 60. The log is shown as follows:
1686898632103
The problem has confused me for a long time and I hope to get some advice for addressing this issue

@JingXiaolun
Copy link
Author

@ArrowLuo

@shallowdream66
Copy link

I have observed your training logs and reproduced it. I found that the performance was poor only on the validation set, but returned to normal on the test set. I hope this will be helpful to you

@JingXiaolun
Copy link
Author

@shallowdream66 ,the test set contains 1000 video clips, and the validation set contains 7408 video clips, do you mean using the 7408 video clips in validation process ?

@shallowdream66
Copy link

Yes,after each epoch it will be verified on the validation set, the checkpoint with the best results will be taken for testing, and the test results will return to normal.

@JingXiaolun
Copy link
Author

@shallowdream66, thanks a lot, I will try it.

@JingXiaolun
Copy link
Author

@shallowdream66 , can you share the training LSMDC log with me ? I still can't reproduce the normal results in the test set

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants