Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Specific parameter setting when training on activityNet v1.2 #15

Open
zronly opened this issue Apr 17, 2020 · 5 comments
Open

Specific parameter setting when training on activityNet v1.2 #15

zronly opened this issue Apr 17, 2020 · 5 comments

Comments

@zronly
Copy link

zronly commented Apr 17, 2020

Hi, I trained your pytorch code on activityNet v1.2 dataset. But I can only get the results as follows.
[email protected]= 47, [email protected]= 44, [email protected]=40, [email protected]=37, [email protected]= 33....it is much lower than what you posted. I think there's something wrong with the parameters. Can you share the specfic paramaters when training on activitNetv1.2 ? I would appreciate it very much if I could receive your reply.

@HumamAlwassel
Copy link

@zronly how were you able to get the results you cited? I'm trying to do the same from my end, but I get mAP @ IoU=0.5 that's extremely low (less than 1%). The classification mAP reaches +90%.

I'm running the ActivityNet1.2 experiment with the following settings:
python main.py --dataset-name ActivityNet1.2 --num-class 100 --model-name AN1.2_reprduce
I edited the smooth() function in detectionMAP.py to include the savgol_filter() call. I have played around with the threshold, but the detection mAP is still extremely low.

@sujoyp
Copy link
Owner

sujoyp commented Apr 27, 2020

Please refer to this: #7
Also need to use savgol_filter as @HumamAlwassel mentioned.

@zronly
Copy link
Author

zronly commented Apr 28, 2020

Please refer to this: #7
Also need to use savgol_filter as @HumamAlwassel mentioned.
Yes, i have used the same setting as what you said, but i find the CASLOSS is not work when training the activitynet1.2 , because when the casloss goes down, the accuracy also goes down. Is this caused by batch size? or learning rate?

@simpler66
Copy link

@zronly i have test the results on ActivitNet1.2, and get the same results as yours mAP@0.5=33.5, if you have got the results posted in paper, please let me know.
I run experiments on ActivityNet1.2 with the following settings:
python main.py --dataset-name ActivityNet1.2 --num-class 100
I do not change any other parameters in options.py provided by author used for training thumos14.
@sujoyp I will be really appreciate if you could offer the option.py used for ActivityNet

@zronly
Copy link
Author

zronly commented May 8, 2020

@zronly i have test the results on ActivitNet1.2, and get the same results as yours mAP@0.5=33.5, if you have got the results posted in paper, please let me know.
I run experiments on ActivityNet1.2 with the following settings:
python main.py --dataset-name ActivityNet1.2 --num-class 100
I do not change any other parameters in options.py provided by author used for training thumos14.
@sujoyp I will be really appreciate if you could offer the option.py used for ActivityNet

the casloss don't work when training on ActivityNet1.2, i am not sure if it has anything to do with parameters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants