Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About ReferitGame test ACC #25

Open
waynamigo opened this issue Mar 26, 2023 · 1 comment
Open

About ReferitGame test ACC #25

waynamigo opened this issue Mar 26, 2023 · 1 comment

Comments

@waynamigo
Copy link

No description provided.

@waynamigo waynamigo changed the title About About ReferitGame test ACC Mar 26, 2023
@waynamigo
Copy link
Author

waynamigo commented Mar 26, 2023

Thank you for sharing the code! I tried to train the model from scratch on ReferitGame dataset several times, but the result on the test set was around 67.4.
So I guess the ACC score 69.66 on ReferitGame test in Table.2 is the result of fine-tuning on ReferitGame after pre-training on mixed datasets? or just I missed something in the paper?

Thanks,

I tested it on

  • a single 2080ti GPU
  • the dataset&model config files are all default from repo without any edit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant