Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MathVerse_MINI 指向的 DATASET_URL 失效 #652

Open
lihytotoro opened this issue Dec 5, 2024 · 2 comments
Open

MathVerse_MINI 指向的 DATASET_URL 失效 #652

lihytotoro opened this issue Dec 5, 2024 · 2 comments

Comments

@lihytotoro
Copy link
Contributor

https://github.com/open-compass/VLMEvalKit/blob/main/vlmeval/dataset/image_vqa.py#L269
你好!这里 MathVerse_MINI 对应的 url 似乎失效了
image

@lihytotoro
Copy link
Contributor Author

另外,OlympiadBench_EN 和 OlympiadBench_CN 对应的 url 似乎也失效了?
https://github.com/open-compass/VLMEvalKit/blob/main/vlmeval/dataset/image_vqa.py#L439

@PhoenixZ810
Copy link
Collaborator

PhoenixZ810 commented Dec 17, 2024

Hi there,

Thank you for reaching out and for your patience.

We have reviewed the MathVerse_MINI.tsv file, and we can confirm that it remains valid in our network. However, we've noticed that the link provided for OlympiadBench is indeed not working as expected. We appreciate your understanding, and our team is actively working on resolving this issue to restore access as soon as possible.

We sincerely appreciate your attention to detail and bringing this to our notice. Once the link is fixed, we will ensure to update this thread with the correct information.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants