Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

用Chartqa测评LLama3.2-11b-vision时,结果全部为0 #644

Open
GoogleAlphaZero opened this issue Dec 4, 2024 · 1 comment
Open

Comments

@GoogleAlphaZero
Copy link

在测评Llama3.2-11b-vision时,用ChartQa,中间有过程,显示了2500条数据的过程,但结果全部为0,结果如下

To disable this warning, you can either:
- Avoid using tokenizers before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using tokenizers before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
[2024-12-03 16:21:54,323] INFO - RUN - run.py: main - 393: The evaluation of model Llama-3.2-11B-Vision-Instruct x dataset ChartQA_TEST has finished!
[2024-12-03 16:21:54] INFO - run.py: main - 393: The evaluation of model Llama-3.2-11B-Vision-Instruct x dataset ChartQA_TEST has finished!
[2024-12-03 16:21:54,323] INFO - RUN - run.py: main - 394: Evaluation Results:
[2024-12-03 16:21:54] INFO - run.py: main - 394: Evaluation Results:
[2024-12-03 16:21:54,325] INFO - RUN - run.py: main - 400:


test_augmented 0
test_human 0
Overall 0


[2024-12-03 16:21:54] INFO - run.py: main - 400:


test_augmented 0
test_human 0
Overall 0


@PhoenixZ810
Copy link
Collaborator

Hi,
Thank you for your inquiry.
Once the inference process has successfully completed, an .xlsx file will be generated in the designated output directory.
To provide you with more specific details regarding the contents of the .xlsx file, it would be helpful to know the particular setup or context in which the inference process is being run.
Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants