Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The locally saved glm-4v-9b model encounters errors during evaluation, which are related to the way the tokenizer is loaded #653

Open
WeiweiZhang1 opened this issue Dec 6, 2024 · 1 comment

Comments

@WeiweiZhang1
Copy link

local model: https://huggingface.co/OPEA/glm-4v-9b-int4-sym-inc
image

See issue in glm-v-9b for a similar error:
https://huggingface.co/THUDM/glm-4v-9b/discussions/35

@WeiweiZhang1 WeiweiZhang1 changed the title local saved glm-4v-9b model evaluation error The locally saved glm-4v-9b model encounters errors during evaluation, which are related to the way the tokenizer is loaded Dec 6, 2024
@kennymckormick
Copy link
Member

Hi, @WeiweiZhang1 ,
For custom models, you first need to add a wrapper and make sure the inference can be successfully performed. Then you can use VLMEvalKit for multi-modal evaluation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants