Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TypeError: MGMllamaForCausalLM.forward() got an unexpected keyword argument 'cache_position' #133

Open
czm708033 opened this issue Jul 17, 2024 · 2 comments
Open

TypeError: MGMllamaForCausalLM.forward() got an unexpected keyword argument 'cache_position' #133

czm708033 opened this issue Jul 17, 2024 · 2 comments

Comments

@czm708033
Copy link

几乎所有评测都有这个问题......请问是什么原因呢？求解决方案
@czm708033
Copy link
Author

我用的是transformers 4.42.0 tokenizers 0.19.0
如果按照readme.md中用transformers 4.36.2的话，tokenizers就需要安装0.19以下的版本，而安装0.15.0之后会报出No module named 'tokenizers.tokenizers'的问题，似乎解决这个问题的方法是升级tokenizers，但我试过0.15.2也不行，再往后就是0.19了

@SVT-Yang
Copy link

add cache_position=None in MGMllamaForCausalLM.forward() could solve.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@SVT-Yang @czm708033