New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

onnx2om 模型转换问题 #6

Open

Carious-ads opened this issue Dec 18, 2024 · 1 comment

Carious-ads commented Dec 18, 2024

交换内存跑满了：24G+24G
在之前提过kv_cache_length=2048.会出现乱码问题的Issues，1024可以成功转换与运行。
这次重新拉取代码，重新转换 kv_cache_length=1024，内存就跑满了。
CANN ： 8.0.RC2
内存跑满了报错，转换日志如下：

Author

Carious-ads commented Dec 18, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment