Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FP8 方式部署 #842

Open
yimuu opened this issue Nov 28, 2024 · 1 comment
Open

FP8 方式部署 #842

yimuu opened this issue Nov 28, 2024 · 1 comment
Assignees
@westfish

Comments

@yimuu
Copy link

yimuu commented Nov 28, 2024

LLaVA现在能够支持PaddleNLP FP8方式部署吗
@luyao-cv
Copy link
Collaborator

感谢支持，暂时还不支持FP8。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@westfish westfish

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@westfish @luyao-cv @yimuu