Why default chunked_prefill_size=8192？ #1153
Closed
CSEEduanyu
started this conversation in
General
Replies: 1 comment
-
|
you can tune for your workloads. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What does this parameter mean? How do you find the best value?
Beta Was this translation helpful? Give feedback.
All reactions