Replies: 2 comments
-
|
Yes! For now, please see this example https://github.com/sgl-project/sglang/blob/main/examples/runtime/srt_engine.py and PR #1614. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
https://sglang.readthedocs.io/en/latest/backend.html#engine-without-http-server |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I saw that separation of
Engineand server is now implemented, but I do not see any documents in thereadthedocswebsite. Will be the usages/api endpoints updated soon?Beta Was this translation helpful? Give feedback.
All reactions