Repositories list

• sglang

  Public
  SGLang is a fast serving framework for large language models and vision language models.

  cudainferencepytorch+ 10transformermoellamavlmllmllm-servingllava+ 3

  Python

  •

  Apache License 2.0

  •486•5.9k•77•18•Updated Nov 8, 2024Nov 8, 2024

• sgl-project.github.io

  Public
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.

  HTML

  •0•0•0•0•Updated Nov 8, 2024Nov 8, 2024

• sgl-learning-materials

  Public
  Materials for learning SGLang

  MIT License

  •5•75•0•0•Updated Nov 6, 2024Nov 6, 2024

• tensorrt-demo

  Public
  TensorRT LLM Benchmark Configuration

  Python

  •4•11•0•0•Updated Jul 26, 2024Jul 26, 2024