From ee37328da085af14f89ad1af8eb2c359ae2f46a1 Mon Sep 17 00:00:00 2001 From: "fuchen.ljl" Date: Wed, 1 May 2024 08:42:09 +0800 Subject: [PATCH] Unable to find Punica extension issue during source code installation (#4494) Co-authored-by: Simon Mo --- docs/source/getting_started/installation.rst | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/source/getting_started/installation.rst b/docs/source/getting_started/installation.rst index e7826114ffa9d..0c81f7ec6d2a9 100644 --- a/docs/source/getting_started/installation.rst +++ b/docs/source/getting_started/installation.rst @@ -53,6 +53,7 @@ You can also build and install vLLM from source: $ git clone https://github.com/vllm-project/vllm.git $ cd vllm + $ # export VLLM_INSTALL_PUNICA_KERNELS=1 # optionally build for multi-LoRA capability $ pip install -e . # This may take 5-10 minutes. .. tip::