Skip to content

Commit

Permalink
Chore: update submodule
Browse files Browse the repository at this point in the history
  • Loading branch information
XprobeBot committed Jul 5, 2024
1 parent a1dbb75 commit 14a48b7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion third_party/inference
Submodule inference updated 54 files
+26 −2 .github/workflows/docker-cd.yaml
+9 −1 .github/workflows/python.yaml
+1 −1 doc/source/getting_started/using_docker_image.rst
+12 −10 doc/source/locale/zh_CN/LC_MESSAGES/getting_started/using_docker_image.po
+68 −19 doc/source/locale/zh_CN/LC_MESSAGES/user_guide/continuous_batching.po
+113 −1 doc/source/models/builtin/llm/qwen2-instruct.rst
+16 −0 doc/source/models/builtin/llm/qwen2-moe-instruct.rst
+31 −3 doc/source/user_guide/continuous_batching.rst
+3 −0 setup.cfg
+6 −6 xinference/api/restful_api.py
+0 −2 xinference/client/restful/restful_client.py
+21 −4 xinference/core/model.py
+2 −0 xinference/core/scheduler.py
+4 −3 xinference/core/tests/test_continuous_batching.py
+74 −45 xinference/core/worker.py
+12 −12 xinference/deploy/docker/Dockerfile
+5 −47 xinference/deploy/docker/cpu.Dockerfile
+68 −0 xinference/deploy/docker/requirements.txt
+45 −0 xinference/deploy/docker/requirements_cpu.txt
+33 −2 xinference/deploy/utils.py
+5 −0 xinference/model/llm/__init__.py
+240 −1 xinference/model/llm/llm_family.json
+32 −8 xinference/model/llm/llm_family.py
+192 −0 xinference/model/llm/llm_family_modelscope.json
+13 −0 xinference/model/llm/mlx/__init__.py
+408 −0 xinference/model/llm/mlx/core.py
+13 −0 xinference/model/llm/mlx/tests/__init__.py
+41 −0 xinference/model/llm/mlx/tests/test_mlx.py
+2 −9 xinference/model/llm/pytorch/chatglm.py
+206 −21 xinference/model/llm/pytorch/cogvlm2.py
+213 −40 xinference/model/llm/pytorch/core.py
+171 −15 xinference/model/llm/pytorch/glm4v.py
+168 −7 xinference/model/llm/pytorch/qwen_vl.py
+53 −62 xinference/model/llm/pytorch/utils.py
+24 −5 xinference/model/llm/utils.py
+5 −0 xinference/model/rerank/core.py
+4 −4 xinference/model/rerank/tests/test_rerank.py
+13 −0 xinference/thirdparty/deepseek_vl/serve/__init__.py
+13 −0 xinference/thirdparty/deepseek_vl/serve/app_modules/__init__.py
+2 −0 xinference/web/ui/src/App.js
+3 −0 xinference/web/ui/src/components/MenuSide.js
+4 −0 xinference/web/ui/src/components/Title.js
+123 −0 xinference/web/ui/src/components/fetchWrapper.js
+32 −1 xinference/web/ui/src/router/index.js
+47 −6 xinference/web/ui/src/scenes/cluster_info/index.js
+33 −35 xinference/web/ui/src/scenes/cluster_info/nodeInfo.js
+13 −16 xinference/web/ui/src/scenes/launch_model/LaunchModelComponent.js
+11 −23 xinference/web/ui/src/scenes/launch_model/index.js
+7 −17 xinference/web/ui/src/scenes/launch_model/launchCustom.js
+18 −27 xinference/web/ui/src/scenes/launch_model/launchLLM.js
+72 −129 xinference/web/ui/src/scenes/launch_model/modelCard.js
+1 −0 xinference/web/ui/src/scenes/register_model/index.js
+29 −42 xinference/web/ui/src/scenes/register_model/registerModel.js
+38 −46 xinference/web/ui/src/scenes/running_models/index.js

0 comments on commit 14a48b7

Please sign in to comment.