Skip to content

Conversation

@yao-fengchen
Copy link
Collaborator

@yao-fengchen yao-fengchen commented Nov 3, 2025

  • add a3 Dockerfile
  • pass dlinfer_tag and lmdeploy_tag (default value is main)
    • DOCKER_BUILDKIT=1 docker build --build-arg ASCEND_DEVICE=ascend_a3 --build-arg DLINFER_TAG=v0.2.3.post2 --build-arg LMDEPLOY_TAG=v0.10.2 --network=host -t lmdeploy_dlinfer:a3 -f Dockerfile.ascend_a3 .

FROM ${ASCEND_DEVICE}_base AS builder
ENV LMDEPLOY_TARGET_DEVICE=ascend
WORKDIR /opt/lmdeploy
COPY lmdeploy /opt/lmdeploy
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

copy . /opt/lmdeploy

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will refactor it.

ENV DEVICE=ascend
ENV TORCH_DEVICE_BACKEND_AUTOLOAD=0
WORKDIR /opt/dlinfer
COPY dlinfer /opt/dlinfer
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we use pip install dlinfer?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Of course, I will modify the installation method.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants