Skip to content

Conversation

@mmuszynskihabana
Copy link
Contributor

To create vllm-plugin docker for Ubuntu with torch package taken from upstream we need to modify 'FROM' directive - image should be based on pytorch-upstream-installer.

'TORCH_TYPE_SUFFIX' arg will have one of two values:

  • empty string (default)
  • 'upstream-'

To create vllm-plugin docker for Ubuntu with torch package taken from upstream we need to modify 'FROM' directive - image should be based on pytorch-upstream-installer.

'TORCH_TYPE_SUFFIX' arg will have one of two values:
- empty string (default)
- 'upstream-'

Signed-off-by: Michal Muszynski <[email protected]>
@github-actions
Copy link

✅ CI Passed

All checks passed successfully against the following vllm commit:
01efc7ef781391e744ed08c3292817a773d654e6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants