Skip to content

Commit

Permalink
update tgi container (#724)
Browse files Browse the repository at this point in the history
  • Loading branch information
pagezyhf authored Oct 25, 2024
1 parent 1de603e commit 6a6bb03
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/containers.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ print(f"llm image uri: {llm_image}")
|-----------------------------|-----------------|---------------------------------------------|
| Training | 0.0.24 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.41.1-neuronx-py310-sdk2.19.1-ubuntu20.04` |
| Inference | 0.0.24 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.41.1-neuronx-py310-sdk2.19.1-ubuntu20.04` |
| Text Generation Inference | 0.0.24 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-tgi-inference:2.1.2-optimum0.0.24-neuronx-py310-ubuntu22.04` |
| Text Generation Inference | 0.0.25 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-tgi-inference:2.1.2-optimum0.0.25-neuronx-py310-ubuntu22.04` |
Please replace `763104351884` with the correct [AWS account ID](https://github.com/aws/sagemaker-python-sdk/blob/master/src/sagemaker/image_uri_config/huggingface-neuronx.json) and `region` with the AWS region you are working in.

0 comments on commit 6a6bb03

Please sign in to comment.