add bedrock system cross-region inference profiles#537
Conversation
🦋 Changeset detectedLatest commit: 26d629a The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
|
Hello @atierian, I came across this PR because I am very interested in support for cross-region inference profiles! Unfortunately, I don't think the changes in this PR will work without also updating the code that generates the IAM policy for the Lambda chat handler. That is because inference profiles have a different ARN prefix than foundational models. When manually providing the model ID or ARN for an inference profile (using the main branch), here is what the resulting chat handler policy looks like it: When it should actually look like this: |
Problem
Issue number, if available:
Changes
Corresponding docs PR, if applicable:
Validation
Checklist
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.