Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bedrock Converse API integration #977

Open
FloRul opened this issue Aug 13, 2024 · 2 comments
Open

Bedrock Converse API integration #977

FloRul opened this issue Aug 13, 2024 · 2 comments
Labels
integration:amazon-bedrock new integration Discuss the creation of a new integration in Core P3

Comments

@FloRul
Copy link
Contributor

FloRul commented Aug 13, 2024

Integrate AWS Bedrock Converse API into Haystack

Background

AWS Bedrock released earlier this year their new converse API that aims to standardize their api calls to their models.

Objective

Integrate the AWS Bedrock Converse API into the Haystack integration library to allow users to leverage AWS Bedrock converse within their Haystack pipelines, paving the way potentially for easier agent development and multimodal integration.

Proposed Features

  1. Add a new BedrockConversationGenerator node in Haystack integrations.
  2. Support easy tool calling with some new classes to ease the process of tools definition and calling.
  3. Support streaming responses from the Bedrock Converse API.
  4. Implement error handling and retries for API calls.

Implementation Details

  • Use the AWS SDK for Python (Boto3) to interact with the Bedrock Converse API.
  • Follow Haystack's node implementation guidelines for consistency.

Resources

Alternatives

This could also be a feature for the existing AmazonBedrock generators instead of a new one.

@FloRul FloRul added the new integration Discuss the creation of a new integration in Core label Aug 13, 2024
@FloRul
Copy link
Contributor Author

FloRul commented Aug 15, 2024

Currently working on it

@lambda-science
Copy link
Contributor

Currently working on it

Following on this, it will help a lot with tool use across all AWS Bedrock models with this unified API

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
integration:amazon-bedrock new integration Discuss the creation of a new integration in Core P3
Projects
None yet
Development

No branches or pull requests

4 participants