Update Streaming Validator for AWS Bedrock Models

[martinwangjian]

This pull request updates the streaming validator logic in our AWS Bedrock integration to align with the latest AWS documentation. According to the AWS Bedrock Models Documentation, models from Anthropic, Cohere, AI21 Labs, Meta, and Mistral support streaming mode, while only specific Amazon models (those with IDs containing keywords like "nova-lite", "nova-micro", "nova-pro", "titan-text-express", "titan-text-lite", or "titan-text-premier") support streaming.

Changes Made

• Streaming Validator Update:
  Modified the set_disable_streaming validator in ChatBedrockConverse to:

  • Recognize Meta, AI21 Labs, and Mistral models as having streaming enabled.
  • For Amazon models, enable streaming only when the model ID contains one of the approved keywords.

• Integration Tests Update:

  • Enhanced the parameterized test for streaming mode (test_set_disable_streaming) to include additional cases, including the new test case for "us.meta.llama3-3-70b-instruct-v1:0".
  • Ensured that models supporting streaming correctly have disable_streaming set to False, while models without streaming support set this flag to "tool_calling".

Benefits

• Alignment with AWS Official Documentation:
  This update ensures that our integration behaves as expected based on the official AWS Bedrock Models Documentation.

• Improved User Experience:
  Users leveraging AWS Bedrock models will now have the correct streaming behavior, avoiding unexpected validation errors.

Related Issue

• This PR addresses the concerns raised in Issue #354.

Please review the changes and provide any feedback or additional suggestions.