Skip to content

Add configuration option to disable "Expect: 100-continue" header for S3 streaming operations #6537

Description

@bhoradc

Describe the feature

Java SDK currently forces the Expect: 100-continue header on all putObject and uploadPart requests via StreamingRequestInterceptor. This overrides any HttpClient configuration that attempts to disable this header. We need a SDK-level configuration option to control whether the Expect: 100-continue header is added to streaming requests.

Use Case

The Hadoop S3A connector added fs.s3a.connection.expect.continue to disable expect-continue for rare cases where network/proxy failures before CONTINUE response cause thread hangs. However, SDK's StreamingRequestInterceptor explicitly sets the header, bypassing the HttpClient configuration. Need SDK-level control for this emergency option.

Proposed Solution

No response

Other Information

This feature request originated from discussion in GitHub issue #6459 (comment)

Acknowledgements

  • I may be able to implement this feature request
  • This feature might incur a breaking change

AWS Java SDK version used

2.32.23

JDK version used

17

Operating System and version

Amazon Linux

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature-requestA feature should be added or improved.p2This is a standard priority issue

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions