TransferListener not working properly

[kanonier171]

Example implementation of upload file with s3TransferManager does not log upload progress properly. When I upload a file with size 1GB, progress log show me 100% but next log "Transfer complete!" occurr after few minutes.

Example code

    UploadFileRequest uploadRequest = UploadFileRequest.builder()
        .putObjectRequest(putObjectRequest)
        .addTransferListener(LoggingTransferListener.create())
        .source(fileInStorage)
        .build();
    CompletedFileUpload completedUpload = s3TransferManager.uploadFile(uploadRequest).completionFuture()
        .join();

AWS Java SDK version used

2.19.8

[debora-ito]

@kanonier171 can you share a repro code of how you're using the TransferListener?
And also the logs with the timestamps?

[kanonier171]

It is simple implementation from amazon sdk docs: docs
void upload(PutObjectRequest putObjectRequest, Path fileInStorage) {
UploadFileRequest uploadRequest = UploadFileRequest.builder()
.putObjectRequest(putObjectRequest)
.addTransferListener(LoggingTransferListener.create())
.source(fileInStorage)
.build();
CompletedFileUpload completedUpload = s3TransferManager.uploadFile(uploadRequest).completionFuture()
.whenComplete((result, e) -> {
if (e != null) {
throw new S3TransferManagerException("Cannot upload file " + putObjectRequest.key(), e);
}
})
.join();
String eTag = completedUpload.response().eTag();
log.info("File [{}] successfully sent do S3. ETag {}", fileInStorage, eTag);
}

and logs

`INFO  11:17:38,781 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - Transfer initiated...

INFO 11:17:38,783 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - | | 0.0%
INFO 11:17:38,903 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |= | 9.3%
INFO 11:17:39,657 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |=== | 18.6%
INFO 11:17:39,679 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |===== | 27.9%
INFO 11:17:39,704 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |======= | 37.3%
INFO 11:17:39,723 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |========= | 46.6%
INFO 11:17:39,748 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |=========== | 55.9%
INFO 11:17:39,770 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |============= | 65.3%
INFO 11:17:39,793 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |============== | 74.6%
INFO 11:17:39,812 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |================ | 83.9%
INFO 11:17:39,837 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |================== | 93.3%
INFO 11:17:39,852 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - |====================| 100.0%
INFO 11:22:09,228 pl.netpr.login.files.s3.NetprS3TransferManagerControl - File [\dbfiles\14\2023\1\18\2376407.7z] successfully sent do S3. ETag "1d02e56fe389979c013115d7f9394e47-22"
INFO 11:22:09,229 software.amazon.awssdk.transfer.s3.progress.LoggingTransferListener - Transfer complete!`

[leo-hydraulic]

We've hit this bug as well. Our current workaround is to not use the S3TransferManager at all, which isn't great.

[github-actions]

This issue is now closed. Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.