s3proxy icon indicating copy to clipboard operation
s3proxy copied to clipboard

S3 Proxy doesn't support CheckSum verification and it throws exception

Open Ajaysankaran opened this issue 9 months ago • 1 comments

When trying to upload a stream to S3Proxy, it throws the error message as mentioned below. The stream is uploaded using S3AsyncClient from aws-java-sdk

S3 Proxy Version: 2.6.0 AWS Java SDK Version: 2.30.9

Error Details

  • Initially it threw the below error:

org.gaul.s3proxy.S3ProxyHandler - Unknown header x-amz-trailer with URI *****

  • After S3Proxy is configured to ignore unknown headers, it throws the below error

Content-Length mismatch, actual: 2052 expected 2000

  • The above error is coming from TransientStorageStrategy | L: 198

Ajaysankaran avatar Mar 10 '25 11:03 Ajaysankaran

Checksum validation has been enabled by default in AWS SDK for Java 2.30.0. It can be disabled by setting those options when building the S3 Client

        .requestChecksumCalculation(RequestChecksumCalculation.WHEN_REQUIRED)
        .responseChecksumValidation(ResponseChecksumValidation.WHEN_REQUIRED)

JulienBenoitSonos avatar Jun 04 '25 09:06 JulienBenoitSonos

Duplicate of #830.

gaul avatar Aug 29 '25 03:08 gaul