lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

[Bug]: lakectl- Uploading large files (25GiB for instance) fails against AWS S3

Open Jonathan-Rosenberg opened this issue 2 months ago • 1 comments

What happened?

When using lakectl to upload a large file (25GiB was tested), to a lakeFS instance backed by an S3 bucket storage backend, the upload of a part of the multipart upload fails (against AWS S3) with the error: part(400 Bad Request)

Steps to Reproduce:

  1. lakectl fs upload lakefs://repo/branch/path -s <A large file>

Expected behavior

Upload should succeed regardless of object size.

lakeFS version

1.70

How lakeFS is installed

No response

Affected clients

No response

Relevant log output

part 997 upload https://<ACTUAL S3 BUCKET/PATH URL> part(400 Bad Request): request failed
Error executing command.
Command exited with non-zero status 1
        Command being timed: "lakectl fs upload lakefs://repo/branch/path -s <A large file>"

Contact details

No response

Jonathan-Rosenberg avatar Oct 06 '25 12:10 Jonathan-Rosenberg

@talSofer @Jonathan-Rosenberg is this issue still open i would like to contribute please assign this to me!

prabhath004 avatar Nov 04 '25 16:11 prabhath004