Hello we are encountering a new issue with file size. We can upload up to 10gb files, but when I tried to upload a 190gb zip file it got rejected.

backend storage limitation ?

We didn't set any limits in the backend 😐

You are using the command 'lakectl fs upload'? Could you specify the exact command you used? What is your environment setup?

Can you please detail the exact command you are running? That is, please copy from your terminal the text of a session that includes the command you ran and its output. Uploading a large object requires using a multipart upload. It is possible that you ran into some case which does not trigger multipart. So I am asking for further details. Thanks!

Thanks for getting back to me. Here is the command line: ./lakectl.exe local commit [project dir] --message [commit message] --config [config path]

This is odd.

lakectl

should use presigned URLs by default, and should upload multiparts if lakeFS supports it. You are reporting behaviour that is consistent with not using multipart uploads. • What versions of lakectl and lakeFS are you using? (Run

lakectl --version

and report the output, please) • What is the backend store for lakeFS? Only S3 currently support multipart uploads. • Can you share your lakeFS server configuration, or at least the configuration under

blockstore

? (Make sure to scrub any secret keys out of your configuration! And feel free to send it to me privately if you cannot share it publically.) • Is there anything special about your lakectl configuration? Have you set any

LAKECTL_*

environment variables on your system? • Can you share any lakeFS server logs generated while running

lakectl  local commit

? Thanks!