I am getting some issues when partitioning parquet, Please refer to my question here : stackoverflow

Hey, I’m not sure how your data looks and when you run this or how. • I would check if the batch you wrote to s3 VS to lakeFS is actually equal and some sort of an append and maybe contains really just 1 partition or something like that. • check

lakectl repo ls <lakefs://repo/branch/prefix/> --recursive

to see if it’s something in the UI when listing • check with s3 cli

aws s3 ls <s3://repo-name/branch-name/>  --endpoint-url=<lakefs-endpoint> --profile <profile-with-lakefs-credentials> --recursive

• Finally, here’s a reference script, I tried to recreate your case and wrote a reference python script you can check. There’s 2 cases for s3 and for lakeFS just like you described, it seems to work maybe you can check that.

@Isan Rivkin Thank you, mate. That worked. Thank you very much your time and effort