Alessandro Mangone

12/06/2022, 10:59 AM
Final question (I think, sorry 😅) It’s the first time that I have physical access to the data on s3 and I am seeing that lakefs is generating some binary files, I cannot see directly delta files, branch paths, etc. If that’s the case, does this mean that the only way to integrate with tools like athena and snowflake is by generating manifest files? Also, do the files referenced in the symlink files maintain the original columnar compression format (e.g. orc, parquet)?

Guy Hardonag

12/06/2022, 11:07 AM
Hi @Alessandro Mangone, no problem 😃 • That is the case, you won’t be able to see files directly in S3 • Yes, the only way to integrate tools that do not support S3 endpoint (such as Athena) would be to generate a manifest file • The files referenced in symlinks would be the exact same files that exist in lakeFS
👍 1