Hello LakeFS community, is there a plan to enable support for open table formats like Iceberg, Delta Lake etc? If yes, what is the tentative ETA?
Ariel Shaqed (Scolnicov)
10/18/2022, 3:37 PM
Hi @Ranjeetha Raja,
Welcome to the lake! Both of these are on our roadmap, and Iceberg is "high priority". You can get some support for Delta even just by using the s3 gateway - obviously we need to improve that too.
10/18/2022, 3:49 PM
thank you Ariel for the prompt response. Any ETA for the Iceberg support?
H @Ranjeetha Raja, let me add some deta on @Ariel Shaqed (Scolnicov) initial answer.
Delta lake is supported, with the exception of "merge" in case both source and destination branches have changed.
Hudi and Iceberg support is expected by the end of December.
We will share the GitHub issues with you once those are all available.