04/01/2023, 10:58 AM
Hello, can anyone explain me the advantage of using lakefs compared to using snapshots in Kubeflow?

Yoni Augarten

04/01/2023, 11:06 AM
Hey @Patrick, I'm not familiar with snapshots in Kubeflow, so I'll be happy to hear about them and explain how they compare with lakeFS. In general, lakeFS offers a format-agnostic full-blown version control system on top of object stores. It aims to bring the well studied methodologies of software engineering to the world of data engineering. With lakeFS, your can instantly create development branches of your data lake, enforce data quality checks on your production data, recover from data errors, and more.