lakeFS is an open-source data version control that transforms your object storage to Git-like repositories..

lakeFS

Following online discussion: <https://github.com/treeverse/lakeFS/blob/8cc1b2799ea69e80ee133c62571b4bd81f2d76e2/clients/spark/core/src/test/scala/io/treeverse/clients/GarbageCollectorSpec.scala#L171-L175|These lines> from the GarbageCollectorSpec show we create a small local Spark inside a test environment.  These can go inside a setup / @Before block.  (We'll probably need to translate them to Java, but it's the same thing in any language).

In practice <https://github.com/treeverse/lakeFS/blob/4153e643760b800c408335d776bd7e3e64bf45a3/.github/workflows/esti.yaml#L213-L254|this runs as part of the Esti workflow>, complete with a lakeFS.