Last question on the board for today! Can LakeFS create a folder that contains files that point to other files? So we can create custom datasets as mixtures of concrete files. For example, let's say we have two uploaded folders

Folder1/fileA.txt

fileB.txt

Folder2/fileC.txt fileD.txt

. Does lakeFS support creating a new folder,

VirtualFolder

, that contains pointers to files from both

Folder1

and

Folder2

?

VirtualFolder/fileA.txt

(pointer to

Folder1/fileA.txt

)

fileD.txt

(pointer to

Folder2/fileD.txt

) and even concrete files of its own.

Not at the moment, although I understand why it’s useful. You can copy the object but not symlink to it.

Thanks, alternatively what might work for us is being able to get the latest commit of a particular folder e.g. given a change to

<lakefs://quickstart/main/data/lakes.source.md>

or any subdirectories to /main/data/ being able to get a version number of /main/data might work for us.

logCommits

with

prefixes

will give you just that. https://github.com/treeverse/lakeFS/blob/ed3301d3c19d3f5a89bb9346bcefd0007aeee0ea/api/swagger.yml#L3514

Great thanks!