Is there some way to download multiple files in parallel via the

fs

or similar command (ideally without wildcards, and without using recursion), e.g.:

lakectl fs download /data/train.csv /data/test.csv dst_dir

hey @Chris 👋 as mentioned in the command reference, the download command supports the

-r

flag, which will recursively download directories if specified.

Ah, so that isn't my use case. A recursive download fetches everything recursively, but a selective download of multiple files is what I am after. Usually, in tools that want to be strictly recursive or not, there are

--include/--exclude

patterns I can set (e.g. rsync).

I don't think we have this functionality in lakectl. A nice thing about the S3 gateway is that it provides a decent workaround: you can use any of these tools by telling it to use the S3 gateway endpoint. We have some instructions here for how to run rclone on the lakeFS endpoint. I hope they might at least unblock you on your current use case.

Thanks !