Hi, does LakeFS support associating a single repository with multiple storage namespaces (S3 prefixes)? Or is the storage namespace applied at the repository level, meaning that all objects under all branches must be within the repo’s storage namespace?
n
Niro
03/28/2024, 6:48 PM
Hi @Yang Zheng lakeFS manages each repository under a single exclusive namespace. This means that all objects of a given repository will be under that configured storage namespace with the exception of imported objects
d
Dmitriy Ryaboy
03/28/2024, 6:49 PM
@Niro but to your exception point, one can import (and reimport, as needed) from multiple buckets, correct? The tradeoff being now the user is responsible for making sure the data in the buckets is not mutated.
n
Niro
03/28/2024, 6:51 PM
That's true, pending you provide lakeFS the necessary credentials to read from said buckets (sources)
i
Iddo Avneri
03/28/2024, 7:18 PM
Stating the obvious - you can chose to upload objects instead of importing them if you are concerned with data being mutated. (Trading off space, and potentially initial time to get started)