Hi, how to fork a repo just like Git ? I want to s...
# helpa
Ants Young
01/29/2023, 2:31 AMHi, how to fork a repo just like Git ? I want to share data with others.
o
Or Tzabary
01/29/2023, 2:36 AMHey @Ants Young !
You can import other objects (even not yours, but they need to be accessible) to be managed by lakeFS (zero copy)
a
Ants Young
01/29/2023, 2:46 AMDo you mean
lakectl import --from --too
Or Tzabary
01/29/2023, 2:59 AMUnfortunately, I think the same command doesn't exist in lakeFS though it can ba partially achieved with the import command
Or Tzabary
01/29/2023, 7:59 AM@Ants Young mind explaining a bit more on your use case?
Or Tzabary
01/29/2023, 10:24 AMplease note that lakeFS is used to collaborate on repository data and offer the branching primitives. This is also similar to code collaboration - when you want to collaborate on code you branch out of main. you create a repo fork in case that you want to change the software logic or in case you are making a contribution to a project, and I don’t think we heard of the parallel use case in data (yet).
understand the use-case will help us improve lakeFS and possibility adding the feature to support the use-case.
a
Ants Young
01/30/2023, 7:18 AMThank you @Or Tzabary, I'm developing a ML training platform which offers MLEs a cloud enviroment to training ML models. Our platform is supposed to support MLEs to share datasets and models with others. In this case, forking a data repo could save a lot of storage, rather than download the whole dataset and add some new data then create a new repo in lakeFS. So, data sharing and storage saving are two main motivations to ask for a fork feature. Thank you.
o
Or Tzabary
01/30/2023, 7:24 AMI trust that checking out to a branch will give you the same result as it's zero copy operation done on the repository level
a
Ants Young
01/30/2023, 7:30 AMYes, you're right. But how can I set independent read/write permission on this data repo?
o
Or Tzabary
01/30/2023, 7:45 AMlakeFS has a built in authorization mechanism just that :)
https://docs.lakefs.io/reference/authorization.html
a
Ants Young
01/30/2023, 1:17 PMThat's really great, thank you. @Or Tzabary
o
Or Tzabary
01/30/2023, 1:32 PMI’m happy to hear 🙂
does this support your use-case?
if you still have questions or concerns, I’ll be happy to set a quick call to discuss the use-case
a
Ants Young
01/30/2023, 2:02 PMThank you, I'm a beginner to lakeFS, so far it works well for me. I'll ask for help if I get trouble. Thanks.
🙏 1
3 Views