• Clinton Monk

    Clinton Monk

    2 months ago
    Hi! Does LakeFS support an automatic retention policy for branches? For example, does LakeFS support creating a policy where a branch with a specific prefix with no new commits after a certain number of days is deleted? I saw that there is an object retention policy, but am not sure about branch retention. Thanks!
    Clinton Monk
    Idan Novogroder
    6 replies
    Copy to Clipboard
  • v

    Vino

    2 months ago
    Hi! I'm trying the lakeFS cloud free trial. I was able to create IAM roles (using the cloudformation stack) and connect to my s3 bucket. But the repo creation fails with
    failed to create storage repository: failed to access storage
    error. What am I missing?
    v
    Idan Novogroder
    2 replies
    Copy to Clipboard
  • s

    Sid Senthilnathan

    2 months ago
    Is there a way for Lakefs to emit events every time an object is uploaded? I see hooks, but it's at a less frequent granularity. I'm looking for something like S3 Event Notifications.
    s
    Ariel Shaqed (Scolnicov)
    6 replies
    Copy to Clipboard
  • v

    Vino

    2 months ago
    Hello! After I connect lakeFS cloud instance to AWS S3 bucket and create a repo on the bucket, why don't I see the objects that already in the S3 bucket in cloud UI?
    v
    1 replies
    Copy to Clipboard
  • k

    Kevin Vasko

    2 months ago
    I have a couple questions. 1) Is there a good “best practices” guide on how to organize your buckets for your data? 2) I'm confused on how lakeFS accesses the data through the UI. Is it accessing from the perspective of the server? Or the user that's logged in?
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    Hi @Kevin Vasko! Let me try to take these in order on successive messages to straighten out each topic...
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    Thread (1): buckets for data. I assume you're asking about (S3) buckets in the underlying storage. I've typically seen very pragmatic rather than principled approaches. There are very few differences between buckets and prefixes within a bucket on S3. I think one important one is costs tooling - it's easier to separate costs between buckets than between prefixes. Even more pragmatically, someone has already made the decision for you: for instance, if I'm only allocated the one bucket name by my organization then for that scope of usage I have my answer. I do not think anyone has written this up anywhere. (And this could be a great place for people to share theirs, hint hint!)
  • k

    Kevin Vasko

    2 months ago
    What do you mean by “prefixes”?
    k
    Ariel Shaqed (Scolnicov)
    6 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    Thread (2): how does the GUI access data? When you log into the lakeFS GUI, you get a jwt representing your identity. The GUI uses that for all access, and the lakeFS server will apply access policies for that user. Now the GUI can access objects on lakeFS. It uses the lakeFS api for that. Every metadata operation (such as listing repos or branches, or listing paths in a "directory") is obviously performed on the server. What about data operations (uploading and downloading contents)? The GUI still asks the lakeFS server. The server applies policies for the user, and if all goes well it accesses data on the storage backend (S3) on behalf of the user and transfers data to or from the user. This is all done using the server credentials; the user does not need credentials for direct data access on the storage.
    Ariel Shaqed (Scolnicov)
    k
    20 replies
    Copy to Clipboard
  • n

    Nuno Carvalho dos Santos

    2 months ago
    Good morning everyone
    n
    n
    +2
    4 replies
    Copy to Clipboard