#5491 Add more detailed docs for `revert` operation Issue created by rmoff The existing docs aren't clear for me (and thus maybe others) on some aspects of using

revert

. Need more explanation, diagrams, and examples. See conversation here Slack Message treeverse/lakeFS

the DuckDB feature on the Object page seems to cache or not re-query data, is that expected? If I run a query, change the underlying data in a separate session, and re-execute the query in the object window the results stay the same until I reload the whole page and re-enter the query. Logged: https://github.com/treeverse/lakeFS/issues/5494

Hi, what policy do I need to set to give permissions for setting branch protection rules? I couldn’t find one that matches exactly the description, so I guess it must be covered by some other more general one. The user has permissions to see Actions, Settings>General and Settings>Retention, but does not have permission for Settings>Branches.

hi there! Newbie question: I am running lakefs on localhost and I am trying to upload a file through lakectl. However I get the following error ( see screenshot below ). Am I missing something here?

Hi Team I want to to use lakefs in the debugger mode. Can you please me how can I set one up? I want to debug one Hadoop filesystem

does lakeFS have an equivalent of

git mv

?

Hello! I'm trying to query data from lakeFS, run locally, using pyspark, however, I get "java.lang.RuntimeException: java.lang.ClassNotFoundException: Class io.lakefs.LakeFSFileSystem not found". I am running a spark shell with --packages io.lakefshadoop lakefs assembly0.1.12 as per the doc https://docs.lakefs.io/integrations/spark.html. Could someone explain why LakeFSFileSystem might not be found?

Hello, I was evaluating LakeFS Open Source for my study and yesterday I saw that RBAC got deprecated on the last release. So now, I would be interested to get some information on the new LakeFS Enterprise which seems to be very interesting. Could someone tell me where could I get this version? And is there any technical constraint or requirement to work on it that I need to know ?

Hi all 👋 is there a way to configure Databricks Serverless SQL warehouses to read from and write to LakeFS paths?

hey y’all, I have a few questions regarding LakeFS Actions: 1. given that we use LakeFS cloud, where does the script for Lua Hooks actually run? is it on our infrastructure or on LakeFS’ infra? 2. when an action fails, is there a way to configure a notification to be routed to PagerDuty or slack for example? 3. I want to use some secrets in my Lua Hook script. What’s the best way to store those secrets and use them in the script? thanks!

Hello everyone, I have two questions about the use of lakectl. First, is there a command to know the current branch ? Second, what is the command to switch branch if exists ? (The equivalent of git checkout) I also have a final question (I promise) about the creation of a repo. After creating one and linking it to an s3 bucket, it is no longer possible to share this storage namespace with another lakeFS repo. If I don't use this repo anymore and I delete it, is there any way to connect a new repo to this same bucket ? Thank you for your precious help !

Hi @Paul, Welcome to lakeFS! I'll answer your questions in separate messages, to allow you to respond if needed to each answer separately. Otherwise I get mixed up 😖 .

First, is there a command to know the current branch ?

A difference between Git and lakeFS is that lakeFS has no concept of a "current branch". It does not make sense on a datalake, as access to the lake itself is distributed among machines. So if you look at lakectl commands they all take a lakeFS path. You might be able to do something similar using the

--base-uri

flag of

lakectl

. Taking it one step further, you can set the environment variable

LAKECTL_BASE_URI

and all relative locations you give lakectl will be relative to that branch or repo (or even a deeper prefix).

Second, what is the command to switch branch if exists ? (The equivalent of git checkout)

Since there is no current branch, there is no "checkout" command. You could alias you way around

alias lakeco='export LAKECTL_BASE_URI=<lakefs://my-repo/$1>'

to get similar behaviour. (But it would not ensure that the branch exists)

After creating one and linking it to an s3 bucket, it is no longer possible to share this storage namespace with another lakeFS repo. If I don't use this repo anymore and I delete it, is there any way to connect a new repo to this same bucket ?

Unfortunately not all of the state of the repo is held on the storage namespace, so this is not possible. We would have the objects and the structure of contents of each commit, but AFAIK not the actual branches and commits.

Thank you very much for all these very clear answers. I understand that it is not possible to connect two lakeFS repositories to the same s3 bucket (even after deleting one of them) but is it possible to connect two s3 buckets to the same lakeFS repo ?

Hey, great community. Nice to meet you all. 🙂 I finally arranged a time to quickly go over LakeFS quick-start to see how it works. First of all, super useful. (and the quick start is well done as well - kudos to the team who wrote it and the rest of the documentation) 😃 I'm trying to compare with other tools and for now, I can't find the real edge (for tabular data) over simpler solutions like Iceberg. Don't get me wrong, I do see the differences, but for most use cases, both provide git-like capabilities. Whereas, Iceberg is easier to adopt since there is no deployment - AFAIK, only the metadata files sitting alongside the data itself and an added jar to Spark/Flink. On the other hand, LakeFS gives us more of a platform-like solution, with a UI and a CLI, with less or no dependency on Spark. Anyway, maybe I am comparing them wrong. I hope you can take a few minutes to help me understand the use cases. I'm asking from the pure desire to check it out for real production purposes. 🙂 (btw, for non-databricks users, I feel that open-source delta-lake can lose ground if they don't implement better features like git-kind features and more, but that's another conversation)

Hello everyone, I have some questions about the [Multipart Uploads](https://docs.lakefs.io/reference/s3.html): • Are there any best practices about multipart uploads in lakefs? Such as how to call the interfaces in Golang? • Are AbortMultipartUpload and ListParts API available? I encountered some errors when I used the aws-sdk-go-v2 to call the interfaces.

Somebody, who has been using lakeFS for some time, asked this question to me directly: “Is there any disadvantage using lakectl using as bash for all the lakeFS operations (Import,branch, commit etc) Vs LakeFS Python API for it.”

Hello, there.. I was assigned with the issue#5605 and wanted some help about it..

if I want to use lakeFS with Spark SQL, do I set

spark.sql.warehouse.dir

? I've tried that but getting

org.apache.spark.SparkException: Unable to create database default as failed to create its directory <s3://example/main>.

and no obvious error on the lakeFS side that I can see.

Hi there 👋 Does the GC job support use service account based auth (IRSA IAM) instead of having s3 secrets mounted to it? We are planning to have GC run as a

SparkApplication

in k8s. Thanks

Hello, I am trying the 30 days demo but it seems we can only choose AWS in the setup page as Cloud vendor? What if I want to try GCP ? Why is the option greyed out?

Hello everyone. I want to apply LakeFS Writer program but I cannot apply for this program because the form is not available. How to apply for this program?

We have deployed dataset to a local lakefs (docker). Question: later on, we will have a lakefs deployed in azure. How do you migrate the data and history to the new lakefs server?

Hello everyone, I've configured lakeFS with a postgreSQL database. So, lakeFS created many tables in the database that I filled in (101 in total, from kv to kv_99). The first one contains all information about my repo, branches, commits... but all the others are empty. What is ther use? I look at this page in the doc https://docs.lakefs.io/understand/how/kv.html but it's not clear for me.

is there a way to do

lakectl branch revert

from the web UI? e.g. what's shown here but without CLI https://docs.lakefs.io/use_cases/rollback.html#how-to-rollback-from-a-bad-data-sync

Hello, I have a question about the storage capacity of lakefs, what is the maximum size of a repo?

Hi I am looking for some inspiration regarding how to use dagster with lakefs, if anyone know of something or has experience regarding it please reach out to me, thanks in advance.

Can we add metadata to a branch? Use case is - I want to add the button I added in the previous commit that is merged into the branch.