We are looking into connecting unity catalog to lakefs. What's the best way to approach this, trying to wrap my head around how others should know that they should use our custom S3 Endpoint to look for

Azure Blob is also supported.

Are there any docs on this? the docs I find is saying only AWS S3 is supported

I will publish Azure Databricks sample notebook in our samples repo and will let you know.

Is it also possible without Lua hooks?

Following our email correspondence on additional features, Potentially in the future we could run python code in hooks. Let’s discuss on our call! (FYI @Oz Katz)

It might also be interesting to connect with the databricks unity product team together?

@Ion I released Azure Databricks sample notebook for Unity Catalog Integration demo. There are 2 notebooks: Unity Catalog Integration Demo.ipynb and unityCatalogIntegrationDemoSetup.ipynb.

@Amit Kesarwani hey, thanks for the Material! I went through it and the guide but I think the setup might not work for us. • Table registration is done by a different team, we can only mention what the paths are to them. • We are not allowed to use oauth tokens Is it possible to only use the table exporter, and not do the registration with the hook, and let this be done by the other team?

Yes, you can only use table exporter