https://lakefs.io/ logo
Title
i

Itai David

09/22/2022, 2:09 PM
Welcome @Alok Anand. Could you please share some more details on your case - what is the data size you are trying to fetch?
y

Yoni Augarten

09/22/2022, 2:10 PM
Also, please share how lakeFS is installed (locally, on your cloud, or using the lakeFS Cloud managed service)
a

Alok Anand

09/22/2022, 2:19 PM
Hi @Yoni Augarten @Itai David, I have installed lakeFs in docker on my local and the repository is on azure storage. I have followed the below documentation(https://docs.lakefs.io/integrations/databricks.html) to configure my cluster. The data size is very small with 4 mb parquet file.
y

Yoni Augarten

09/22/2022, 2:20 PM
Thank you for the details. In order for Databricks to be able to access lakeFS, your lakeFS server endpoint needs to be accessible by Databricks. This can prove a bit tricky on a local installation, but you can use a service like ngrok to achieve that.
🙌 2
Note that the endpoint you provided as the lakeFS server URL (https://lakefs.example.com) is just an example from our docs.
👍 2
a

Alok Anand

09/23/2022, 9:53 AM
Thanks @Yoni Augarten