Welcome @Alok Anand. Could you please share some more details on your case - what is the data size you are trying to fetch?
09/22/2022, 2:10 PM
Also, please share how lakeFS is installed (locally, on your cloud, or using the lakeFS Cloud managed service)
09/22/2022, 2:19 PM
Hi @Yoni Augarten@Itai David,I have installed lakeFs in docker on my local and the repository is on azure storage. I have followed the below documentation(https://docs.lakefs.io/integrations/databricks.html) to configure my cluster. The data size is very small with 4 mb parquet file.
09/22/2022, 2:20 PM
Thank you for the details. In order for Databricks to be able to access lakeFS, your lakeFS server endpoint needs to be accessible by Databricks. This can prove a bit tricky on a local installation, but you can use a service like ngrok to achieve that.