Thread
#lakefs-for-beginners
    Itai David

    Itai David

    5 days ago
    Welcome @Alok Anand. Could you please share some more details on your case - what is the data size you are trying to fetch?
    Yoni Augarten

    Yoni Augarten

    5 days ago
    Also, please share how lakeFS is installed (locally, on your cloud, or using the lakeFS Cloud managed service)
    a

    Alok Anand

    5 days ago
    Hi @Yoni Augarten @Itai David, I have installed lakeFs in docker on my local and the repository is on azure storage. I have followed the below documentation(https://docs.lakefs.io/integrations/databricks.html) to configure my cluster. The data size is very small with 4 mb parquet file.
    Yoni Augarten

    Yoni Augarten

    5 days ago
    Thank you for the details. In order for Databricks to be able to access lakeFS, your lakeFS server endpoint needs to be accessible by Databricks. This can prove a bit tricky on a local installation, but you can use a service like ngrok to achieve that.
    Note that the endpoint you provided as the lakeFS server URL (https://lakefs.example.com) is just an example from our docs.
    a

    Alok Anand

    5 days ago
    Thanks @Yoni Augarten