has anybody recently tried these steps i.e https://lakefs.io/git-like-operations-over-minio-with-lakefs/. ??

Hey Abdul, I’m looking into this, will update here soon

sure, i was trying this locally on ubuntu 18.04.6 x_64

Are you running lakefs using the docker-compose?

yes

curl https://compose.lakefs.io | docker-compose --env-file $LAKEFS_CONFIG_FILE -f - up

the content of env file is as bleow

root@Buzzy:~/one# cat .lakefs-env  AWS_ACCESS_KEY_ID=minioadmin AWS_SECRET_ACCESS_KEY=minioadmin LAKEFS_BLOCKSTORE_S3_ENDPOINT=http://localhost:9000 LAKEFS_BLOCKSTORE_TYPE=s3 LAKEFS_BLOCKSTORE_S3_FORCE_PATH_STYLE=true

lakectl config
# output:
# Config file /home/janedoe/.lakectl.yaml will be used
# Access key ID: <LAKEFS_ACCESS_KEY_ID>
# Secret access key: <LAKEFS_SECRET_KEY>
# Server endpoint URL: <http://127.0.0.1:8000/api/v1>

try to change Server endpoint URL to

<http://172.17.0.1:8000/api/v1>

will try and update here

then run docker compose again

ok

Getting same error

root@Buzzy:~/one# lakectl config Config file /root/.lakectl.yaml will be used Access key ID: AKIAJYYLCEIABZM2R6VQ Secret access key: t9g9BYHRbIZ5fKiu9uew30N+DEY77TPvw3uSOlmd Server endpoint URL: http://172.17.0.1:8000/api/v1

root@Buzzy:~/one# lakectl repo create lakefs://example-repo s3://example-bucket Repository: lakefs://example-repo failed to create repository: failed to access storage 400 Bad Request

lakefs server terminal logs as below:

lakefs_1  | time=“2022-02-24T133551Z” level=error msg=“failed to get region for bucket, falling back to default region” func=“pkg/block/s3.(*ClientCache).getBucketRegion” file=“build/pkg/block/s3/client_cache.go:71" error=“RequestError: send request failed\ncaused by: dial tcp 127.0.0.19000 connect: connection refused” host=“172.17.0.1:8000" method=POST path=/api/v1/repositories request_id=ab21862a-5930-4d5c-8195-ae159c7945f7 service_name=rest_api lakefs_1  | time=“2022-02-24T133551Z” level=error msg=“error making request request” func=“pkg/block/s3.(*Adapter).streamToS3” file=“build/pkg/block/s3/adapter.go:232" error=“Put \“http://localhost:9000/example-bucket/dummy\“: dial tcp 127.0.0.19000 connect: connection refused” host=“172.17.0.1:8000" method=POST operation=PutObject path=/api/v1/repositories request_id=ab21862a-5930-4d5c-8195-ae159c7945f7 service_name=rest_api url=“http://localhost:9000/example-bucket/dummy” lakefs_1  | time=“2022-02-24T133551Z” level=warning msg=“Could not access storage namespace” func=“pkg/api.(*Controller).CreateRepository” file=“build/pkg/api/controller.go:1220” error=“Put \“http://localhost:9000/example-bucket/dummy\“: dial tcp 127.0.0.19000 connect: connection refused” service=api_gateway storage_namespace=“s3://example-bucket”

can you add

LAKEFS_BLOCKSTORE_S3_REGION=us-east-1

ok

same issue🙂

root@Buzzy:~/one# lakectl repo create lakefs://example-repo s3://example-bucket Repository: lakefs://example-repo failed to create repository: failed to access storage 400 Bad Request

i restarted the docker-compose after updating the env file

Can you share lakefs logs again

sure, lakefs logs are as below

lakefs_1  | time=“2022-02-24T134729Z” level=error msg=“failed to get region for bucket, falling back to default region” func=“pkg/block/s3.(*ClientCache).getBucketRegion” file=“build/pkg/block/s3/client_cache.go:71" error=“RequestError: send request failed\ncaused by: dial tcp 127.0.0.19000 connect: connection refused” host=“172.17.0.1:8000" method=POST path=/api/v1/repositories request_id=8edd87e6-7244-4f01-a483-5f2497db7832 service_name=rest_api lakefs_1  | time=“2022-02-24T134729Z” level=error msg=“error making request request” func=“pkg/block/s3.(*Adapter).streamToS3” file=“build/pkg/block/s3/adapter.go:232" error=“Put \“http://localhost:9000/example-bucket/dummy\“: dial tcp 127.0.0.19000 connect: connection refused” host=“172.17.0.1:8000" method=POST operation=PutObject path=/api/v1/repositories request_id=8edd87e6-7244-4f01-a483-5f2497db7832 service_name=rest_api url=“http://localhost:9000/example-bucket/dummy” lakefs_1  | time=“2022-02-24T134729Z” level=warning msg=“Could not access storage namespace” func=“pkg/api.(*Controller).CreateRepository” file=“build/pkg/api/controller.go:1220” error=“Put \“http://localhost:9000/example-bucket/dummy\“: dial tcp 127.0.0.19000 connect: connection refused” service=api_gateway storage_namespace=“s3://example-bucket”

what is

LAKEFS_BLOCKSTORE_S3_ENDPOINT

root@Buzzy:~/one# cat .lakefs-env  AWS_ACCESS_KEY_ID=minioadmin AWS_SECRET_ACCESS_KEY=minioadmin LAKEFS_BLOCKSTORE_S3_ENDPOINT=http://localhost:9000 LAKEFS_BLOCKSTORE_TYPE=s3 LAKEFS_BLOCKSTORE_S3_FORCE_PATH_STYLE=true LAKEFS_BLOCKSTORE_S3_REGION=us-east-1

LAKEFS_BLOCKSTORE_S3_ENDPOINT=http://localhost:9000

change LAKEFS_BLOCKSTORE_S3_ENDPOINT=http://172.17.0.1:9000 and revert the Server endpoint URL to http://127.0.0.1:8000/api/v1

ok

this worked

root@Buzzy:~/one# lakectl repo create lakefs://example-repo s3://example-bucket Repository: lakefs://example-repo Repository ‘example-repo’ created: storage namespace: s3://example-bucket default branch: main timestamp: 1645711968 root@Buzzy:~/one#

😀

Thank you so much for the help and steps

if it is okay, can you plz summarise the issue for future understanding

Thanks for the update, lakefs is running on container and minio on localhost, they don’t share the same network so lakefs won’t be able to talk to minio on local host. That’s why we changed the minio endpoint inside the lakefs container to reference the host localhost. let me know if you are running into any other issue

sure , thank you for explaining..!!