Hello team, I want to install lakeFS on AWS. I fol...
# help
b
Hello team, I want to install lakeFS on AWS. I followed the instructions you provided here, where I created an IAM with the DynamoDB permissions you specified. I linked this IAM to a new EC2 instance, created the
config.yaml
and ran the
lakefs
command. However, I get an error:
Copy code
WARNING[2024-10-23T09:07:01Z]lakeFS/pkg/kv/dynamodb/store.go:199 pkg/kv/dynamodb.setupKeyValueDatabase Failed to create or detect KV table           error="operation error DynamoDB: CreateTable, https response error StatusCode: 0, RequestID: , request send failed, Post \"<https://dynamodb>..<http://amazonaws.com/\|amazonaws.com/\>": dial tcp: lookup dynamodb..<http://amazonaws.com|amazonaws.com>: no such host" table_name=kvstore
INFO   [2024-10-23T09:07:01Z]lakeFS/pkg/kv/dynamodb/store.go:165 pkg/kv/dynamodb.setupKeyValueDatabase.func1 Setup time                                    table_name=kvstore took=7.253785ms
FATAL  [2024-10-23T09:07:01Z]lakeFS/cmd/lakefs/cmd/run.go:159 cmd/lakefs/cmd.init.func9 Failed to open KV store                       error="setup failed: operation error DynamoDB: CreateTable, https response error StatusCode: 0, RequestID: , request send failed, Post \"<https://dynamodb>..<http://amazonaws.com/\|amazonaws.com/\>": dial tcp: lookup dynamodb..<http://amazonaws.com|amazonaws.com>: no such host"
I wanted to ask if you can reproduce it and help me resolve this? Thanks in advance!
i
Hey @Benoit Putzeys 👋 There seems to be something wrong with your DDB host, the region part of the url is missing (for example
<http://dynamodb.us-east-1.amazonaws.com|dynamodb.us-east-1.amazonaws.com>
). Could you double check your lakeFS config and/or your AWS env vars on the EC2 instance and make sure there’s no some sort of mixup?
b
Hey Itai. Thank you very much for your quick reply! This helped because now I get a different error (yay) haha
Copy code
FATAL  [2024-10-23T09:59:37Z]lakeFS/cmd/lakefs/cmd/run.go:165 cmd/lakefs/cmd.init.func9 Failure on schema validation                  error="get KV schema version: get item: operation error DynamoDB: GetItem, https response error StatusCode: 400, RequestID: JARDBF7599AP7Q40IJIAAGCJ3NVV4KQNSO5AEMVJF66Q9ASUAAJG, api error ValidationException: The provided key element does not match the schema"
i
Now I'm not so sure 😅 are you using a fresh DDB table? Is it possible that are some leftovers in the table you use?
b
ah I thought I had deleted it but indeed it was still there!
Thank you so much! It works smoothly now.
To clarify and maybe for other people, I ran the command:
export LAKEFS_DATABASE_DYNAMODB_AWS_REGION="eu-north-1"
to solve the original issue in this thread. And for the other issue, I made sure to have no table in DDB.
👌 1