I am trying to deploy LakeFS on AWS ECS with a loa...
# help
t
I am trying to deploy LakeFS on AWS ECS with a load balancer in front. I can connect to the landing page just fine using the ALB DNS name ( have not created an Alias record yet as I am just testing). My issue is using the AWS CLI to copy a file into my repo. I followed the steps: 1. Configure profile "lakefs", adding the access keys and region. 2. Created a repo with the storage namespace
<s3://example-bucket/poc/>
3. attempted to copy my file with
aws --profile lakefs --endpoint-url <http://alb_dns_name.amazonaws.com> s3 cp myfile.txt <s3://example-bucket/poc/>
I have checked the security groups and IAM policies but I am at a loss for what is causing this
đź‘€ 1
t
Hi @tgosselin!
t
hello
t
Can you please try the same cp command but use the lakefs URI instead of the repo storage namespace as the copy destination? that is, change
aws --profile lakefs --endpoint-url <http://alb_dns_name.amazonaws.com> s3 cp myfile.txt <s3://example-bucket/poc/>
into
aws --profile lakefs --endpoint-url <http://alb_dns_name.amazonaws.com> s3 cp myfile.txt <<lakefs://your-repo/your-branch/path>>
See this example for a reference
t
usage: aws s3 cp <LocalPath> <S3Uri> or <S3Uri> <LocalPath> or <S3Uri> <S3Uri> Error: Invalid argument type
replaced 1 error with another i guess
t
1. Can you please share the command you are running? 2. Can you please look if you see any errors in the lakefs logs?
and sorry, please use s3://your-repo/your-branch instead of the lakefs uri
This should work 🙂
t
that is what I was using before and was getting the error? does repo = bucket?
t
Based on your example (bullets 2-3), you used the repo storage namespace as opposed to the repo and branch name.
1. Configure profile “lakefs”, adding the access keys and region.
2. Created a repo with the storage namespace
<s3://example-bucket/poc/>
3. attempted to copy my file with
aws --profile lakefs --endpoint-url <http://alb_dns_name.amazonaws.com> s3 cp myfile.txt <s3://example-bucket/poc/>
A repository is a lakeFS concept, and it has a storage namespace associated with it. that is repo != bucket
What i’m suggesting is do
aws --profile lakefs --endpoint-url <http://alb_dns_name.amazonaws.com> s3 cp myfile.txt <s3://repo/branch/path>
instead of
aws --profile lakefs --endpoint-url <http://alb_dns_name.amazonaws.com> s3 cp myfile.txt <s3://example-bucket/poc/>
The lakeFS server expects a path that follows this convention