Can you please show how to setup Lakefs with aws?
# help
u
Can you please show how to setup Lakefs with aws?
u
Hi @setu suyagya and welcome! Please see the following lakeFS documentation on deployment with AWS: Also, I recommend starting with this guide if you are taking your first steps with lakeFS. Let us know if you have any additional questions! jumping lakefs
u
i am getting issue in prerequisites as i am new to aws also
u
Can you share what issue you're facing?
u
Are you trying to add permissions for lakeFS? If that's the case, you can see here how to configure your bucket.
u
i tried this only but its not working properly, i guess i am doing some mistake in the prerequisites i.e virtual hosting and S3 configuration
u
Can you share the policy that causes the error?
u
{ "Id": "Policy1590051531320", "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1590051522178", "Action": [ "s3:GetObject", "s3:GetObjectVersion", "s3:PutObject", "s3:AbortMultipartUpload", "s3:ListMultipartUploadParts", "s3:GetBucketVersioning", "s3:ListBucket", "s3:GetBucketLocation", "s3:ListBucketMultipartUploads", "s3:ListBucketVersions" ], "Effect": "Allow", "Resource": ["arnawss3:::axtria-lakefs-test", "arnawss3:::<BUCKET_NAME_WITH_PATH_PREFIX>/*"], "Principal": { "AWS": ["arnawsiam:141327738889role/<IAM_ROLE>"] } } ] }
u
As the error points, the principal is invalid. You should replace
<IAM_ROLE>
with the relevant role (this is relevant if you're using IAM_ROLE authenticate lakeFS to AWS). You should also replace
<BUCKET_NAME_WITH_PATH_PREFIX>
to you bucket name.
u
where do i get this IAM_ROLE
u
As i installed lakefs using docker in my sytem
u
This is related to accessing and identifying to AWS resources. You can read more about AWS IAM to get information about that. Regarding lakeFS - if you use an AWS user’s key-pair to authenticate lakeFS to AWS, change the policy’s Principal to be the user:
Copy code
"Principal": {
   "AWS": ["arn:aws:iam::<ACCOUNT_ID>:user/<IAM_USER>"]
 }