Can you please show how to setup Lakefs with aws?

Hi @setu suyagya and welcome! Please see the following lakeFS documentation on deployment with AWS: Also, I recommend starting with this guide if you are taking your first steps with lakeFS. Let us know if you have any additional questions! jumping lakefs

i am getting issue in prerequisites as i am new to aws also

Can you share what issue you're facing?

Are you trying to add permissions for lakeFS? If that's the case, you can see here how to configure your bucket.

i tried this only but its not working properly, i guess i am doing some mistake in the prerequisites i.e virtual hosting and S3 configuration

Can you share the policy that causes the error?

{ "Id": "Policy1590051531320", "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1590051522178", "Action": [ "s3:GetObject", "s3:GetObjectVersion", "s3:PutObject", "s3:AbortMultipartUpload", "s3:ListMultipartUploadParts", "s3:GetBucketVersioning", "s3:ListBucket", "s3:GetBucketLocation", "s3:ListBucketMultipartUploads", "s3:ListBucketVersions" ], "Effect": "Allow", "Resource": ["arnawss3:::axtria-lakefs-test", "arnawss3:::<BUCKET_NAME_WITH_PATH_PREFIX>/*"], "Principal": { "AWS": ["arnawsiam:141327738889role/<IAM_ROLE>"] } } ] }

As the error points, the principal is invalid. You should replace

<IAM_ROLE>

with the relevant role (this is relevant if you're using IAM_ROLE authenticate lakeFS to AWS). You should also replace

<BUCKET_NAME_WITH_PATH_PREFIX>

to you bucket name.

where do i get this IAM_ROLE

As i installed lakefs using docker in my sytem

This is related to accessing and identifying to AWS resources. You can read more about AWS IAM to get information about that. Regarding lakeFS - if you use an AWS user’s key-pair to authenticate lakeFS to AWS, change the policy’s Principal to be the user:

"Principal": {
   "AWS": ["arn:aws:iam::<ACCOUNT_ID>:user/<IAM_USER>"]
 }