Can you please show how to setup Lakefs with aws?

Hi @setu suyagya and welcome! Please see the following lakeFS documentation on deployment with AWS: Also, I recommend starting with this guide if you are taking your first steps with lakeFS. Let us know if you have any additional questions! :jumping-lakefs:

i am getting issue in prerequisites as i am new to aws also

Can you share what issue you're facing?

i tried this only but its not working properly, i guess i am doing some mistake in the prerequisites i.e virtual hosting and S3 configuration

Can you share the policy that causes the error?

{ "Id": "Policy1590051531320", "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1590051522178", "Action": [ "s3:GetObject", "s3:GetObjectVersion", "s3:PutObject", "s3:AbortMultipartUpload", "s3:ListMultipartUploadParts", "s3:GetBucketVersioning", "s3:ListBucket", "s3:GetBucketLocation", "s3:ListBucketMultipartUploads", "s3:ListBucketVersions" ], "Effect": "Allow", "Resource": ["arn:aws:s3:::axtria-lakefs-test", "arn:aws:s3:::<BUCKET_NAME_WITH_PATH_PREFIX>/*"], "Principal": { "AWS": ["arn:aws:iam::141327738889:role/<IAM_ROLE>"] } } ] }

As the error points, the principal is invalid. You should replace

<IAM_ROLE>

with the relevant role (this is relevant if you're using IAM_ROLE authenticate lakeFS to AWS). You should also replace

<BUCKET_NAME_WITH_PATH_PREFIX>

to you bucket name.

where do i get this IAM_ROLE

This is related to accessing and identifying to AWS resources. You can read more about AWS IAM to get information about that. Regarding lakeFS - if you use an AWS user’s key-pair to authenticate lakeFS to AWS, change the policy’s Principal to be the user:

"Principal": {
   "AWS": ["arn:aws:iam::<ACCOUNT_ID>:user/<IAM_USER>"]
 }