Cristian Caloian
09/12/2023, 9:30 AMaws --profile lakefs s3 ls s3://<bucket>/<repo> --recursive
. I have configured the lakefs
profile with credentials from LakeFS, and the corresponding endpoint url. I also have AuthFullAccess
, FSFullAccess
and RepoManagementFullAccess
permissions. However, I still get the following error
An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Forbidden
Do you have an idea what I am missing?Idan Novogroder
09/12/2023, 10:07 AMlakefs
profile with credentials from LakeFS? do you mean you use access key and secret from lakeFS or do you mean you use the same AWS credentials your lakeFS instance use?
2. About your command- aws --profile lakefs s3 ls s3://<bucket>/<repo> --recursive
why do you use s3://<bucket>/<repo>? you should use the storage namespace you configured for your repo, e.g.- s3://<bucket>/<prefix>
HT
09/12/2023, 10:11 AMunderlying s3 storage
you mean the back end S3 bucket that LakeFS is using ... in which case you need the credential for that S3 bucket (nothing to do with Lakefs credential)Idan Novogroder
09/12/2023, 11:22 AM~/.aws/credentials
file, the answer is yes.
Please let me know if it worked for you 🙏🏽Cristian Caloian
09/12/2023, 12:00 PMsource_storage_namespace = '<s3://mySourceBucket>'
target_storage_namespace = '<s3://myTargetBucket>'
aws_region = '<AWS region name>' # e.g. us-east-1
aws_access_key_id = 'aaaaaaaaaaaaa'
aws_secret_access_key = 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'
Thanks again for making me realize the distinction between the two 🙏