Hi I am trying to access the underlying s3 storage of a repo

Question

Hi I am trying to access the underlying s3 storage of a repository using `aws profile lakefs s3 ls s3 lt bucket gt lt repo gt recursive` I have configured the `lakefs` profile with credentials from LakeFS and the corresponding endpoint url I also have `AuthFullAccess` `FSFullAccess` and `RepoManagementFullAccess` permissions However I still get the following error `An error occurred AccessDenied when calling the ListObjectsV2 operation Forbidden` Do you have an idea what I am missing

Idan Novogroder · Answer

Hi < Cristian Caloian> Two questions 1 What do you mean when you say I have configured the `lakefs` profile with credentials from LakeFS do you mean you use access key and secret from lakeFS or do you mean you use the same AWS credentials your lakeFS instance use 2 About your command `aws profile lakefs s3 ls s3 lt bucket gt lt repo gt recursive` why do you use s3 lt bucket gt lt repo gt you should use the storage namespace you configured for your repo e g `s3 lt bucket gt lt prefix gt `

HT · Answer

isn t it supposed to be `s3 lt repo gt lt branch gt lt somePath gt ``

HT · Answer

Oh nevermind by `underlying s3 storage` you mean the back end S3 bucket that LakeFS is using in which case you need the credential for that S3 bucket nothing to do with Lakefs credential

Idan Novogroder · Answer

If you re asking if you should use AWS credentials in your `~ aws credentials` file the answer is yes Please let me know if it worked for you pray skin tone 4

Cristian Caloian · Answer

I guess my first question is whether in the context of migrating a repository from one LakeFS installation to a completely different LakeFS installation I need to copy the underlying S3 storage If the answer is yes then I think now I understand that it needs the AWS credentials

Cristian Caloian · Answer

I think I figured out from the linked notebook in the guide I think it is the underlying storage namespace ```source storage namespace = target storage namespace = aws region = lt AWS region name gt e g us east 1 aws access key id = aaaaaaaaaaaaa aws secret access key = bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb ``` Thanks again for making me realize the distinction between the two pray