Jennifer Cristina Evangelista Da Silva
03/24/2022, 9:52 PM--conf spark.hadoop.fs.s3a.secret.key='abc/lakefs/1234567bPxRfiCYEXAMPLEKEY' \
I did not understand this part here:
https://docs.lakefs.io/integrations/spark.html#access-lakefs-using-the-s3a-gateway
spark-shell --conf spark.hadoop.fs.s3a.access.key='AKIAlakefs12345EXAMPLE' \
--conf spark.hadoop.fs.s3a.secret.key='abc/lakefs/1234567bPxRfiCYEXAMPLEKEY' \
--conf spark.hadoop.fs.s3a.path.style.access=true \
--conf spark.hadoop.fs.s3a.endpoint='https://lakefs.example.com' ...Guy Hardonag
03/24/2022, 10:01 PMabc/lakefs/1234567bPxRfiCYEXAMPLEKEY
is the secret key
(It could of been abcd12345671234567bPxRfiCYEXAMPLEKEY
as well)
I understand why it’s confusingGuy Hardonag
03/24/2022, 10:02 PMJennifer Cristina Evangelista Da Silva
03/25/2022, 2:40 PM