Oliver Dain
08/15/2023, 7:40 PMrclone
to work with the sample repo one gets by clicking "try without installing". I've setup my rclone config file like:
[lakefs]
type = s3
provider = AWS
env_auth = false
access_key_id = <redacted>
secret_access_key = <redacted>
endpoint = <https://big-zebra.us-east-1.lakefscloud.io>
no_check_bucket = true
where big-zebra.us-east-1...
is, I think, the correct endpoint for that sample repo (it's what shows in my address bar). But I get certificate errors:
$ rclone -vv ls lakefs:sample-repo/testing/
2023/08/15 12:35:09 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "-vv" "ls" "lakefs:sample-repo/testing/"]
2023/08/15 12:35:09 DEBUG : Creating backend with remote "lakefs:sample-repo/testing/"
2023/08/15 12:35:09 DEBUG : Using config file from "/home/oliver/.config/rclone/rclone.conf"
2023/08/15 12:35:09 DEBUG : fs cache: renaming cache item "lakefs:sample-repo/testing/" to be canonical "lakefs:sample-repo/testing"
2023/08/15 12:35:49 DEBUG : 2 go routines active
2023/08/15 12:35:49 Failed to ls: RequestError: send request failed
caused by: Get "<https://sample-repo.big-zebra.us-east-1.lakefscloud.io/?delimiter=&encoding-type=url&max-keys=1000&prefix=testing%2F>": x509: certificate is valid for *.<http://us-east-1.lakefscloud.io|us-east-1.lakefscloud.io>, <http://us-east-1.lakefscloud.io|us-east-1.lakefscloud.io>, not <http://sample-repo.big-zebra.us-east-1.lakefscloud.io|sample-repo.big-zebra.us-east-1.lakefscloud.io>
I see it's a wildcard cert for *.<http://us-east-1.lakefscloud.io|us-east-1.lakefscloud.io>
which seems like it should work, but it also looks like rclone
is adding the repo name (sample-repo
) to the hostname which seems incorrect. What am I doing wrong?gsutil
and a .boto
file and got the same certificate error.Oz Katz
provider = Other
instead of AWS
?Oliver Dain
08/15/2023, 7:56 PMls
gave me a recursive listing. With provider=Other
does it flatten the directory hierachy?Note that `ls` and `lsl` recurse by default - use `--max-depth 1` to stop the recursion.
Oz Katz
> s3-force-path-style
>
If true use path style access if false use virtual hosted style.
If this is true (the default) then rclone will use path style access, if false then rclone will use virtual path style. See the AWS S3 docs for more info.
Some providers (e.g. AWS, Aliyun OSS, Netease COS, or Tencent COS) require this set to false - rclone will do this automatically based on the provider setting.
Oliver Dain
08/15/2023, 8:03 PMOz Katz