yes, set the ssl off and access using path
# helpb
Barak Amar
03/06/2023, 10:44 AM
yes, set the ssl off and access using path
r
Robin Moffatt
03/06/2023, 10:44 AMis that an environment variable to set?
b
Barak Amar
03/06/2023, 10:45 AM
s3_use_ssl=false
Barak Amar
03/06/2023, 10:45 AM
in duckdb
Barak Amar
03/06/2023, 10:45 AM
set s3_url_style='path'
Barak Amar
03/06/2023, 10:46 AM
you may need to set also the region
r
Robin Moffatt
03/06/2023, 10:46 AM Copy code
D SET s3_use_ssl=false;
D select count(*) from read_parquet('<s3://drones03/main/Registations-P107-Active-2017.parquet>');
┌──────────────┐
│ count_star() │
│ int64 │
├──────────────┤
│ 5819 │
└──────────────┘🙌 1
Robin Moffatt
03/06/2023, 10:46 AM💥
Robin Moffatt
03/06/2023, 10:46 AMthanks @Barak Amar!
lakefs 1
Robin Moffatt
03/06/2023, 10:46 AMout of interest, what does setting the region do in the context of the lakeFS S3 gateway?
b
Barak Amar
03/06/2023, 10:49 AM
mainly used as part of signing the request between S3 client and lakefs
r
Robin Moffatt
03/06/2023, 10:49 AMso can it be set to any valid region?
b
Barak Amar
03/06/2023, 10:50 AM
and also as part of the S3 client used to communicate with the underlying storage
Barak Amar
03/06/2023, 10:51 AM
from lakefs to S3 - you need to set the region based on your bucket location
Barak Amar
03/06/2023, 10:51 AM
there is support for multiple regions
r
Robin Moffatt
03/06/2023, 10:51 AMok, thanks
b
Barak Amar
03/06/2023, 10:52 AM
the first part I wrote is the part that is relevant to the S3 gateway
Barak Amar
03/06/2023, 10:53 AM
so it doesn't have any real meaning there, just by the protocol
5 Views