https://lakefs.io/ logo
Title
b

Barak Amar

03/06/2023, 10:44 AM
yes, set the ssl off and access using path
r

Robin Moffatt

03/06/2023, 10:44 AM
is that an environment variable to set?
b

Barak Amar

03/06/2023, 10:45 AM
s3_use_ssl=false
in duckdb
set s3_url_style='path'
you may need to set also the region
r

Robin Moffatt

03/06/2023, 10:46 AM
D SET s3_use_ssl=false;
D select count(*) from read_parquet('<s3://drones03/main/Registations-P107-Active-2017.parquet>');
┌──────────────┐
│ count_star() │
│    int64     │
├──────────────┤
│         5819 │
└──────────────┘
🙌 1
💥
thanks @Barak Amar!
:lakefs: 1
out of interest, what does setting the region do in the context of the lakeFS S3 gateway?
b

Barak Amar

03/06/2023, 10:49 AM
mainly used as part of signing the request between S3 client and lakefs
r

Robin Moffatt

03/06/2023, 10:49 AM
so can it be set to any valid region?
b

Barak Amar

03/06/2023, 10:50 AM
and also as part of the S3 client used to communicate with the underlying storage
from lakefs to S3 - you need to set the region based on your bucket location
there is support for multiple regions
r

Robin Moffatt

03/06/2023, 10:51 AM
ok, thanks
b

Barak Amar

03/06/2023, 10:52 AM
the first part I wrote is the part that is relevant to the S3 gateway
so it doesn't have any real meaning there, just by the protocol