https://lakefs.io/ logo
Title
a

Adi Polak

01/16/2023, 12:01 PM
It seems like s3 is still the most important component of any aws cluster based architecture. and so the most expensive part. I wonder if that is related to the fact that many make multiple copies of the data https://twitter.com/dhh/status/1613508201953038337?s=20
m

Mitchell H

01/16/2023, 2:46 PM
I'd like to see a break down of storage costs vs the GET/PUT costs. I've worked with a number of folks that wonder why s3 is so expensive and it comes down to doing 1000s of GETS/PUTs per second
b

Beegee Alop

01/16/2023, 5:26 PM
AWS will punish you for data transfer. If you’re processing engine is not in AWS, you’re in trouble. $0.09GB for non-AWS transfer $0.02GB for other AWS region transfer GET are cheaper than PUT PUT, COPY, POST, or LIST requests $0.005 per 1,000 requests GET, SELECT, and all other requests $0.0004 per 1,000 requests