Ariel Shaqed (Scolnicov)

01/04/2023, 5:42 AM
Nice piece about the state of Iceberg.
👍 2

Adi Polak

01/04/2023, 7:10 AM
"The result is a reduction in the cost of moving data, and improved throughput and performance"
Separating compute from storage will enable more compute engines to execute on the data, a big difference between a classic data warehouse and a data lake + compute approach. That requirement created a very challenging motion of moving from a data warehouse to data lakes - e.g., S3. AND after folks have already moved to S3, managing duplicates/versions of data is the next challenge. I wonder where people are on this journey...