Title
#dev
Ariel Shaqed (Scolnicov)

Ariel Shaqed (Scolnicov)

09/22/2022, 9:17 AM
To recap: I'm seeing reasonable speeds for writing 4000 partitions from Spark, but as soon as I switch SaveMode over to overwrite things are slow again. Can we count DeleteObjects operations and their paths, to see how overwrite deletes the old data?