James Daus
10/04/2023, 6:31 PMcommon_prefix
, but upon import an additional "file" with the same name as every folder is created (see below). When we try to run df = sedona.read.parquet(lakefspath)
we are met with this error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 75.0 failed 4 times, most recent failure: Lost task 0.3 in stage 75.0: org.apache.spark.SparkException: Exception thrown in awaitResult: [CANNOT_READ_FILE_FOOTER] Could not read footer for file: <lakefs://test/testrepo1/providerfeeds/places1/theme=places1>
Amit Kesarwani
10/04/2023, 7:13 PMJames Daus
10/04/2023, 8:01 PMAmit Kesarwani
10/04/2023, 8:25 PMJames Daus
10/04/2023, 8:43 PMAmit Kesarwani
10/04/2023, 8:52 PMNiro
10/05/2023, 7:46 AMJames Daus
10/05/2023, 11:09 PMAmit Kesarwani
10/05/2023, 11:16 PM