I guess I figured out why, the paths are re-export...
# helpi
Ion
05/07/2024, 1:04 PMI guess I figured out why, the paths are re-exported as https instead of abfss paths🤨
n
Niro
05/07/2024, 1:08 PMUnfortunately Databricks does not recognize https scheme as a valid URL for Azure external location.
j
Jonathan Rosenberg
05/07/2024, 1:08 PMwhat lakeFS version are you using?
i
Ion
05/07/2024, 1:09 PM1.13
j
Jonathan Rosenberg
05/07/2024, 1:10 PMThis is a bug that was fixed in 1.14
i
Ion
05/07/2024, 1:10 PMAii
j
Jonathan Rosenberg
05/07/2024, 1:10 PMi
Ion
05/07/2024, 1:11 PMAnd what do I exactly pass than to the exporter, because I already passed azure.abfss_transform_path
j
Jonathan Rosenberg
05/07/2024, 1:17 PMNow it actually has a 6th parameter that it will use to convert the paths
Jonathan Rosenberg
05/07/2024, 1:17 PMso pass the same thing
i
Ion
05/07/2024, 1:18 PMI already passed that, but it didn't complain about the extra arg
j
Jonathan Rosenberg
05/07/2024, 1:19 PMLua ignores extra arguments
i
Ion
05/07/2024, 1:22 PMInteresting language 😄
j
Jonathan Rosenberg
05/07/2024, 1:25 PMJS is no different 🙂
i
Ion
05/07/2024, 1:30 PMI would trip to fast with these languages 😆
😂 1
Ion
05/07/2024, 2:45 PM@Niro @Jonathan Rosenberg export works btw now :)
Still having an issue. It's throwing errors that account key is incorrect in databricks when reading one of the parquets, but it only happens on the Lakefs exported tables :S