Is this a hint that lakeFS might be able to work w...
# deve
einat.orr
03/30/2022, 3:58 PM
Is this a hint that lakeFS might be able to work with BigQuery out of the box? https://hevodata.com/learn/federated-query-bigquery/#w
👀 1
o
Oz Katz
03/30/2022, 5:20 PM
Probably not out of the box 🙂 but perhaps this paves a way
👍 1
e
Edmondo Porcu
03/30/2022, 8:16 PMOut of the box seems to me "unrealistic", although I just submitted my first PR a couple of days ago 🙂
heart lakefs 5
Edmondo Porcu
03/30/2022, 8:18 PMI imagine that to implement de-duplication, LakeFS must be adopting some form of content addressable storage, while maintaining an index that allows going from "commit + file name" to its physical location on an object storage.
There's a way, maybe, this "book index" can be exposed in ways that one can consume it from BigQuery, Athena, Presto, etc?
8 Views