Hello, I've touched upon this in <#C02CV7MUV4G|>, ...
# help
s
Hello, I've touched upon this in #C02CV7MUV4G, but has anyone ever implemented lakefs with GBQ? We're directly streaming data into GBQ using a Stitch ELT pipeline (see my conversatin with @Barak Amar https://lakefs.slack.com/archives/C02CV7MUV4G/p1648836947359049). I'm new to GBQ and LakeFS, but can't seem to find where the GBQ data is actually hosted (and therefore where I can add the LakeFS layer). Any suggestions?
l
As I'm also new to GBQ, I tried to find some information regarding this and found some articles that may be relevant (sorry if I'm stating the obvious): https://panoply.io/data-warehouse-guide/bigquery-architecture/ https://medium.com/google-cloud/bigquery-explained-overview-357055ecfda3 If I'll manage to gain some more knowledge about it I'll let you know. And of course if anyone has some experience or information about it we'd love to hear more 🙂
s
Yeah these articles seem to describe my fear; GBQ does not seem to be hosted inside a bucket, and therefore I wouldn't be able to install lakefs over it