Hi all!! I'm comparing tools and would like to know what kind of files I can track with LakeFS??... CSV, parquet, excel..?
i
Iddo Avneri
11/04/2022, 3:00 PM
Hi @David García , lakeFS is format agnostic
So any files 🙂
o
Or Tzabary
11/04/2022, 3:00 PM
Hey David 👋
lakeFS is working on the object level, so it supports any file you store in your object store.
It provides sort of proxy to your object store, with additional features like versioning, reproducibility, isolation, etc
Mind sharing your use case?
d
David García
11/04/2022, 3:51 PM
I'm working with GCP suit to process data that is coming from Pharmaceutical plants, like sensors but also laboratory tests and we are interesting to track changes in such data.
Sorry, another question, what is the maximum size of a file to be tracked?
o
Or Tzabary
11/04/2022, 3:55 PM
There's no real limit for lakeFS, there are practices following the type of usage
The limit is driven from the object store hosting your files (i.e Google Storage, AWS S3, etc)
Also, the usage pattern might impact the sizing