Hi all!! I'm comparing tools and would like to know what kind of files I can track with LakeFS??... CSV, parquet, excel..?
u
user
11/04/2022, 3:00 PM
Hi @David GarcĂa , lakeFS is format agnostic
u
user
11/04/2022, 3:00 PM
So any files 🙂
u
user
11/04/2022, 3:00 PM
Hey David đź‘‹
lakeFS is working on the object level, so it supports any file you store in your object store.
It provides sort of proxy to your object store, with additional features like versioning, reproducibility, isolation, etc
u
user
11/04/2022, 3:01 PM
Mind sharing your use case?
u
user
11/04/2022, 3:51 PM
I'm working with GCP suit to process data that is coming from Pharmaceutical plants, like sensors but also laboratory tests and we are interesting to track changes in such data.
u
user
11/04/2022, 3:52 PM
Sorry, another question, what is the maximum size of a file to be tracked?
u
user
11/04/2022, 3:55 PM
There's no real limit for lakeFS, there are practices following the type of usage
The limit is driven from the object store hosting your files (i.e Google Storage, AWS S3, etc)
Also, the usage pattern might impact the sizing