01/20/2022, 1:56 PM
Hello all, I'm a data engineer for a small CRO specializing in medical imaging analysis. I have been following the developments of LakeFS for some time now and like what I have been seeing (have run through the Quickstart a few times). I am currently in the process of evaluating tools to enable data versioning and data provenance record keeping via S3 native storage and was hoping to have a few questions answered.

Oz Katz

01/20/2022, 2:15 PM
Hi @tgosselin! Welcome to the community 🙂 feel free to engage on #help or #beginner-questions - we'd love to assist!
From what you've described lakeFS could be a good fit here: it doesn't assume anything about the data or format so great for imaging and unstructured data. The lakeFS server supports the S3 protocol (and S3 as underlying storage) and supports commits that can carry arbitrary metadata, which can be very useful for provenance