Channels
announcements
blockers_for_windward
career-opportunities
celebrations
cuddle-corner
data-discussion
data-events
dev
events
general
help
iceberg-integration
lakefs-for-beginners
lakefs-hubspot-cloud-registration-email-automation
lakefs-releases
lakefs-suggestions
lakefs-twitter
linen-dev
memes-and-banter
say-hello
stackoverflow
test
Title
t
tgosselin
01/20/2022, 1:56 PMHello all, I'm a data engineer for a small CRO specializing in medical imaging analysis. I have been following the developments of LakeFS for some time now and like what I have been seeing (have run through the Quickstart a few times). I am currently in the process of evaluating tools to enable data versioning and data provenance record keeping via S3 native storage and was hoping to have a few questions answered.
o
Oz Katz
01/20/2022, 2:15 PMHi @tgosselin! Welcome to the community 🙂 feel free to engage on #help or #beginner-questions - we'd love to assist!
From what you've described lakeFS could be a good fit here:
it doesn't assume anything about the data or format so great for imaging and unstructured data.
The lakeFS server supports the S3 protocol (and S3 as underlying storage) and supports commits that can carry arbitrary metadata, which can be very useful for provenance