Also curious about disaster recovery. If data gets deleted from the output metadata tables can LakeFS effectively backfill from how the data is stored?

Yap, with lakeFS you could just look at some previous commit that contains that data.

I mean what if the delta lake table itself gets corrupt somehow: https://docs.lakefs.io/integrations/delta.html can lake FS look at the raw binary objects in S3 (the data files) that were added to the lake previously and backfill its metadata tables from that data? or am i misunderstanding

@Callum Dempsey Leach I see Iddo invited you to a meeting. Did you get this answered?

No the meeting isn't till later today