I'm unfamiliar with the k8s parts of that stack, I...
# helpa
Ariel Shaqed (Scolnicov)
12/02/2020, 8:16 PMI'm unfamiliar with the k8s parts of that stack, I'll ask around tomorrow. Is there a description somewhere if the steps fluxcd takes when deploying a new version? I'd like to stick something on before it starts the new version, obviously.
t
T. P.
12/02/2020, 10:00 PMfluxcd basically has a CR in k8s
T. P.
12/02/2020, 10:00 PMHelmRelease
T. P.
12/02/2020, 10:00 PMit does a rolling update
T. P.
12/02/2020, 10:01 PMso tries to spin up new pods for new lakefs version
T. P.
12/02/2020, 10:01 PMbefore shutting down older version pods
T. P.
12/02/2020, 10:01 PMwe face similar migration issues many times earlier (with other apps)
T. P.
12/02/2020, 10:01 PMlakefs container needs to auto run the migration on detecting older schema version in DB
T. P.
12/02/2020, 10:02 PMotherwise the new pod will always fail and new version deployment of lakefs will fail
T. P.
12/02/2020, 10:03 PMhope this helps
T. P.
12/02/2020, 10:03 PMfluxcd: https://fluxcd.io/
a
Ariel Shaqed (Scolnicov)
12/02/2020, 10:09 PMOK, thanks!
I figured as much. We could probably add a flag to migrate on startup. IIUC that would work for you. But note that I think rollback might not always be possible without losing some metadata.
(I would not want this behaviour always - in less CD deployments there is greater risk, e.g. if one runs a wrong version in error.)
Ariel Shaqed (Scolnicov)
12/02/2020, 10:10 PMI'll set if I can get you a PR to do that tomorrow.
Ariel Shaqed (Scolnicov)
12/02/2020, 10:19 PMActually, it's possible in one direction (upgrade) but not in the other (downgrade). You'd need an explicit step using the up to date version (which knows what to remove to change back) being told what the less recent version that is being installed needs.
So I'll do it, but it's always going to be a ratchet - you can go up but not down like this.
t
T. P.
12/03/2020, 10:12 AMunderstood
y
Yoni Augarten
12/03/2020, 1:03 PMHey @T. P., published a new version (0.4.7) of the Helm chart, which runs the migrations automatically on upgrade. Let me know how it works
t
T. P.
12/03/2020, 2:20 PMgreat, will test out today and provide feedback, thanks
👍🏻 2