ah perfect, this is exactly what I was missing. Adding the --path then will be fast operation, and when doing so the original table stay untouched.

Hey @Nicola Corda, I'm afraid I mislead you - I'm very sorry about that. We currently do not support an incremental

create-symlink

command. The supplied path has to be the path to the table. Running the command will write the table from the start with all the up-to-date partitions. I will open an issue for this and update here.

I can also create a symslink and register the new partitions manually to the table that I use in my glue catalog

Or does the symslink recreate the table in glue as well?

Hi @Nicola Corda! I’m looking into your suggestion and will get back to you asap :)

@Nicola Corda if you create a symlink and register the partitions manually to the table this should work, but we haven’t tested it yet. Can you please share the steps that you thought of taking to do that, and the commands you are planning to use?

@Tal Sofer sure, I didn’t run anything yet. I’m consuming docs to see if we can use lakefs with our current setup:)