Looking at the yaml in https://docs.lakefs.io/integrations/glue_metastore.html, I don’t immediately recognize the yaml format. Is this homegrown or defined elsewhere? I kind of expected to see something like https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-table.html

@Dmitriy Ryaboy this yaml file is the table descriptor used by lakeFS for the data catalog exports

Yeah I got that part, what I am asking is if the yaml description is specific to lakefs or one shared with other systems that also end up describing tables for HCat using json or yaml

This is a file that only lakeFS uses. But - it is used by lakeFS to externalize the table for other tools. Which mean that for the Glue exporter for example, you need to explicitly define the schema since there's no actual metadata