Hi, i'm looking into the glue catalog exporter, so...
# help
j
Hi, i'm looking into the glue catalog exporter, so that the data we store in lakefs can be queried by athena. I get everything that's happening. I have one question. In the docs here: https://docs.lakefs.io/integrations/glue_metastore.html in the "Configure Action Hooks" section, the yaml files you specify seemingly have the aws keys hard coded in the yaml file. How would we read those values at runtime, say from secrets manager , at runtime so we don't have to hardcocde them in the repo itself?
o
Hi Joe Settings can be changed to be read from secret rather than be exposed in yaml file.
a
There is no current support for secrets in lakeFS. It is a roadmap item. For a small self-hosted installation, I would probably store secrets in environment variables on the lakeFS instance. For a large self-hosted installation, I would personally probably run my hooks on a separate web server, and handle secrets over there. 🙂