<!here> I'm beginner to LakeFS and have done initi...
# dev
s
<!here> I'm beginner to LakeFS and have done initial hosting on top AWS EKS cluster. Now I have a question related to implementation. Can we do some sort of user activity monitoring (user details, sessions etc)when lakefs is running onto an EKS cluster? If so how can we achieve that?
o
hey @Souvik, welcome! what exactly are you trying to achieve? if you turn logging.level to DEBUG it should log every user request including user id to the log. additionally you can set logging.format to json to get structured logs that you can then ship to ELK/clodwatch logs/loggly/other logging provider, so you could filter it, create auditing dashboard, etc. does that answer your question? for reference, you can find the logging configuration here: https://docs.lakefs.io/reference/configuration.html
s
Thanks @Oz Katz for addressing this. I am basically more interested to get user details , Users' active sessions / how long the users are active in lakefs session and what operation they are doing. I got an impression that lakefs will log every user request. Can you assist me on integrating and mapping the logs to cloudwatch?
o
Getting user's details is possible by using the API or CLI (see e.g. https://docs.lakefs.io/reference/commands.html#lakectl-auth-users-list) As for cloudwatch, it really depends on your setup. For example see this post from AWS' blog: https://aws.amazon.com/blogs/containers/how-to-capture-application-logs-when-using-amazon-eks-on-aws-fargate/
s
ok. so there is no possible way to monitor Users' active sessions / how long the users are active in lakefs?
o
you can, but you’d have to collect that information from the logs and analyze it yourself. it’s an interesting requirement though - would be happy to hear more about what information would be valuable for you and why 🙂