Working on <issue#2629>, trying to figure out what...
# dev
i
Working on issue#2629, trying to figure out what are the FileSystem calls being made to lakeFSFS and what are the calls it does to the underlying s3a FS. I’ve configured the following in
/usr/lib/hadoop/etc/hadoop/log4j.properties
file:
Copy code
log4j.appender.A1=org.apache.log4j.ConsoleAppender
log4j.appender.A1.layout=org.apache.log4j.PatternLayout
log4j.appender.A1.layout.ConversionPattern=%-4r [%t] %-5p %c %x - %m%n
log4j.logger.io.lakefs=TRACE, A1
But I still can’t see the TRACE logs in my stdout. @Tal Sofer @Ariel Shaqed (Scolnicov) @Barak Amar how should I configure the logs?
a
Maybe https://github.com/treeverse/dev/blob/main/pages/databricks/troubleshooting-spark-applications.md#changing-application-log-level for inspiration (Sorry, internal link, not sure all information there can be shared.)
1