Title
#help
Yoni Augarten

Yoni Augarten

10/04/2022, 2:30 PM
Hey @Nick Hryhoriev(AF)! You can configure the amount of space lakeFS uses for cache. I'll look it up in the docs, one sec please
Nick Hryhoriev(AF)

Nick Hryhoriev(AF)

10/04/2022, 2:31 PM
ANd by default it’s do not have limit?
Yoni Augarten

Yoni Augarten

10/04/2022, 2:35 PM
The default value is 1GB. You can change the value using the
committed.local_cache.size_bytes
configuration.
2:37 PM
For example, if you're using a yaml configuration file to configure lakeFS, add the following to limit the cache to 256MB:
committed:
  local_cache:
    size_bytes: 268435456
Oz Katz

Oz Katz

10/04/2022, 2:41 PM
we should probably open an issue on this: it’s a good idea to validate that the cache size doesn’t exceed the size of the target device (and perhaps warn if current free space < cache size?)
Nick Hryhoriev(AF)

Nick Hryhoriev(AF)

10/04/2022, 2:42 PM
hm… BUt I definetly have more than 1 gb
Oz Katz

Oz Katz

10/04/2022, 2:47 PM
any idea what the current size of the cache directory is? are you running inside a container? if so, the limit would be the volume used by e.g. docker when spinning up the container
Nick Hryhoriev(AF)

Nick Hryhoriev(AF)

10/04/2022, 2:56 PM
I am running on ec2 instance and the value is default on
Yoni Augarten

Yoni Augarten

10/04/2022, 2:56 PM
Thanks @Nick Hryhoriev(AF). Can you check how much space the
/home/lakefs/data/lakefs/cache/
directory takes? (
du -sh /home/lakefs/data/lakefs/cache/
)
Nick Hryhoriev(AF)

Nick Hryhoriev(AF)

10/04/2022, 2:57 PM
Yep, give me some time.
3:06 PM
I am sorry I can’t. Something wrong with my SSM config
Your session has been terminated for the following reasons: Plugin with name Standard_Stream not found. Step name: Standard_Stream
I will recreate instance with correct config or my ssh keys and come back to you, later.
Yoni Augarten

Yoni Augarten

10/04/2022, 3:09 PM
Thanks for the update, @Nick Hryhoriev(AF). Looking forward to your update
Barak Amar

Barak Amar

10/04/2022, 5:07 PM
In case you are running using docker inside ec2 -
docker ps --size
should give you how much size the container takes. Alt. will be
docker system df
to understand how much we use from the host.