Is there a simple way to get an object count for s...
# help
o
Is there a simple way to get an object count for some branch and path in lakefs?
i
It’s very hack-ish, but would this work?
Copy code
lakectl fs ls lakefs://<repo>/<branch>/<path> --recursive | wc -l
gratitude thank you 1
o
ah of course the lakefs cli. I was trying to use the aws cli 🤦 Thank you for the suggestion
i
NP, I guess you could do the same with aws cli
a
Not sure you will get any better than that -- lakeFS tries to be a lot like S3, and an object store doesn't really do that sort of thing without iterating over everything.
i
On that note. @Oliver Haney - whats the use case for counting number of objects? Maybe we can suggest something else 🙂
jumping lakefs 1
o
I have an ingestion job running to build a vector store index. I use branches to segregate data produced from runs of said ingestion job. I just wanted to compare the number of objects produced in each branch in the same amount of time because I made some improvements to the ingestion process.
i
So the files will be completely different files in each branch - correct?
o
The second branch I created contains the same objects as the first branch and more.
I just wanted to a dirty comparison without updating the code since the job had already been deployed.
I was successful using the lakefs cli
i
right. Comparing in the UI might work as well. THANK YOU!