I'm attempting to use the api to download files from LakeFs (/api/v1/repositories/rep name/refs/main/objects?path/). But I can't seem to download the files. We have folders within the main repo, and each folder contains many part files with.parquet extensions. I can download each part file by specifying the file name (for example, api/v1/repositories/rep name/refs/main/objects?path/part filename.parquet). But I'd like to download all of the files in the folder. Could you assist me with this request? Is there anything I missed in the API call?
09/27/2022, 9:19 AM
Hi @venkadesan elangovan, the API is very similar to other object stores. It enables a single object read. Each request enables reading the data of the requested object. Application level code usually will have to code serial or parallel reading of the objects.
Application level code will usually perform listing and download of each object.