Yaphet Kebede02/02/2023, 8:53 PM
Vino02/02/2023, 9:02 PM
? Would you mind sharing how you configured that?
root temp dir configured on the client object
Yaphet Kebede02/02/2023, 9:22 PM
here's my client init, i set
def init_client(lakefs_conf_path): logger.debug('initializing ') configuration = lakefs_client.Configuration() configuration.temp_folder_path = os.path.join(os.path.dirname(os.path.abspath(__file__)), 'data') with open(lakefs_conf_path) as stream: config_raw = yaml.load(stream, Loader=yaml.FullLoader) configuration.username = config_raw["credentials"]["access_key_id"] configuration.password = config_raw["credentials"]["secret_access_key"] configuration.host = config_raw["server"]["endpoint_url"] the_lake = LakeFsWrapper(configuration=configuration) return the_lake
as the correct path which is great, I can see the files being downloaded there when i make a call like
configuration.temp_folder_path = os.path.join(os.path.dirname(os.path.abspath(__file__)), 'data')
but what i wanted to do was say i have
# path is lakefs location self._client.objects.get_object(repository=repository, ref=branch, path=location)
on lake fs , and wanted to download it to a local
wouldn't let me as it would just dump
Vino02/02/2023, 9:42 PM
work with a single file at a time. You'd have to iterate over the files under a specific lakeFS path and create required subdirectories in your local storage to achieve what you are looking for.