Sebastian Haugg
04/25/2024, 12:39 PMwith open(filename, "r+b") as f:
with self.branch_data.object(path=self._string_builder()).writer( mode="wb", metadata=meta_data) as writer:
writer.write(f.read())
The dict is converted to type str:str beforehandNiro
04/25/2024, 12:44 PMSebastian Haugg
04/25/2024, 12:46 PMNiro
04/25/2024, 12:58 PMNiro
04/25/2024, 12:59 PMSebastian Haugg
04/25/2024, 1:06 PMElad Lachmi
04/25/2024, 1:25 PMmeta_data
before calling writer.write
and post it here?Sebastian Haugg
04/25/2024, 3:01 PM{'Preprocessor': 'CDE', 'scaling_period': '35', 'n_target_days': '1', 'replace_zeros': 'True', 'remove_density': '0.01'}
Output after calling the context manager(just to be sure): {'Preprocessor': 'CDE', 'scaling_period': '35', 'n_target_days': '1', 'replace_zeros': 'True', 'remove_density': '0.01'}
Niro
04/26/2024, 8:16 AMNiro
04/26/2024, 8:16 AMSebastian Haugg
04/26/2024, 10:21 AM{'path': 'gold/<customer>/File-Full.parquet', 'physical_address': 's3://<repo>/data/<uuid>/<uuid>', 'physical_address_expiry': None, 'checksum': 'abc123a068516cc2fcdd11bfff789xyz', 'size_bytes': 134440782, 'mtime': 1714126066, 'metadata': {'preprocessor': 'CDE'}, 'content_type': 'application/octet-stream'}
, which I redacted a little bit because of the policy at my company.Niro
04/26/2024, 10:50 AMSebastian Haugg
04/26/2024, 11:10 AMNiro
04/26/2024, 11:11 AM