When using the `lakectl import` command to import ...
# help
y
When using the
lakectl import
command to import data, an
import_xxx
file is created in the
/tmp
directory. Is it possible to modify this directory? Importing 2 billion files consumes a significant amount of space. Deploy LakeFS on a Linux physical machine.
o
Hi Which version of lakectl do you use?
y
lakeFS 1.32.1
o
@YUREN WANDER I'm not aware of these files, nor do I see them on my end when uploading. Can you please share more details?
y
lakefs will delete this files, when import data complete。may be you can try a big file. my import command:
Copy code
./lakectl import \
  --from <s3://bc-dw-test/> \
  --to <lakefs://dataset-on-tos/branch-raw-data-tx/>
o
This is not configurable at current. Please open a GitHub issue on this
y
OK, thank you !
lakefs 1