https://lakefs.io/ logo
#help
Title
# help
u

성진영

11/28/2023, 7:58 AM
Hello! Is it possible to import files from Synology NAS without using MinIO or any s3-compatible storage? Our data is stored as json file (in NAS) and cannot change this format due to business issues. NAS is mounted on a CentOS server (
:/mnt
), the same server that lakeFS docker container is operating.
Copy code
sudo docker run \
  -v /mnt:/home/lakefs/ext_data \
  -p 8000:8000 \
  -e LAKEFS_DATABASE_TYPE=postgres \
...
  -e LAKEFS_AUTH_ENCRYPT_SECRET_KEY="lakefs" \
  -e LAKEFS_BLOCKSTORE_TYPE=local \
  -e LAKEFS_BLOCKSTORE_LOCAL_PATH="~/lakefs" \
  -e LAKEFS_BLOCKSTORE_LOCAL_IMPORT_ENABLED=true \
  -e LAKEFS_BLOCKSTORE_LOCAL_ALLOWED_EXTERNAL_PREFIXES="/mnt" \
  treeverse/lakefs:latest run
I can access all files in NAS via docker volume (
:/home/lakefs/ext_data
) but can't figure it out how to import files inside the LakeFS repository.
n

Niro

11/28/2023, 8:28 AM
Hi @성진영, lakeFS communicates with the underlying storage via a compatible S3 interface, therefore the suggested method will not. Can you explain why you can't achieve your task by installing MinIO on your NAS? Objects stores are usually format agnostic - you can store whatever type of file you want
a

Amit Kesarwani

11/28/2023, 9:58 PM
@성진영 For local blockstore, you can enable import from POSIX compliant storage. Add 2 parameters:
import_enabled: true
and
allowed_external_prefixes
, as mentioned here: https://docs.lakefs.io/howto/deploy/onprem.html#local-blockstore
u

성진영

11/28/2023, 11:21 PM
@Niro Our team has no permission to install object store on NAS..:( @Amit Kesarwani thanks for the answer
10 Views