Hi, i am new to lakefs. I have installed lakefs using helm, and it’s running. But when I try importing data from s3, it gives me an error.

./lakectl import \
  --from <s3://test.csv/> \
  --to <lakefs://repo/branch/>

I want to achieve this using juypter notebook python.

S3 bucket name is missing. Checkout this Python example: https://github.com/treeverse/lakeFS-samples/blob/main/00_notebooks/import-multiple-buckets.ipynb You can run this example in Docker environment: https://github.com/treeverse/lakeFS-samples/tree/main

Hi, thank you. it worked. can you even help me on how can i upload data back to lakefs. after i have created a branch from main. can you send me a similar link for uploading data as well. its really helpful. @Amit Kesarwani

Hi @Cartick Can you please elaborate on your scenario of upload data back to lakeFS after import?

i have imported data from s3 to my "main" branch, then i created a new branch"processed-data" from my "main" branch. now on my local notebook using python, i have transformed the same data file. i want to get that data file in my "processed-data" branch so that i can have a version of it.

Search for

upload

in this sample notebook: https://github.com/treeverse/lakeFS-samples/blob/main/00_notebooks/data-lineage.ipynb

thank you, everything works now.