I'm trying to clone a repo to a new repo, but alre...
# help
i
I'm trying to clone a repo to a new repo, but already having issues at step 2. Lakectl refs-dump is not creating manifest file in the _lakefs folder..
i
Hey @Ion, can you send the steps you’re following? Also, does
refs-dump
return successfully? Can you copy the command and the output here?
i
I have lakectl installed on my laptop. Then I do lakectl config, then lakectl refs-dump Lakefs://silver This returns the Json values in the command line but does not store the file in the remote object store
i
It’s supposed to be stored under the storage namespace with
_lakefs/
prefix. So if the storage namespace is
<s3://bucket/path>
, then the objects would be in
<s3://bucket/path/_lakefs/>
i
Yes it's not showing up there
I'm using azure btw
The guide looks incorrect, I can save the manifest or I can chain it to stdin and then do lakectl refs-restore
i
I was able to get the dump files written with Azure blob store
i
Can you share the exact cmd you ran?
i
Why does the guide look incorrect? The restore needs that json, whether it’s chain from the dump or loaded from a saved file
lakectl refs-dump <lakefs://first-test>
i
Strange it doesn't save anything to my blob with that
i
Do you get the json output?
i
I do, I saved it in a local file for now
Does the Lakefs access key require any access here?
i
Not sure I understand the question
i
Lakectl is using a Lakefs access key
Does that access require some minimum level of privileges here?
i
If you get the json, it means the command ran successfully
i
Yes but why is it not saving it in azure😄
i
Can you do
lakectl repo list
and share the output?
The objects should be in the repo matching storage namespace
i
I can't, I cannot open slack on my work laptop
👍 1
i
What’s your version of lakefs/lakectl?
i
Lakefs 1.13
Lakectl 1.14.1
i
Do you see anything from the lakeFS logs?
i
Nope, no error msg
i
Do you see any object in your storage namespace under
_lakefs/
prefix?
i
Yes it contains 2000 objects
All hash named files with no extension
i
And none of them match any of the 3 objects in the json, right?
i
Well I haven't opened any of them one by one
I assume it should be saved as a human readable filename
i
No.. the strings provided in the json should be in that path
Those 3 objects contain all the information of branches, commits and tags. What did you expect to see?
i
Ah I see what you mean
Yeah they exist
i
So the refs-dump was successful
i
Then the guide is giving a wrong statement
'by creating a refs_manifest.json file inside _lakefs folder'
This has not happened
i
Can you send me a link to the guide?
Step 2
Outside of that odd instruction it works really nice, the clone and import
i
Thanks for the feedback, we’ll fix the blog post