hi folks i am back with another question.I am trying to implement multi part uploading usingmanta custom adapter (https://apidocs.joyent.com/manta/api.html) .Manta creates upload id similar to this

e1565962-d5b6-43ff-83f6-63dfeab21a83

and while trying to upload by running something like this

aws --endpoint-url <http://s3.local.lakefs.io:8000> s3api upload-part --bucket demo1 --key main/large_test_file --part-number 1 --body temp_10MB_file --upload-id e1565962-d5b6-43ff-83f6-63dfeab21a83 --content-md5 exampleaAmjr+4sRXUwf0w==

ends up with this error

ERROR  [2021-06-25T22:15:50+05:30]pkg/gateway/operations/putobject.go:168 pkg/gateway/operations.handleUploadPart part 1 upload failed                          error="invalid upload id format: encoding/hex: invalid byte: U+002D '-'" host="<http://s3.local.lakefs.io:8000|s3.local.lakefs.io:8000>" method=PUT part_number=1 path=large_test_file ref=main repository=demo1 request_id=af90d942-20ee-42d8-aed8-098191675364 service_name=s3_gateway upload_id=e1565962-d5b6-43ff-83f6-63dfeab21a83 user=admin

is this by design? or is there a way i can work around this issue ?

Hey @sumesh kanayi - the ID returned by the object store cannot be used directly, it'll have to be translated to an ID that is compatible with the S3 formatting. See an example here: https://github.com/treeverse/lakeFS/blob/master/pkg/block/s3/adapter.go#L66

nice ..thanks for this @Oz Katz ..