• Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    4 months ago
    I'm trying to use the Python auto-generated API (
    lakefs_client~=0.41.0
    ) to upload to lakeFS. Since I don't have a file, I want to use a Pythonic IO. But I get:
    Traceback (most recent call last):
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_provider/operators/upload_operator.py", line 50, in execute
        ref = hook.upload(self.repo, self.branch, self.path, self.content)
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_provider/hooks/lakefs_hook.py", line 62, in upload
        upload = client.objects.upload_object(
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_client/api_client.py", line 772, in __call__
        return self.callable(self, *args, **kwargs)
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_client/api/objects_api.py", line 990, in __upload_object
        return self.call_with_http_info(**kwargs)
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_client/api_client.py", line 834, in call_with_http_info
        return self.api_client.call_api(
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_client/api_client.py", line 409, in call_api
        return self.__call_api(resource_path, method,
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_client/api_client.py", line 174, in __call_api
        post_params.extend(self.files_parameters(files))
      File "/home/ariels/dev/airflow-provider-lakeFS/env/lib/python3.10/site-packages/lakefs_client/api_client.py", line 551, in files_parameters
        filename = os.path.basename(file_instance.name)
    AttributeError: '_io.StringIO' object has no attribute 'name'
    Any idea why it wants to know the name of a file, when I am anyway specifying the desired destination name? And: is there anything other than a file that I could pass it?
    Ariel Shaqed (Scolnicov)
    n
    5 replies
    Copy to Clipboard
  • Barak Amar

    Barak Amar

    3 months ago
    Wanted to share the part of our road, working on decouple ref-store from PostgreSQL, we split the work into 3 milestones and we completed the first milestone.
    Barak Amar
    1 replies
    Copy to Clipboard
  • Oz Katz

    Oz Katz

    3 months ago
    Not really sure yet what this means yet, but it just might pave a great way to integrate lakeFS with Snowflake! Given that lakeFS supports the S3 Protocol, this seems like a very interesting first step towards a big roadmap item 🙂 https://www.linkedin.com/posts/jamesamalone_github-snowflakedbsnowflake-s3compat-api-[…]3612148736-9zk5?utm_source=linkedin_share&utm_medium=ios_app
    Oz Katz
    1 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    3 months ago
    Preparing to release airflow-provider-lakefs version 0.43.0. Block the PR if you need something more in it.
    Ariel Shaqed (Scolnicov)
    1 replies
    Copy to Clipboard
  • Lynn Rozen

    Lynn Rozen

    3 months ago
    Hi all, Did someone run into a failed
    license/cla
    check in a PR? This is the first time it fails, and I tried to sign the cla again..
    Lynn Rozen
    1 replies
    Copy to Clipboard
  • Itai David

    Itai David

    3 months ago
    Hi. Was doing some code traversal and got into
    pkg/onboard
    , which I must admit I'm not familiar with. What is it used for?
    Itai David
    Itai Admi
    2 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    Hi devs, With all the auth changes going around, I kind-of lost track of the difference between Username and Email on the User model, with respect to "userID" parameters. • What do I pass to auth.Service.Authorize: user.Username? • What do I pass to auth.Service.CreateCredentials: user.Username (of the user for whom I'm creating credentials)? THANKS!
    Ariel Shaqed (Scolnicov)
    Yoni Augarten
    11 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    Any Swaggerers in the crowd? (Well, OK, OpenAPIcians...) I want to specify an OpenAPI endpoint that returns some arbitrary content type (it might be text/plain, or text/html, or application/json, or application/binary, or really anything). How do I specify that in our swagger.yml file?
    Ariel Shaqed (Scolnicov)
    1 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    I'm getting 2 integration test failures. I believe that they are unrelated to the added code, which is not exercised by any integration tests. Is this expected? --------------------------------------------------------- Annotations 2 errors *Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage* Process completed with exit code 137. *lakeFS migrate with KV* Process completed with exit code 1.
    Ariel Shaqed (Scolnicov)
    Itai Admi
    +1
    4 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    2 months ago
    Repost for Go people (thanks to @Barak Amar, who showed me this!): The Laws of Reflection.
    Ariel Shaqed (Scolnicov)
    1 replies
    Copy to Clipboard