• Edmondo Porcu

    Edmondo Porcu

    6 months ago
    Does anyone understand why tests are not run automatically on a new commit on a Pull request ? It says "Waiting reporting of status check" or something similar on each check. It would be handy if one could just click and jump to the workflow execution instead
    Edmondo Porcu
    Barak Amar
    20 replies
    Copy to Clipboard
  • einat.orr

    einat.orr

    5 months ago
    Is this a hint that lakeFS might be able to work with BigQuery out of the box? https://hevodata.com/learn/federated-query-bigquery/#w
    einat.orr
    Oz Katz
    +1
    3 replies
    Copy to Clipboard
  • Edmondo Porcu

    Edmondo Porcu

    5 months ago
    Has someone developed pre-commit hooks for lakeFS? I am doing a couple of self-inflicted push-ups because I committed and pushed without linting locally 😞
    Edmondo Porcu
    1 replies
    Copy to Clipboard
  • Tal Sofer

    Tal Sofer

    5 months ago
    Hi, I created my own lakeFS policy and am trying to attach it to a lakeFS user. However, the UI only allow me attach pre-configured policies. am I missing something or this is a bug? I’m able to attach the policy with
    lakectl auth users policies attach -id my_user --policy myPolicy
    Tal Sofer
    Barak Amar
    16 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    5 months ago
    @Jonathan Rosenberg can we pull https://github.com/treeverse/lakeFS/pull/3159 soon so that I can rebase and test https://github.com/treeverse/lakeFS/pull/3183?
    Ariel Shaqed (Scolnicov)
    1 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    5 months ago
    I'm having difficulty compiling
    spark/client
    ; I get (during update):
    [error] file:///home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.9.0/jackson-annotations-2.9.0.jar: not found: /home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.9.0/jackson-annotations-2.9.0.jar
    [error] file:///home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.3/jackson-annotations-2.10.3.jar: not found: /home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.3/jackson-annotations-2.10.3.jar
    [error] file:///home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.9.5/jackson-databind-2.9.5.jar: not found: /home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.9.5/jackson-databind-2.9.5.jar
    [error] (lakefs-spark-client-247 / update) lmcoursier.internal.shaded.coursier.error.FetchError$DownloadingArtifacts: Error fetching artifacts:
    [error] file:///home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.9.0/jackson-annotations-2.9.0.jar: not found: /home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.9.0/jackson-annotations-2.9.0.jar
    [error] file:///home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.3/jackson-annotations-2.10.3.jar: not found: /home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.3/jackson-annotations-2.10.3.jar
    [error] file:///home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.9.5/jackson-databind-2.9.5.jar: not found: /home/ariels/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.9.5/jackson-databind-2.9.5.jar
    Does
    sbt compile
    in
    client/spark
    work for anyone? Does it stlll work after
    sbt clean
    ?
    Ariel Shaqed (Scolnicov)
    Tal Sofer
    4 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    5 months ago
    Another retention question: the file
    _lakefs/retention/gc/rules/config.json
    is not a JSON file. What format is it? protobuf?? Here's a hexdump of one that I have right now:
    00000000  08 05 12 08 0a 04 6d 61  69 6e 10 06              |......main..|
    Ariel Shaqed (Scolnicov)
    Barak Amar
    4 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    5 months ago
    ❯ ~/dev/lakeFS/lakectl fs stat <lakefs://ariels-gc-test/main~1/a/moo>
    Invalid 'path': not a valid path uri
    Error executing command.
    Did something change in the refs parser, or am I too tired?
    Ariel Shaqed (Scolnicov)
    Yoni Augarten
    2 replies
    Copy to Clipboard
  • Yoni Augarten

    Yoni Augarten

    5 months ago
    Hey, EMR question - asked it on Stackoverflow as well: In an EMR cluster, I run multiple Spark steps. Steps may or may not have the same name. I want to monitor the number of failed steps, grouped by the step name. EMR triggers EventBridge events for a step status change, but I want numbers: the goal is to trigger an alarm if more than (say) 5 steps with the same name failed within (say) the last hour. Was hoping to get a Cloudwatch metric counting failed steps, with a dimension of the step name. Can I achieve that?
    Yoni Augarten
    Oz Katz
    2 replies
    Copy to Clipboard
  • Yoni Augarten

    Yoni Augarten

    5 months ago
    I'm about to release a new lakeFS version! Are there any objections? (waiting for @Tal Sofer to merge #3223)
    Yoni Augarten
    1 replies
    Copy to Clipboard