• Tal Sofer

    Tal Sofer

    5 months ago
    A question about the UI build - Why sometimes we need to explicitly do
    npm install
    to build the UI after a new node module is added? I mean, looking at the Makefile I expect the following to happen on
    make build
    - make build -> gen > gen-ui -> ui-build -> $(UI_DIR)/node_modules (that does npm install)
    Tal Sofer
    Barak Amar
    +1
    7 replies
    Copy to Clipboard
  • f

    Felix

    5 months ago
    Good Morning, is the Helm Chart still under active development? The latest PRs only bump chart versions. I opened an issue last week. The problem is that the chart uses an outdated ingress api version, so we are currently not able to deploy the chart. I would contribute this, but so far I didn’t get any reaction if PRs are wanted (ftr: https://github.com/treeverse/charts/issues/115)
    f
    Barak Amar
    11 replies
    Copy to Clipboard
  • n

    Niro

    4 months ago
    Hi - I have small question: I created a database using BuildDatabaseConnection and was wondering if its OK to use it concurrently in several goroutines or should each goroutine create its own database connection
    n
    Barak Amar
    2 replies
    Copy to Clipboard
  • Oz Katz

    Oz Katz

    4 months ago
    Question about the Spark OutputCommitter proposal 🙂 I acknowledge that this might be a dumb question - but does it really have to depend on the lakeFS HadoopFilesystem ("lakeFSFS")? In theory, Spark could write directly to the object store, and have the OutputCommitter stage and commit all written files. This could be a terrible idea, but perhaps has a smaller surface area...?
    Oz Katz
    Ariel Shaqed (Scolnicov)
    5 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    4 months ago
    https://github.com/golangci/golangci-lint/issues/2859 seems to affect us today 😞 @Itai Admi
    Ariel Shaqed (Scolnicov)
    Itai Admi
    3 replies
    Copy to Clipboard
  • Tal Sofer

    Tal Sofer

    4 months ago
    Does anyone else experiencing a halt of the following github actions? • Run Go tests • Run Linters and Checkers Example pr
    Tal Sofer
    Ariel Shaqed (Scolnicov)
    4 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    4 months ago
    @Jonathan Rosenberg is right (following some F2F): S3AFileSystem reads (at least some) configuration from "fs.s3a" no matter what
    fs.impl
    loaded it. E.g. have a look at hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/InternalConstants.java in the hadoop repo. Even at tip of trunk it says
    /**
       * AccessPoint ARN for the bucket. When set as a bucket override the requests for that bucket
       * will go through the AccessPoint.
       */
      public static final String ARN_BUCKET_OPTION = "fs.s3a.bucket.%s.accesspoint.arn";
    (and I don't see any code that will try to edit "s3a" in the configuration option name).
    Ariel Shaqed (Scolnicov)
    Oz Katz
    3 replies
    Copy to Clipboard
  • n

    Niro

    4 months ago
    As part of some refactoring work we are doing I had some thoughts about how we save the Actions run information
    n
    Tal Sofer
    +3
    8 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    4 months ago
    I'm giving the lakeFS provider for Airflow some attention. I'd like to run some tests on my machine on my version -- and obviously I don't want to push it to PyPI before it works. Now our docs say to install the package in order to create a connection. How do I do that without pushing to PyPI? (We will also need to do that to write integration tests for it, of course!) @Lynn Rozen @Itai Admi any hints, please?
    Ariel Shaqed (Scolnicov)
    Itai Admi
    2 replies
    Copy to Clipboard