• Barak Amar

    Barak Amar

    1 year ago
    lakeFS v0.40.0 released!https://github.com/treeverse/lakeFS/releases/tag/v0.40.0 This is a big release for lakeFS with many notable improvements • OpenAPI 3.0 compliant • Python client package (lakefs-client) • Native Spark client, allowing to export a commit (or set of commits) to another object store • lakeFS standardized URIs • Complete UI Overhaul See the change log for full list of features, bug fixes and breaking changes.
    Barak Amar
    1 replies
    Copy to Clipboard
  • Ariel Shaqed (Scolnicov)

    Ariel Shaqed (Scolnicov)

    1 year ago
    We're 🎉 excited 🎊 to announce the customer preview of the :axolotl: lakeFS-specific Hadoop FileSystem for Spark (and other products in the Hadoop ecosystem). Using this client lets your Spark applications to read lakeFS data directly from the underlying S3 object store rather than having to go through the lakeFS server. See https://docs.lakefs.io/integrations/spark.html for details. We've heard concerns from many of you about scaling lakeFS. With this client your lakeFS server handles only metadata, while all your data access can achieve full S3 scalability. Please let us know how you get along!
    Ariel Shaqed (Scolnicov)
    Karen
    +1
    3 replies
    Copy to Clipboard
  • Tal Sofer

    Tal Sofer

    1 year ago
    lakeFS v0.43.0 released! https://github.com/treeverse/lakeFS/releases/tag/v0.43.0 Notable changes: [Feature] Add lakeFS version to the UI (#2088) [Feature] Warn about using “local” adapter for use in production (#2159) [Feature] Explicit handling of mismatch in block store config and repository namespace according to a user setting (#2126) [Bugfix] Fix lakectl read environment variables in absence of lakectl.yml config file, this bugfix unlocks the Kubeflow-lakeFS integration (#2143) [Bugfix] Add UI error reporting on action failure during a commit (#2120)
    Tal Sofer
    t
    6 replies
    Copy to Clipboard
  • Guy Hardonag

    Guy Hardonag

    1 year ago
    lakeFS v0.48.0 released! https://github.com/treeverse/lakeFS/releases/tag/v0.48.0 • Support multiple AWS regions for underlying buckets (#2245#2325#2326) • Make S3 Gateway DNS settings optional • Fix lakectl upload fails on big uploads (#2280) • Fix blank screen bug in UI (#1908) • Actions secrets support with env vars (#2333) • Reduce the number of database connections used on startup • Validate required configuration keys blockstore.type, auth.encrypt.secret_key. This breaks existing configurations that assume a default blockstore.type of “local”. But no such configuration may be for production. • Fix incorrect time logged on DB get operations (#2341) thanks @holajiawei • API with an unknown path should return an error (#2190) thanks @DataDavD • Retry DB connection on Migration (#2017)
    Guy Hardonag
    1 replies
    Copy to Clipboard
  • Itai Admi

    Itai Admi

    11 months ago
    lakeFS v0.53.0 released with many improvements and bug fixes! https://github.com/treeverse/lakeFS/releases/tag/v0.53.0 New Features: • Add support for LDAP authentication (#2058). • Add tree-view for uncommitted, compare and commit views (#2174) • Support object content-type and user metadata (#2296). • Support multiple commits in lakectl revert (#2345). • lakectl diff: support two way diff. • lakectl diff: allow including uncommitted changes in the diff. • Support lakectl fs rm --recursive (#2446).Bug Fixes: • Fix Trino AVRO format access via S3 gateway (#2429). • Fix UI list users pagination (#2581).
    Itai Admi
    t
    +1
    3 replies
    Copy to Clipboard
  • Tal Sofer

    Tal Sofer

    10 months ago
    lakeFS v0.55.0 released! https://github.com/treeverse/lakeFS/releases/tag/v0.55.0 What’s New? lakeFS branches with DBT (#2680) You can now easily create a dbt project branch using the lakectl dbt branch command. This will automatically create a fully isolated environment similar to any other branch created in lakeFS. If you are interested in more details about the implementation. The
    lakectl dbt create-branch-schema
    command will execute behind the scenes:1. Create a new schema in the Hive metastore and point the new schema to a new branch that was previously created in lakeFS.  2. List all dbt tables in the project. 3. Create and Copy all tables from the original schema to the new schema created in step 1.  4. Build all views in the new schema. View content and size diff between two objects (#2685) Until now, lakeFS displayed a list of objects changed between branches, on commits and for uncommitted changes. lakeFS now also displays content changes within readable objects such as CSV, TSV, and TXT files up to 120KB. For non-readable objects, lakeFS will display the change in size.  The change is presented graphically with color coding, highlighting the difference in the content. View tags in objects, compare and other views (#2670) lakeFS makes another step in making your data lake behave like a git repository. You can now view objects in the context of a tag you created, for example view your production branch state at the time of a release. Enhancements • Remove the lakefs diagnose command (#2693) • Add request ID fields to all DB and auth logs (#2683) • Add an s3 block adapter configuration parameter to disable bucket’s region discovery, if you are using MinIO - check this out (#2705)Bug Fixes 🐛 • Make lakectl provide meaningful information and exit code in case of a merge conflict (#2700,#2706; Fixes:#2699)
    Tal Sofer
    s
    3 replies
    Copy to Clipboard
  • Yoni Augarten

    Yoni Augarten

    7 months ago
    We hope you like quality - because lakeFS v0.58.1 is now released! 🤓 • Merge operation optimized by another 20%! (#2884) • Improved the output verbosity of the 
    lakectl dbt
     tool. (#2895) • Usage examples added in 
    lakectl repo create
     command. (#2900) • Fixed misleading errors on branch creation. (#2859)
    Yoni Augarten
    1 replies
    Copy to Clipboard
  • Lynn Rozen

    Lynn Rozen

    7 months ago
    We are happy to announce the new lakeFS export functionality. :lakefs: Now you can export data from your lakeFS repository to a designated S3 location using Docker. You can read our documentation for more details. We'd love to hear your thoughts and suggestions! 🙂
    Lynn Rozen
    1 replies
    Copy to Clipboard
  • Idan Novogroder

    Idan Novogroder

    3 months ago
    lakeFS v0.68.0 released 😎 https://github.com/treeverse/lakeFS/releases/tag/v0.68.0 Note- This release fixes a bug in the garbage collector. If you are using cloud storage that is not S3 and have configured a garbage collection policy for retention, you will need to reconfigure it. (Note that the garbage collector itself does not yet run on such storage!) There are no changes if you are using S3. What’s new : UI: Show content diff for conflicts 😒unglasses_lakefs: (#3522) lakeFS configuration for audit log level 📄 (#3512) Bug fixes :ladybug:: Fix: Garbage Collector - Eliminate double slash in URL 🚮 (#3525) Fix: Crash fix on
    lakectl superuser
    command - missing logging initialization :female_superhero:(#3519)
    Idan Novogroder
    1 replies
    Copy to Clipboard
  • Yoni Augarten

    Yoni Augarten

    2 months ago
    lakeFS v0.69.0 is available!https://github.com/treeverse/lakeFS/releases/tag/v0.69.0 Notes 1. This release contains performance and security improvements to the authentication mechanism. After upgrading to this version. all current browser sessions will become invalid and users will have to login again. 2. This release requires running database migrations. Before running the lakeFS server you will be required to run the the migrate command. What's new • OIDC support: manage lakeFS users externally (#3452) • Choose merge strategy in the UI (#3581) • Templating capability in the lakeFS web server (#3600) • Visibility: show branch creation errors in the UI (#3604) Bug fixes: • When a revert results in a conflict, return code 409 instead of 500 (#3538)
    Yoni Augarten
    1 replies
    Copy to Clipboard