lakeFS
lakeFS copied to clipboard
lakeFS - Data version control for your data lake | Git for data
First step: add postgres section to KV params. Post KV - remove database section parameters entirely
Modified documentation: - upgrade doc - sizing guide DB storage and Mem **only**
As mentioned [in the docs](https://docs.lakefs.io/reference/garbage-collection.html), the current Garbage Collection is supported only on S3 and Azure and will be at some point available for GCP. However, I did not find...
Abuse command that will get a link to stage and link object in parallel. The command was created to capture the case of parallel write to the same key. In...
While configured to work with auth API, there is no sense in running setup or superuser command as the remote service is responsible of the setup. The current commands setup...
Enable lakectl abuse by write to the same key - alternative to random-write.
- How to migrate from DB to KV - Quick start with DynamoDB - New properties in the configuration struct - Unsupported versions/features for dump/restore - Architecture page - Sizing...
Currently, lakeFSFS support Hadoop 2, and we need to add support for Hadoop 3. DOD: - Hadoop 3 spec tests pass - lakeFSFS depends only on matching Hadoop packages. -...
Currently, we run an integration test using docker on Spark cluster 2.x and 3.x. Running the same on Databricks will help us catch more cases and issues before publishing a...