lakeFS
lakeFS copied to clipboard
lakeFS - Data version control for your data lake | Git for data
Add tests of GC report at the end of run to esti.
Currently, GC integration tests are implemented in bash. This slows down our dev speed significantly and we want to move the tests to another language.
Currently metrics are collected base on SQL statistics for the Postgres DB implementation. Some of these metrics are not relevant / impossible to obtain on different driver implementation. As such,...
Many lakeFS users integrate it with Spark. To simplify the search experience of docs, Spark integrations should be a top-level category in our documentation.
## User story In general, objects should be removed from the storage when there are no valid pointers from lakeFS to them. In particular, objects that were removed from the...
Use https://github.com/treeverse/lakeFS/tree/master/cmd/lakefs-loadtest to run load tests on a recurring cadence, for main lakeFS workflows.
Initial investigation show's there might be a race which causes writer to close before operation is completed `Aborting write to range: %!w(*fmt.wrapError=&{sstable file close: pebble: writer is closed` **Logs:** ```...