lakeFS

lakeFS copied to clipboard

lakeFSFS: Define target performance and measure performance

1

1. Define target performance for lakeFSFS used with Spark and Hive tables 2. Define performance benchmarks and guide to running them 3. Measure performance and document results Target performance and...

talSofer

Creating bare repository skips storage namespace validation

1

Some bad things can happen as a result, e.g. - Creating a repo with no storage access - Creating multiple repositories under the same namespace

itaiad200

gateway should identify wrong endpoints requests and return a friendly error

1

Users often set the gateway endpoint in the clients with `/api/v1/` which is the openAPI endpoint. The return error in such cases isn't very informative: ``` java.nio.file.AccessDeniedException: s3a:////: getFileStatus on...

itaiad200

Wrap Spark client API calls to detect version mismatches

4

Typical bad installations of the Spark clients (both lakeFSFS _and_ metadata) have mismatched versions that cause methods and classes not to be found. Wrap all calls with some layer that...

arielshaqed

Running lakeFS on AKS without passing credentials

5

Support a way to deploy lakeFS with access to storage without passing key/secrets to the lakeFS container running inside AKS (Azure's Managed Kubernetes Service). The current lakeFS implement doesn't work...

nopcoder

Add a merge_base_finder_test unit test that simulates workloads that perform many merges

2

Add a unit test that could have caught the [diff bug](https://github.com/treeverse/lakeFS/issues/2962) that was fixed in https://github.com/treeverse/lakeFS/pull/2968 https://github.com/treeverse/lakeFS/blob/master/pkg/graveler/ref/merge_base_finder_test.go

talSofer

Add windows flavor Esti tests

4

As lakectl can be built and used on windows systems, need to support its testing on windows too Update: We need a windows environment esti tests since we need to...

itaidavid

Isolate storage location (directory) for lakeFS Action files

2

**Background issue:** #6299 **Context:** - We want to work in pre-sign mode in AWS S3 and block lakeFS from Get/Put to the bucket, ideally only allow `*/_lakefs/*` folder. - When...

Isan-Rivkin

Restrict list repositories to a specific prefix

3

A request from a user: Restrict `fs:ListRepositories` by a spacific prefix: `arn:lakefs:fs:::repository/{prefix}*` From Slack: https://lakefs.slack.com/archives/C016726JLJW/p1692694405836989

lynnro314

UploadObject returns 500 when "precondition fails"

3

`ErrPredicateFailed` is not handled in the api controller. Not sure if by design or not. When kv returns the error `ErrPredicateFailed` it propagates to the api and 500 is returned...

itaiad200