lynnro314

Add tests of GC report at the end of run to esti.

As for now, we publish lakeFS hadoopFS client jar and uber-jar to Maven central, and publish the Spark client jar to Maven, but the Spark client uber-jar to a public...

The integration test of GC on Azure is flaky, and some times failing with timeout: ``` io.lakefs.clients.api.ApiException: java.net.SocketTimeoutException: timeout at io.lakefs.clients.api.ApiClient.execute(ApiClient.java:945) at io.lakefs.clients.api.RetentionApi.getGarbageCollectionRulesWithHttpInfo(RetentionApi.java:158) at io.lakefs.clients.api.RetentionApi.getGarbageCollectionRules(RetentionApi.java:136) at io.treeverse.clients.ApiClient.getGarbageCollectionRules(ApiClient.scala:106) at io.treeverse.clients.GarbageCollector$.main(GarbageCollector.scala:339) at...

[GC] Add unit tests for GC

1

Add unit tests for GC to check the client behavior.

Add test for region check in GC: 1. Check that GC on AWS fails without specification of region

Today lakeFS supports Azure Blob Storage, and partially supports Azure Data Lake Storage Gen2. We should check and document our support in Azure, what are (if any) the differences in...

Update lakeFS API SDK clients so applications can upgrade their client version

2

API changes (like adding optional parameters to functions) are not backward compatible with the clients. The java and python clients are generated with the lakeFS version. Other clients like the...

sbt package doesn't compatible with apple M1

1

In the spark client - sbt package doesn't compatible with apple M1. We should add an option to download the package locally and use it in case of running the...