Ajantha Bhat
Ajantha Bhat
As nessie gc module [in #3421] depends on Iceberg spark run time jar, it should depend on `client.nessie.version` similar to other modules. It cannot depend on it now itself as...
- Support `NessieApiV1` API for Unreachable reference heads. - Implement Authz with `VIEW_UNREACHABLE_REFERENCE_HEADS`. - REST endpoint path for `unreachableHeads`. - Move contents of `ReferenceUtils` to `AbstractDatabaseAdapter`. TODO: `GCImpl#collectDeadReferences()` to use...
Currently `DatabaseAdapter` level `ReferencesUtil` has the implementation to identify the unreferenced heads. To use this in GC (instead of reflog), `NessieApiV1` should have the implementation which calls this via REST...
#4234 has modified the backend store structure. So, need to update the spec and commit kernel docs. cc: @snazy, @dimas-b
In nessie spark sql extensions, `use reference main at $someHash` is always setting the head reference instead of specified reference. cause: At nessie side we are only using the refName...
**Description**: Support [foundationDB](https://www.foundationdb.org/) as one of the NoSQL backend stores. **Expected Use Cases**: Snowflake and Firebolt currently use foundationDB backend store. Delta seems to also consider this (https://github.com/delta-io/delta/issues/867). Note: It...
I just observed that, Create branch_1 from main and then create a table_1 on this branch with columns A, B and do some insert. Create branch_2 from main and then...
nessie.version.store.type= TRANSACTIONAL is directly mapped to postgres https://github.com/projectnessie/nessie/blob/main/servers/quarkus-cli/src/main/resources/application.properties#L23-L24 In future if we want to support some more transactional backend store, configuration may become confusing. So, rename the TRANSACTIONAL enum to...
Add Integration test that tests the correctness of Iceberg compaction when used within a branch. Compaction on a table in a branch should not affect the same table on the...
Currently `ContentValues`, keeps the list of expired snapshots per refName. Need to keep refName + hash plus contentKey (and other info) required by the consumer of the GC to clean...