jialin

How do we recover from partition commit failures? Looks like rcf will be overwritten and we will lose old RCF as source_partition_locator would be same across all runs? _Originally posted...

Currently, we use a single actor to handle all `add_record_counts` tasks from all nodes, we have observed that this single actor often stalls and couldn't return ack to dedupe tasks....

https://github.com/ray-project/deltacat/blob/main/deltacat/compute/compactor/steps/hash_bucket.py#L121 if `storage_type` is `StorageType.DISTRIBUTED`, the returned `tables` is a distributed ray dataset. Several changes are needed to deal with a distributed dataset: * replace len() with ds.count(), as len()...

json: unknown field "envs"

1

``` kubectl kustomize base | kubectl apply -f - Error: json: unknown field "envs" error: no objects passed to apply ``` kubectl version ``` "v1.20.4" ```