milvus-cdc

milvus-cdc copied to clipboard

[Feature]: cdc when to support etcd ssl config？

1

### Is your feature request related to a problem? Please describe. my etcd cluster is open the ssl，so when i use milvus-cdc，i must config the etcd ssl，but i dont konw...

yunurs

[Bug]: cdc service panic with error `assignment to entry in nil map` during running

2

### Current Behavior ``` [2024/01/22 11:16:28.743 +00:00] [INFO] [reader/replicate_channel_manager.go:354] ["start to add partition"] [collection_name=PartitionDropChecker__MqbkEkqW] [partition_name=PartitionDropChecker__ujYlyRug] [num=1] [2024/01/22 11:16:28.743 +00:00] [WARN] [reader/replicate_channel_manager.go:335] ["the partition is dropped in the source and target"]...

zhuwenxing

### Current Behavior some collections are dropped in upstream, but still in downstream some collections are in upstream, but not in downstream some collections are both in upstream and downstream,...

zhuwenxing

[Bug]: cdc task pasued with reason `fail to read the replicate event` when upstream had a pod kill chaos

1

### Current Behavior ``` [2023-12-25T02:59:41.170Z] + curl --location 10.255.40.87:8444/cdc --header Content-Type: application/json --data { [2023-12-25T02:59:41.171Z] "request_type": "list" [2023-12-25T02:59:41.171Z] } [2023-12-25T02:59:41.171Z] % Total % Received % Xferd Average Speed Time Time...

zhuwenxing

[Bug]: cdc task paused with error `fail to handle the op message pack, err:collection is not ready`

1

### Current Behavior ``` {"code":200,"data":{"tasks":[{"task_id":"79358858c4714759878af76381bc7728","milvus_connect_param":{"host":"10.255.227.180","port":19530,"enable_tls":false,"ignore_partition":false,"connect_timeout":10},"collection_infos":[{"name":"*"}],"state":"Paused","reason":"fail to handle the op message pack, err:collection is not ready"}]}} ``` ### Expected Behavior _No response_ ### Steps To Reproduce _No response_ ### Environment _No...

zhuwenxing

zhuwenxing

- issue: #117

SimFG

1. add kafkaDataHandler that can pass to writer 2. add kafka request param 3. [WIP] : modify cdc.impl when replicating data to kafka (espacially the ReplicateEntity struct) 4. [WIP] :...

Ricky-chen1

### Current Behavior ``` "state": "Running", "reason": "manually pause through http interface" ``` These two status values are contradictory. ``` { "code": 200, "data": { "tasks": [ { "task_id": "a2040d620ac84ab3b07902f3b54cbe8f",...

zhuwenxing

SimFG