[Bug]: Upgrade Milvus 2.4.1 -> 2.4.9 Error: Milvus is not ready yet. on Attu

[weiZhenkun]

Is there an existing issue for this?

• [X] I have searched the existing issues

Environment

- Milvus version: 2.4.1 -> 2.4.9
- Deployment mode(standalone or cluster):cluster
- MQ type(rocksmq, pulsar or kafka):  kafka  
- SDK version(e.g. pymilvus v2.0.0rc2): Attu
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

• New install Milvus 2.4.9 OK

• Upgrade Milvus 2.4.1 -> 2.4.8 OK

• Upgrade Milvus 2.4.1 -> 2.4.9 Error: Milvus is not ready yet. Aug 28, 2024 @ 11:49:32.096 [2024/08/28 03:49:32.096 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_1] [groupID=querynode-100-test1-rootcoord-dml_1_451793181617364351v0-true] [error="Local: Timed out"] Aug 28, 2024 @ 11:49:31.767 [2024/08/28 03:49:31.767 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_0] [groupID=datanode-94-test1-rootcoord-dml_0_451792644505338701v0-true] [error="Local: Timed out"] Aug 28, 2024 @ 11:49:31.700 [2024/08/28 03:49:31.700 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_3] [groupID=datanode-94-test1-rootcoord-dml_3_451793181617565152v0-true] [error="Local: Timed out"] Aug 28, 2024 @ 11:49:30.663 [2024/08/28 03:49:30.662 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_3] [groupID=querynode-98-test1-rootcoord-dml_3_451793181617565152v0-true] [error="Local: Timed out"] Aug 28, 2024 @ 11:49:30.378 [2024/08/28 03:49:30.378 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_1] [groupID=datanode-94-test1-rootcoord-dml_1_451793181617364351v0-true] [error="Local: Timed out"] Aug 28, 2024 @ 11:49:30.205 [2024/08/28 03:49:30.205 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_0] [groupID=querynode-98-test1-rootcoord-dml_0_451792644505338701v0-true] [error="Local: Timed out"]

Expected Behavior

• Upgrade Milvus 2.4.1 -> 2.4.9 should be OK

Steps To Reproduce

Upgrade Milvus 2.4.1 -> 2.4.9 should be OK

Milvus realted vaules:
extraConfigFiles:
  user.yaml: |
    common:
      security:
        authorizationEnabled: true
      chanNamePrefix:
        cluster: test1

Milvus querynode Log

Aug 28, 2024 @ 11:49:32.096	[2024/08/28 03:49:32.096 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_1] [groupID=querynode-100-test1-rootcoord-dml_1_451793181617364351v0-true] [error="Local: Timed out"]
Aug 28, 2024 @ 11:49:31.767	[2024/08/28 03:49:31.767 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_0] [groupID=datanode-94-test1-rootcoord-dml_0_451792644505338701v0-true] [error="Local: Timed out"]
Aug 28, 2024 @ 11:49:31.700	[2024/08/28 03:49:31.700 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_3] [groupID=datanode-94-test1-rootcoord-dml_3_451793181617565152v0-true] [error="Local: Timed out"]
Aug 28, 2024 @ 11:49:30.663	[2024/08/28 03:49:30.662 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_3] [groupID=querynode-98-test1-rootcoord-dml_3_451793181617565152v0-true] [error="Local: Timed out"]
Aug 28, 2024 @ 11:49:30.378	[2024/08/28 03:49:30.378 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_1] [groupID=datanode-94-test1-rootcoord-dml_1_451793181617364351v0-true] [error="Local: Timed out"]
Aug 28, 2024 @ 11:49:30.205	[2024/08/28 03:49:30.205 +00:00] [WARN] [kafka/kafka_consumer.go:139] ["consume msg failed"] [topic=test1-rootcoord-dml_0] [groupID=querynode-98-test1-rootcoord-dml_0_451792644505338701v0-true] [error="Local: Timed out"]

Anything else?

N/A