Router does not update from adapter-xds for its lifetime.

[VirajSalaka]

Description:

After running for several days, we noticed that the router stopped being updated for like 5 hours (After 5 hours, we have restarted the pod.)

Following log was there prior to observing the mentioned.

"4/18/2022, 6:34:01.437 AM","[2022-04-18 06:34:01.436][22][warning][client] [source/common/http/codec_client.cc:122] [C8266518] Connection is closed by peer during connecting.","524e98af-d44d-473d-b7e1-a424344de46d/choreo-connect-router"

During the period, request were served by this router too.

Steps to reproduce:

Affected Product Version:

Environment details (with versions):

• OS:
• Client:
• Env (Docker/K8s):

---

Optional Fields

Related Issues:

Suggested Labels:

Suggested Assignees:

[isurulucky]

@VirajSalaka @isuruw @pubudu538 Isn't this a critical issue which should be fixed asap?

[pubudu538]

@renuka-fernando is looking into this.

[renuka-fernando]

The following log should be printed in the router when it is disconnected from the adapter (for eg: adapter-1 restarted and router connect to adapter-2). In the frozen router, there was only one such log when it terminated and not when adapters restarted.

StreamAggregatedResources gRPC config stream closed: 13

Should print as follows for a healthy router.

[2022-05-03 11:00:30.153][1][info][upstream] [source/common/upstream/cds_api_helper.cc:30] cds: add 1 cluster(s), remove 4 cluster(s)
[2022-05-03 11:00:30.153][1][info][upstream] [source/common/upstream/cds_api_helper.cc:67] cds: added/updated 0 cluster(s), skipped 1 unmodified cluster(s)
[2022-05-03 11:00:30.960][1][info][upstream] [source/common/upstream/cds_api_helper.cc:30] cds: add 1 cluster(s), remove 4 cluster(s)
[2022-05-03 11:00:30.960][1][info][upstream] [source/common/upstream/cds_api_helper.cc:67] cds: added/updated 0 cluster(s), skipped 1 unmodified cluster(s)
[2022-05-03 11:02:28.440][1][warning][config] [./source/common/config/grpc_stream.h:160] StreamAggregatedResources gRPC config stream closed: 13,
[2022-05-03 11:02:28.947][1][info][upstream] [source/common/upstream/cds_api_helper.cc:30] cds: add 1 cluster(s), remove 4 cluster(s)
[2022-05-03 11:02:28.948][1][info][upstream] [source/common/upstream/cds_api_helper.cc:67] cds: added/updated 0 cluster(s), skipped 1 unmodified cluster(s)

[renuka-fernando]

The issue was not reproduced after the fix https://github.com/wso2/product-microgateway/pull/2964