sarama
sarama copied to clipboard
IBM
Increase in huge number of goroutines during every metadata refresh
Versions
Please specify real version numbers or git SHAs, not just "Latest" since that changes fairly regularly.
| Sarama | Kafka | Go |
|---|---|---|
| 1.31.1 | V2_0_0_0 | 1.17 |
Configuration
What configuration values are you using for Sarama and Kafka?
config.Config.Producer.Retry.Max = 0
if config.Metadata.Retry.Backoff == 0 {
config.Metadata.Retry.Backoff = 100000000
}
if config.Metadata.Retry.Max == 0 {
config.Metadata.Retry.Max = 5
}
if config.Producer.Retry.Backoff == 0 {
config.Producer.Retry.Backoff = 5000000
}
if config.Producer.Timeout == 0 {
config.Producer.Timeout = 300000000
}
if config.Producer.RequiredAcks == 0 {
config.Producer.RequiredAcks = 1
}
config.Producer.Return.Successes = true
config.Producer.Return.Errors = true
if config.Consumer.Retry.Backoff == 0 {
config.Consumer.Retry.Backoff = 5000000
}
if config.Consumer.MaxWaitTime == 0 {
config.Consumer.MaxWaitTime = 300000000
}
if config.Consumer.Group.Heartbeat.Interval == 0 {
config.Consumer.Group.Heartbeat.Interval = 1000000
}
Logs
When filing an issue please provide logs from Sarama and Kafka if at all
possible. You can set sarama.Logger to a log.Logger to capture Sarama debug
output.
logs: CLICK ME
DEBU [16:56:59] client/metadata fetching metadata for all topics from broker b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 37426368 GoRoutines: 442)
DEBU [16:57:01] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 37557176 GoRoutines: 442)
DEBU [16:57:01] SASL authentication successful with broker b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 37559344 GoRoutines: 442)
DEBU [16:57:01] Connected to broker at b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #3)
(Memory: 37561288 GoRoutines: 442)
DEBU [16:57:03] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 38653464 GoRoutines: 442)
DEBU [16:57:03] client/metadata fetching metadata for all topics from broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 38655448 GoRoutines: 443)
DEBU [16:57:04] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 38785552 GoRoutines: 443)
DEBU [16:57:05] SASL authentication successful with broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 38787592 GoRoutines: 443)
DEBU [16:57:05] Connected to broker at b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #10)
(Memory: 38789536 GoRoutines: 443)
DEBU [16:57:05] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 38792072 GoRoutines: 443)
DEBU [16:57:05] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 38795072 GoRoutines: 445)
DEBU [16:57:06] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 38968616 GoRoutines: 444)
DEBU [16:57:06] SASL authentication successful with broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 38970656 GoRoutines: 444)
DEBU [16:57:06] Connected to broker at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #24)
(Memory: 38972600 GoRoutines: 444)
DEBU [16:57:07] client/metadata fetching metadata for all topics from broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 39010728 GoRoutines: 444)
DEBU [16:57:09] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 40103176 GoRoutines: 444)
DEBU [16:57:09] client/metadata fetching metadata for all topics from broker b21-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40105256 GoRoutines: 445)
DEBU [16:57:10] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 40243608 GoRoutines: 445)
DEBU [16:57:11] SASL authentication successful with broker b21-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 40245648 GoRoutines: 445)
DEBU [16:57:11] Connected to broker at b21-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #21)
(Memory: 40247592 GoRoutines: 445)
DEBU [16:57:16] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 41339864 GoRoutines: 445)
DEBU [16:57:16] client/metadata fetching metadata for all topics from broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 41341944 GoRoutines: 446)
DEBU [16:57:17] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 41395080 GoRoutines: 446)
DEBU [16:57:18] SASL authentication successful with broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 41397120 GoRoutines: 446)
DEBU [16:57:18] Connected to broker at b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #0)
(Memory: 41399064 GoRoutines: 446)
DEBU [16:57:18] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 42491112 GoRoutines: 446)
DEBU [16:57:18] client/metadata fetching metadata for all topics from broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 42493096 GoRoutines: 447)
DEBU [16:57:19] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 42631544 GoRoutines: 447)
DEBU [16:57:20] SASL authentication successful with broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 42633584 GoRoutines: 447)
DEBU [16:57:20] Connected to broker at b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #11)
(Memory: 42635528 GoRoutines: 447)
DEBU [16:57:21] client/metadata fetching metadata for all topics from broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 42673400 GoRoutines: 447)
DEBU [16:57:21] client/metadata got error from broker 0 while fetching metadata: write tcp 172.0.74.2:62067->44.238.98.177:9092: write: broken pipe
(Memory: 42676320 GoRoutines: 447)
DEBU [16:57:21] Error while closing connection to broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62067->44.238.98.177:9092: write: broken pipe
(Memory: 42678872 GoRoutines: 446)
DEBU [16:57:21] client/brokers deregistered broker #0 at b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 42681600 GoRoutines: 446)
DEBU [16:57:21] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 42683408 GoRoutines: 446)
DEBU [16:57:21] client/metadata fetching metadata for all topics from broker b13-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 42686312 GoRoutines: 448)
DEBU [16:57:22] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 42813648 GoRoutines: 447)
DEBU [16:57:23] SASL authentication successful with broker b13-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 42815688 GoRoutines: 447)
DEBU [16:57:23] Connected to broker at b13-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #13)
(Memory: 42817632 GoRoutines: 447)
DEBU [16:57:23] client/brokers registered new broker #0 at b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 42854096 GoRoutines: 447)
DEBU [16:57:23] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 43911568 GoRoutines: 447)
DEBU [16:57:23] client/metadata got error from broker 5 while fetching metadata: write tcp 172.0.74.2:62778->52.24.52.229:9092: write: broken pipe
(Memory: 43914472 GoRoutines: 447)
DEBU [16:57:23] Error while closing connection to broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62778->52.24.52.229:9092: write: broken pipe
(Memory: 43917008 GoRoutines: 446)
DEBU [16:57:23] client/brokers deregistered broker #5 at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 43919704 GoRoutines: 446)
DEBU [16:57:23] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 43921512 GoRoutines: 446)
DEBU [16:57:23] client/metadata fetching metadata for all topics from broker b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 43924416 GoRoutines: 448)
DEBU [16:57:24] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 43977104 GoRoutines: 447)
DEBU [16:57:25] SASL authentication successful with broker b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 43979144 GoRoutines: 447)
DEBU [16:57:25] Connected to broker at b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #16)
(Memory: 43981088 GoRoutines: 447)
DEBU [16:57:25] client/brokers registered new broker #5 at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44017552 GoRoutines: 447)
DEBU [16:57:25] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44020768 GoRoutines: 447)
DEBU [16:57:25] client/metadata got error from broker 5 while fetching metadata: write tcp 172.0.74.2:62069->52.24.52.229:9092: write: broken pipe
(Memory: 44023672 GoRoutines: 447)
DEBU [16:57:25] Error while closing connection to broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62069->52.24.52.229:9092: write: broken pipe
(Memory: 44026208 GoRoutines: 446)
DEBU [16:57:25] client/brokers deregistered broker #5 at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44028392 GoRoutines: 446)
DEBU [16:57:25] client/metadata fetching metadata for all topics from broker b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44030280 GoRoutines: 446)
DEBU [16:57:25] client/metadata got error from broker 20 while fetching metadata: write tcp 172.0.74.2:62780->54.186.200.131:9092: write: broken pipe
(Memory: 44033200 GoRoutines: 446)
DEBU [16:57:25] Error while closing connection to broker b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62780->54.186.200.131:9092: write: broken pipe
(Memory: 44035752 GoRoutines: 445)
DEBU [16:57:25] client/brokers deregistered broker #20 at b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44038032 GoRoutines: 445)
DEBU [16:57:25] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44039936 GoRoutines: 445)
DEBU [16:57:25] client/metadata got error from broker 24 while fetching metadata: write tcp 172.0.74.2:63040->35.82.221.13:9092: write: broken pipe
(Memory: 44042840 GoRoutines: 445)
DEBU [16:57:25] Error while closing connection to broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:63040->35.82.221.13:9092: write: broken pipe
(Memory: 44045376 GoRoutines: 444)
DEBU [16:57:25] client/brokers deregistered broker #24 at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44047592 GoRoutines: 444)
DEBU [16:57:25] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 44049416 GoRoutines: 444)
DEBU [16:57:25] client/metadata fetching metadata for all topics from broker b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44051400 GoRoutines: 445)
DEBU [16:57:26] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 44179344 GoRoutines: 445)
DEBU [16:57:27] SASL authentication successful with broker b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 44181384 GoRoutines: 445)
DEBU [16:57:27] Connected to broker at b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #3)
(Memory: 44183328 GoRoutines: 445)
DEBU [16:57:27] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 44204200 GoRoutines: 445)
DEBU [16:57:27] client/brokers registered new broker #5 at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44221720 GoRoutines: 446)
DEBU [16:57:27] client/brokers registered new broker #20 at b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44224032 GoRoutines: 446)
DEBU [16:57:27] client/metadata fetching metadata for all topics from broker b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44225784 GoRoutines: 446)
DEBU [16:57:27] client/brokers registered new broker #24 at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 44227480 GoRoutines: 446)
DEBU [16:57:28] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 45410464 GoRoutines: 446)
DEBU [16:57:28] SASL authentication successful with broker b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 45412504 GoRoutines: 446)
DEBU [16:57:28] Connected to broker at b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #14)
(Memory: 45414448 GoRoutines: 446)
DEBU [16:57:30] client/metadata fetching metadata for all topics from broker b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 45452480 GoRoutines: 446)
DEBU [16:57:30] client/metadata got error from broker 20 while fetching metadata: write tcp 172.0.74.2:62552->34.211.70.153:9092: write: broken pipe
(Memory: 45455400 GoRoutines: 446)
DEBU [16:57:30] Error while closing connection to broker b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62552->34.211.70.153:9092: write: broken pipe
(Memory: 45457952 GoRoutines: 445)
DEBU [16:57:30] client/brokers deregistered broker #20 at b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 45460200 GoRoutines: 445)
DEBU [16:57:30] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 45462024 GoRoutines: 445)
DEBU [16:57:30] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 45464008 GoRoutines: 446)
DEBU [16:57:31] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 45591960 GoRoutines: 446)
DEBU [16:57:31] SASL authentication successful with broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 45594000 GoRoutines: 446)
DEBU [16:57:31] Connected to broker at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #24)
(Memory: 45595944 GoRoutines: 446)
DEBU [16:57:31] client/brokers registered new broker #20 at b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 45632424 GoRoutines: 446)
DEBU [16:57:31] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 45635560 GoRoutines: 446)
DEBU [16:57:31] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 45637544 GoRoutines: 447)
DEBU [16:57:33] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 45766568 GoRoutines: 447)
DEBU [16:57:33] SASL authentication successful with broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 45768608 GoRoutines: 447)
DEBU [16:57:33] Connected to broker at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #5)
(Memory: 45770552 GoRoutines: 447)
DEBU [16:57:34] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 46862768 GoRoutines: 447)
DEBU [16:57:34] client/metadata fetching metadata for all topics from broker b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 46865768 GoRoutines: 449)
DEBU [16:57:35] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 46993928 GoRoutines: 448)
DEBU [16:57:35] SASL authentication successful with broker b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 46995968 GoRoutines: 448)
DEBU [16:57:35] Connected to broker at b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #19)
(Memory: 46997912 GoRoutines: 448)
DEBU [16:57:36] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 47035704 GoRoutines: 448)
DEBU [16:57:36] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 47038608 GoRoutines: 450)
DEBU [16:57:37] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 47089728 GoRoutines: 449)
DEBU [16:57:37] SASL authentication successful with broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 47091768 GoRoutines: 449)
DEBU [16:57:37] Connected to broker at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #5)
(Memory: 47093712 GoRoutines: 449)
DEBU [16:57:39] client/metadata fetching metadata for all topics from broker b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 48185840 GoRoutines: 449)
DEBU [16:57:39] client/metadata got error from broker 16 while fetching metadata: write tcp 172.0.74.2:62558->52.10.199.195:9092: write: broken pipe
(Memory: 48188760 GoRoutines: 449)
DEBU [16:57:39] Error while closing connection to broker b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62558->52.10.199.195:9092: write: broken pipe
(Memory: 48191312 GoRoutines: 448)
DEBU [16:57:39] client/brokers deregistered broker #16 at b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 48193560 GoRoutines: 448)
DEBU [16:57:39] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 48195384 GoRoutines: 448)
DEBU [16:57:39] client/metadata fetching metadata for all topics from broker b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 48197368 GoRoutines: 449)
DEBU [16:57:40] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 48325512 GoRoutines: 449)
DEBU [16:57:40] SASL authentication successful with broker b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 48327552 GoRoutines: 449)
DEBU [16:57:40] Connected to broker at b20-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #20)
(Memory: 48329496 GoRoutines: 449)
DEBU [16:57:41] client/metadata fetching metadata for all topics from broker b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 48331872 GoRoutines: 449)
DEBU [16:57:41] client/brokers registered new broker #16 at b16-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 48368624 GoRoutines: 449)
DEBU [16:57:44] client/metadata fetching metadata for all topics from broker b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 49461704 GoRoutines: 449)
DEBU [16:57:44] client/metadata got error from broker 26 while fetching metadata: write tcp 172.0.74.2:62560->52.13.126.115:9092: write: broken pipe
(Memory: 49464624 GoRoutines: 449)
DEBU [16:57:44] Error while closing connection to broker b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62560->52.13.126.115:9092: write: broken pipe
(Memory: 49467176 GoRoutines: 448)
DEBU [16:57:44] client/brokers deregistered broker #26 at b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 49469936 GoRoutines: 448)
DEBU [16:57:44] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 49471760 GoRoutines: 448)
DEBU [16:57:44] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 49473744 GoRoutines: 449)
DEBU [16:57:45] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 49602016 GoRoutines: 449)
DEBU [16:57:45] SASL authentication successful with broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 49604056 GoRoutines: 449)
DEBU [16:57:45] Connected to broker at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #24)
(Memory: 49606000 GoRoutines: 449)
DEBU [16:57:45] client/brokers registered new broker #26 at b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 49642328 GoRoutines: 449)
DEBU [16:57:46] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 49645448 GoRoutines: 449)
DEBU [16:57:46] client/metadata fetching metadata for all topics from broker b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 49647432 GoRoutines: 450)
DEBU [16:57:47] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 49775672 GoRoutines: 450)
DEBU [16:57:47] SASL authentication successful with broker b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 49777712 GoRoutines: 450)
DEBU [16:57:47] Connected to broker at b3-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #3)
(Memory: 49779656 GoRoutines: 450)
DEBU [16:57:48] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 50871704 GoRoutines: 450)
DEBU [16:57:48] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 50874608 GoRoutines: 452)
DEBU [16:57:49] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 51011560 GoRoutines: 451)
DEBU [16:57:50] SASL authentication successful with broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 51013600 GoRoutines: 451)
DEBU [16:57:50] Connected to broker at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #5)
(Memory: 51015544 GoRoutines: 451)
DEBU [16:57:50] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 51017840 GoRoutines: 451)
DEBU [16:57:50] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 51020744 GoRoutines: 453)
DEBU [16:57:51] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 51107704 GoRoutines: 452)
DEBU [16:57:51] SASL authentication successful with broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 51109744 GoRoutines: 452)
DEBU [16:57:51] Connected to broker at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #24)
(Memory: 51111688 GoRoutines: 452)
DEBU [16:57:52] client/metadata fetching metadata for all topics from broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 51149696 GoRoutines: 452)
DEBU [16:57:52] client/metadata got error from broker 11 while fetching metadata: write tcp 172.0.74.2:62563->44.239.206.85:9092: write: broken pipe
(Memory: 51152616 GoRoutines: 452)
DEBU [16:57:52] Error while closing connection to broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62563->44.239.206.85:9092: write: broken pipe
(Memory: 51155168 GoRoutines: 451)
DEBU [16:57:52] client/brokers deregistered broker #11 at b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 51157416 GoRoutines: 451)
DEBU [16:57:52] client/metadata fetching metadata for all topics from broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 51159320 GoRoutines: 451)
DEBU [16:57:52] client/brokers registered new broker #11 at b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 51196064 GoRoutines: 451)
DEBU [16:57:54] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 52253536 GoRoutines: 451)
DEBU [16:57:54] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 52256440 GoRoutines: 453)
DEBU [16:57:55] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 52383792 GoRoutines: 452)
DEBU [16:57:55] SASL authentication successful with broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 52385832 GoRoutines: 452)
DEBU [16:57:55] Connected to broker at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #24)
(Memory: 52387776 GoRoutines: 452)
DEBU [16:57:56] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 52425568 GoRoutines: 452)
DEBU [16:57:56] client/metadata fetching metadata for all topics from broker b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 52427552 GoRoutines: 453)
DEBU [16:57:57] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 52556648 GoRoutines: 453)
DEBU [16:57:58] SASL authentication successful with broker b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 52558688 GoRoutines: 453)
DEBU [16:57:58] Connected to broker at b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #19)
(Memory: 52560632 GoRoutines: 453)
DEBU [16:57:59] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 53652768 GoRoutines: 453)
DEBU [16:57:59] client/metadata got error from broker 24 while fetching metadata: write tcp 172.0.74.2:62572->52.11.243.191:9092: write: broken pipe
(Memory: 53655688 GoRoutines: 453)
DEBU [16:57:59] Error while closing connection to broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62572->52.11.243.191:9092: write: broken pipe
(Memory: 53658240 GoRoutines: 452)
DEBU [16:57:59] client/brokers deregistered broker #24 at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 53660488 GoRoutines: 452)
DEBU [16:57:59] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 53662312 GoRoutines: 452)
DEBU [16:57:59] client/metadata fetching metadata for all topics from broker b6-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 53664296 GoRoutines: 453)
DEBU [16:58:00] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 53792552 GoRoutines: 453)
DEBU [16:58:01] SASL authentication successful with broker b6-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 53794592 GoRoutines: 453)
DEBU [16:58:01] Connected to broker at b6-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #6)
(Memory: 53796536 GoRoutines: 453)
DEBU [16:58:01] client/brokers registered new broker #24 at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 53832872 GoRoutines: 453)
DEBU [16:58:01] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 53835992 GoRoutines: 453)
DEBU [16:58:01] client/metadata fetching metadata for all topics from broker b7-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 53838896 GoRoutines: 455)
DEBU [16:58:02] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 53965800 GoRoutines: 454)
DEBU [16:58:03] SASL authentication successful with broker b7-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 53967840 GoRoutines: 454)
DEBU [16:58:03] Connected to broker at b7-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #7)
(Memory: 53969784 GoRoutines: 454)
DEBU [16:58:04] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 55061896 GoRoutines: 454)
DEBU [16:58:04] client/metadata fetching metadata for all topics from broker b22-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 55064800 GoRoutines: 456)
DEBU [16:58:05] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 55191736 GoRoutines: 455)
DEBU [16:58:05] SASL authentication successful with broker b22-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 55193776 GoRoutines: 455)
DEBU [16:58:05] Connected to broker at b22-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #22)
(Memory: 55195720 GoRoutines: 455)
DEBU [16:58:07] client/metadata fetching metadata for all topics from broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 55234016 GoRoutines: 455)
DEBU [16:58:07] client/metadata got error from broker 10 while fetching metadata: write tcp 172.0.74.2:62812->35.81.123.60:9092: write: broken pipe
(Memory: 55236920 GoRoutines: 455)
DEBU [16:58:07] Error while closing connection to broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62812->35.81.123.60:9092: write: broken pipe
(Memory: 55239456 GoRoutines: 454)
DEBU [16:58:07] client/brokers deregistered broker #10 at b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 55241672 GoRoutines: 454)
DEBU [16:58:07] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 55243496 GoRoutines: 454)
DEBU [16:58:07] client/metadata fetching metadata for all topics from broker b17-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 55245480 GoRoutines: 455)
DEBU [16:58:08] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 56427592 GoRoutines: 455)
DEBU [16:58:09] SASL authentication successful with broker b17-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 56429632 GoRoutines: 455)
DEBU [16:58:09] Connected to broker at b17-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #17)
(Memory: 56431576 GoRoutines: 455)
DEBU [16:58:09] client/brokers registered new broker #10 at b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 56467904 GoRoutines: 455)
DEBU [16:58:09] client/metadata fetching metadata for all topics from broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 56471104 GoRoutines: 455)
DEBU [16:58:11] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 56509312 GoRoutines: 455)
DEBU [16:58:11] client/metadata fetching metadata for all topics from broker b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 56511296 GoRoutines: 456)
DEBU [16:58:12] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 56648608 GoRoutines: 456)
DEBU [16:58:13] SASL authentication successful with broker b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 56650648 GoRoutines: 456)
DEBU [16:58:13] Connected to broker at b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #25)
(Memory: 56652592 GoRoutines: 456)
DEBU [16:58:13] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 56690384 GoRoutines: 456)
DEBU [16:58:13] client/metadata fetching metadata for all topics from broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 56693288 GoRoutines: 458)
DEBU [16:58:14] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 57798872 GoRoutines: 457)
DEBU [16:58:15] SASL authentication successful with broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 57800912 GoRoutines: 457)
DEBU [16:58:15] Connected to broker at b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #11)
(Memory: 57802856 GoRoutines: 457)
DEBU [16:58:16] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 57840648 GoRoutines: 457)
DEBU [16:58:16] client/metadata fetching metadata for all topics from broker b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 57843552 GoRoutines: 459)
DEBU [16:58:17] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 57970472 GoRoutines: 458)
DEBU [16:58:17] SASL authentication successful with broker b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 57972512 GoRoutines: 458)
DEBU [16:58:17] Connected to broker at b19-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #19)
(Memory: 57974456 GoRoutines: 458)
DEBU [16:58:17] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 57976752 GoRoutines: 458)
DEBU [16:58:17] client/metadata fetching metadata for all topics from broker b23-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 57978736 GoRoutines: 459)
DEBU [16:58:19] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 59206088 GoRoutines: 459)
DEBU [16:58:19] SASL authentication successful with broker b23-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 59208128 GoRoutines: 459)
DEBU [16:58:19] Connected to broker at b23-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #23)
(Memory: 59210072 GoRoutines: 459)
DEBU [16:58:20] client/metadata fetching metadata for all topics from broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59247544 GoRoutines: 459)
DEBU [16:58:20] client/metadata got error from broker 0 while fetching metadata: write tcp 172.0.74.2:62107->44.238.98.177:9092: write: broken pipe
(Memory: 59250464 GoRoutines: 459)
DEBU [16:58:20] Error while closing connection to broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62107->44.238.98.177:9092: write: broken pipe
(Memory: 59253016 GoRoutines: 458)
DEBU [16:58:20] client/brokers deregistered broker #0 at b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59255232 GoRoutines: 458)
DEBU [16:58:20] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 59257040 GoRoutines: 458)
DEBU [16:58:20] client/metadata fetching metadata for all topics from broker b23-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59259024 GoRoutines: 459)
DEBU [16:58:21] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 59387296 GoRoutines: 459)
DEBU [16:58:22] SASL authentication successful with broker b23-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 59389336 GoRoutines: 459)
DEBU [16:58:22] Connected to broker at b23-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #23)
(Memory: 59391280 GoRoutines: 459)
DEBU [16:58:22] client/brokers registered new broker #0 at b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59427608 GoRoutines: 459)
DEBU [16:58:22] client/metadata fetching metadata for all topics from broker b8-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59430808 GoRoutines: 459)
DEBU [16:58:22] client/metadata got error from broker 8 while fetching metadata: write tcp 172.0.74.2:63079->35.161.205.0:9092: write: broken pipe
(Memory: 59433712 GoRoutines: 459)
DEBU [16:58:22] Error while closing connection to broker b8-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:63079->35.161.205.0:9092: write: broken pipe
(Memory: 59436248 GoRoutines: 458)
DEBU [16:58:22] client/brokers deregistered broker #8 at b8-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59438432 GoRoutines: 458)
DEBU [16:58:22] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 59440240 GoRoutines: 458)
DEBU [16:58:22] client/metadata fetching metadata for all topics from broker b29-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 59443240 GoRoutines: 460)
DEBU [16:58:23] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 59570352 GoRoutines: 459)
DEBU [16:58:23] SASL authentication successful with broker b29-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 60626648 GoRoutines: 459)
DEBU [16:58:23] Connected to broker at b29-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #29)
(Memory: 60628592 GoRoutines: 459)
DEBU [16:58:24] client/brokers registered new broker #8 at b8-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 60664920 GoRoutines: 459)
DEBU [16:58:25] client/metadata fetching metadata for all topics from broker b2-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 60668120 GoRoutines: 459)
DEBU [16:58:25] client/metadata got error from broker 2 while fetching metadata: write tcp 172.0.74.2:62828->34.212.129.24:9092: write: broken pipe
(Memory: 60671040 GoRoutines: 459)
DEBU [16:58:25] Error while closing connection to broker b2-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62828->34.212.129.24:9092: write: broken pipe
(Memory: 60673592 GoRoutines: 458)
DEBU [16:58:25] client/brokers deregistered broker #2 at b2-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 60675808 GoRoutines: 458)
DEBU [16:58:25] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 60677616 GoRoutines: 458)
DEBU [16:58:25] client/metadata fetching metadata for all topics from broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 60679600 GoRoutines: 459)
DEBU [16:58:26] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 60808072 GoRoutines: 459)
DEBU [16:58:26] SASL authentication successful with broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 60810112 GoRoutines: 459)
DEBU [16:58:26] Connected to broker at b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #9)
(Memory: 60812056 GoRoutines: 459)
DEBU [16:58:26] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 60814352 GoRoutines: 459)
DEBU [16:58:26] client/metadata fetching metadata for all topics from broker b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 60816336 GoRoutines: 460)
DEBU [16:58:26] client/brokers registered new broker #2 at b2-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 60856880 GoRoutines: 461)
DEBU [16:58:28] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 60982480 GoRoutines: 460)
DEBU [16:58:28] SASL authentication successful with broker b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 62038776 GoRoutines: 460)
DEBU [16:58:28] Connected to broker at b25-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #25)
(Memory: 62040720 GoRoutines: 460)
DEBU [16:58:28] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 62043016 GoRoutines: 460)
DEBU [16:58:28] client/metadata fetching metadata for all topics from broker b18-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 62045000 GoRoutines: 461)
DEBU [16:58:30] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 62208632 GoRoutines: 461)
DEBU [16:58:30] SASL authentication successful with broker b18-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 62210672 GoRoutines: 461)
DEBU [16:58:30] Connected to broker at b18-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #18)
(Memory: 62212616 GoRoutines: 461)
DEBU [16:58:30] client/metadata fetching metadata for all topics from broker b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 62250640 GoRoutines: 461)
DEBU [16:58:30] client/metadata got error from broker 14 while fetching metadata: write tcp 172.0.74.2:62832->35.155.48.218:9092: write: broken pipe
(Memory: 62253560 GoRoutines: 461)
DEBU [16:58:30] Error while closing connection to broker b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62832->35.155.48.218:9092: write: broken pipe
(Memory: 62256112 GoRoutines: 460)
DEBU [16:58:30] client/brokers deregistered broker #14 at b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 62258360 GoRoutines: 460)
DEBU [16:58:30] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 62260184 GoRoutines: 460)
DEBU [16:58:30] client/metadata fetching metadata for all topics from broker b21-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 62262168 GoRoutines: 461)
DEBU [16:58:32] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 62390312 GoRoutines: 461)
DEBU [16:58:32] SASL authentication successful with broker b21-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 62392352 GoRoutines: 461)
DEBU [16:58:32] Connected to broker at b21-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #21)
(Memory: 62394296 GoRoutines: 461)
DEBU [16:58:32] client/brokers registered new broker #14 at b14-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 62430760 GoRoutines: 461)
DEBU [16:58:33] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 62433896 GoRoutines: 461)
DEBU [16:58:33] client/metadata fetching metadata for all topics from broker b12-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 62436800 GoRoutines: 463)
DEBU [16:58:34] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 63618408 GoRoutines: 462)
DEBU [16:58:34] SASL authentication successful with broker b12-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 63620448 GoRoutines: 462)
DEBU [16:58:34] Connected to broker at b12-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #12)
(Memory: 63622392 GoRoutines: 462)
DEBU [16:58:34] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 63624768 GoRoutines: 462)
DEBU [16:58:39] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 64753040 GoRoutines: 462)
DEBU [16:58:39] client/metadata fetching metadata for all topics from broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 64755024 GoRoutines: 463)
DEBU [16:58:40] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 64893472 GoRoutines: 463)
DEBU [16:58:40] SASL authentication successful with broker b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 64895512 GoRoutines: 463)
DEBU [16:58:40] Connected to broker at b10-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #10)
(Memory: 64897456 GoRoutines: 463)
DEBU [16:58:41] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 64935248 GoRoutines: 463)
DEBU [16:58:41] client/metadata fetching metadata for all topics from broker b6-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 64938152 GoRoutines: 465)
DEBU [16:58:42] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 64989272 GoRoutines: 464)
DEBU [16:58:42] SASL authentication successful with broker b6-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 64991312 GoRoutines: 464)
DEBU [16:58:42] Connected to broker at b6-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #6)
(Memory: 64993256 GoRoutines: 464)
DEBU [16:58:43] client/metadata fetching metadata for all topics from broker b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 65031128 GoRoutines: 464)
DEBU [16:58:43] client/metadata got error from broker 26 while fetching metadata: write tcp 172.0.74.2:62123->35.165.192.88:9092: write: broken pipe
(Memory: 65034048 GoRoutines: 464)
DEBU [16:58:43] Error while closing connection to broker b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62123->35.165.192.88:9092: write: broken pipe
(Memory: 65036600 GoRoutines: 463)
DEBU [16:58:43] client/brokers deregistered broker #26 at b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 65038848 GoRoutines: 463)
DEBU [16:58:43] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 65040672 GoRoutines: 463)
DEBU [16:58:43] client/metadata fetching metadata for all topics from broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 65042656 GoRoutines: 464)
DEBU [16:58:44] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 66224928 GoRoutines: 464)
DEBU [16:58:44] SASL authentication successful with broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 66226968 GoRoutines: 464)
DEBU [16:58:44] Connected to broker at b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #9)
(Memory: 66228912 GoRoutines: 464)
DEBU [16:58:45] client/brokers registered new broker #26 at b26-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 66265248 GoRoutines: 464)
DEBU [16:58:45] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 66268368 GoRoutines: 464)
DEBU [16:58:45] client/metadata fetching metadata for all topics from broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 66271272 GoRoutines: 466)
DEBU [16:58:46] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 66408352 GoRoutines: 465)
DEBU [16:58:46] SASL authentication successful with broker b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 66410392 GoRoutines: 465)
DEBU [16:58:46] Connected to broker at b11-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #11)
(Memory: 66412336 GoRoutines: 465)
DEBU [16:58:48] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 67504928 GoRoutines: 465)
DEBU [16:58:48] client/metadata fetching metadata for all topics from broker b12-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 67506912 GoRoutines: 466)
DEBU [16:58:50] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 67559800 GoRoutines: 466)
DEBU [16:58:50] SASL authentication successful with broker b12-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 67561840 GoRoutines: 466)
DEBU [16:58:50] Connected to broker at b12-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #12)
(Memory: 67563784 GoRoutines: 466)
DEBU [16:58:50] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 67601584 GoRoutines: 466)
DEBU [16:58:50] client/metadata fetching metadata for all topics from broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 67604680 GoRoutines: 468)
DEBU [16:58:51] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 67732784 GoRoutines: 467)
DEBU [16:58:52] SASL authentication successful with broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 67734824 GoRoutines: 467)
DEBU [16:58:52] Connected to broker at b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #4)
(Memory: 67736768 GoRoutines: 467)
DEBU [16:58:53] client/metadata fetching metadata for all topics from broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 67775680 GoRoutines: 467)
DEBU [16:58:53] client/metadata got error from broker 4 while fetching metadata: write tcp 172.0.74.2:62711->52.10.176.85:9092: write: broken pipe
(Memory: 67780168 GoRoutines: 467)
DEBU [16:58:53] Error while closing connection to broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62711->52.10.176.85:9092: write: broken pipe
(Memory: 67725656 GoRoutines: 466)
DEBU [16:58:53] client/brokers deregistered broker #4 at b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 46751904 GoRoutines: 466)
DEBU [16:58:53] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 46742352 GoRoutines: 466)
DEBU [16:58:53] client/metadata fetching metadata for all topics from broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 46742480 GoRoutines: 467)
DEBU [16:58:54] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 38986488 GoRoutines: 467)
DEBU [16:58:54] SASL authentication successful with broker b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 38988712 GoRoutines: 467)
DEBU [16:58:54] Connected to broker at b24-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #24)
(Memory: 38990656 GoRoutines: 467)
DEBU [16:58:55] client/brokers registered new broker #4 at b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 39049616 GoRoutines: 467)
DEBU [16:58:55] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 39065104 GoRoutines: 467)
DEBU [16:58:55] client/metadata fetching metadata for all topics from broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 39068104 GoRoutines: 469)
DEBU [16:58:56] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 39195600 GoRoutines: 468)
DEBU [16:58:56] SASL authentication successful with broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 39197896 GoRoutines: 468)
DEBU [16:58:56] Connected to broker at b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #4)
(Memory: 39199840 GoRoutines: 468)
DEBU [16:58:57] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
(Memory: 39274504 GoRoutines: 468)
DEBU [16:58:57] client/metadata fetching metadata for all topics from broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 39277408 GoRoutines: 470)
DEBU [16:58:58] Successful SASL handshake. Available mechanisms: [PLAIN OAUTHBEARER]
(Memory: 39404848 GoRoutines: 469)
DEBU [16:58:59] SASL authentication successful with broker b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092:4 - [0 0 0 0]
(Memory: 40461160 GoRoutines: 469)
DEBU [16:58:59] Connected to broker at b5-pkc-pgq85.us-west-2.aws.confluent.cloud:9092 (registered as #5)
(Memory: 40463104 GoRoutines: 469)
DEBU [16:58:59] client/metadata fetching metadata for all topics from broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40501200 GoRoutines: 469)
DEBU [16:58:59] client/metadata got error from broker 4 while fetching metadata: write tcp 172.0.74.2:62850->44.224.184.152:9092: write: broken pipe
(Memory: 40504120 GoRoutines: 469)
DEBU [16:58:59] Error while closing connection to broker b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62850->44.224.184.152:9092: write: broken pipe
(Memory: 40506672 GoRoutines: 468)
DEBU [16:58:59] client/brokers deregistered broker #4 at b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40509432 GoRoutines: 468)
DEBU [16:58:59] client/metadata fetching metadata for all topics from broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40511320 GoRoutines: 468)
DEBU [16:58:59] client/metadata got error from broker 9 while fetching metadata: write tcp 172.0.74.2:62609->44.240.33.34:9092: write: broken pipe
(Memory: 40514224 GoRoutines: 468)
DEBU [16:58:59] Error while closing connection to broker b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092: tls: failed to send closeNotify alert (but connection was closed anyway): write tcp 172.0.74.2:62609->44.240.33.34:9092: write: broken pipe
(Memory: 40516760 GoRoutines: 467)
DEBU [16:58:59] client/brokers deregistered broker #9 at b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40518944 GoRoutines: 467)
DEBU [16:58:59] client/metadata fetching metadata for all topics from broker b0-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40520832 GoRoutines: 467)
DEBU [16:58:59] client/brokers registered new broker #9 at b9-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40557560 GoRoutines: 467)
DEBU [16:58:59] client/brokers registered new broker #4 at b4-pkc-pgq85.us-west-2.aws.confluent.cloud:9092
(Memory: 40559216 GoRoutines: 467)
Problem Description
In our logs we could see when there is a request to publish to a topic, there are some go-routines that are started which are also mentioned in sarama (https://github.com/Shopify/sarama/wiki/Reading-Backtraces) but after around 8 minutes there is some meta-data refresh which is increasing number of goroutines by 45-50 everytime and those goroutines are not closing as well, which we believe is the reason why our application has so much higher number of goroutines.
Below are the goroutines which were there during publishing:
Also not sure about these two goroutines github.com/Shopify/sarama.(*syncProducer).handleSuccesses(0x0?) and github.com/Shopify/sarama.(*syncProducer).handleErrors(0x10000?)
Can you tell how to decrease these spikes in number of goroutines. Any help would be appreciated.
Thank you for taking the time to raise this issue. However, it has not had any activity on it in the past 90 days and will be closed in 30 days if no updates occur. Please check if the main branch has already resolved the issue since it was raised. If you believe the issue is still valid and you would like input from the maintainers then please comment to ask for it to be reviewed.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
This isn’t something that would be expected in normal behaviour and we have made a large overhaul in Sarama since v1.40 onwards so we would ideally need someone to report seeing an issue like this in a recent version and be able to provide logs and context to help narrow down what might be causing it if there is still a problem
Thank you for taking the time to raise this issue. However, it has not had any activity on it in the past 90 days and will be closed in 30 days if no updates occur. Please check if the main branch has already resolved the issue since it was raised. If you believe the issue is still valid and you would like input from the maintainers then please comment to ask for it to be reviewed.