fluvio-connectors icon indicating copy to clipboard operation
fluvio-connectors copied to clipboard

HTTP connector restarts showing duplicate `star` values in #alerts channel

Open ajhunyady opened this issue 2 years ago • 0 comments

Take a look at the #alerts channel in slack. You'll see duplicate numbers at various intervals (sometimes twice a day, other times every few days):

fluvio-stars-bot APP [10:08 AM] Fluvio Github Star count is now 1311
fluvio-stars-bot APP  [2:50 PM] Fluvio Github Star count is now 1311

Based on @morenol's logs, the connector restarts:

morenol@fischer k8-metadata-client % kubectl get pods
NAME                                    READY   STATUS    RESTARTS      AGE
cat-facts-85b4bb79bf-k4j8c              1/1     Running   0             18d
fluvio-sc-5b89fb89fd-ccvqj              1/1     Running   0             23d
fluvio-spg-main-0                       1/1     Running   0             23d
github-stars-input-655d75d489-rf7kd     1/1     Running   1 (10m ago)   18d
github-stars-output-5fd9977f85-8x75n    1/1     Running   0             18d
http-random-cat-facts-fc868f667-d5g2s   1/1     Running   0             18d
2022-08-15T14:12:04.354913Z  INFO http: Initializing HTTP connector
2022-08-15T14:12:04.354946Z  INFO http: interval=30 method=GET topic=github-stars output_parts=body output_type=text endpoint=https://api.github.com/repos/infinyon/fluvio
2022-08-15T14:12:04.372172Z  INFO fluvio::config::tls: Using verified TLS with certificates from paths domain="steep-poetry-c18d25004294c1261cd9b5fdefd7a353.c.cloud.fluvio.io"
2022-08-15T14:12:04.449287Z  INFO connect: fluvio::sockets: connect to socket add=fluvio-sc-public:9003
2022-08-15T14:12:04.459374Z  INFO connect:connect_with_config: fluvio::config::tls: Using verified TLS with certificates from paths domain="steep-poetry-c18d25004294c1261cd9b5fdefd7a353.c.cloud.fluvio.io"
2022-08-15T14:12:04.527666Z  INFO connect:connect_with_config:connect: fluvio::sockets: connect to socket add=fluvio-sc-public:9003
2022-08-15T14:12:04.533181Z  INFO dispatcher_loop{self=MultiplexDisp(13)}: fluvio_socket::multiplexing: multiplexer terminated
2022-08-15T14:12:04.588256Z  INFO stream:stream_with_config:inner_stream_batches_with_config:request_stream{offset=Offset { inner: FromEnd(1) }}:create_serial_socket:create_serial_socket_from_leader{leader_id=0}:connect_to_leader{leader=0}:connect: fluvio::sockets: connect to socket add=fluvio-spg-main-0.fluvio-spg-main:9005
2022-08-15T14:12:05.029581Z  INFO http: Connected to Fluvio
2022-08-15T14:12:05.280354Z ERROR dispatcher_loop{self=MultiplexDisp(13)}: fluvio_socket::multiplexing: error sending to socket, problem sending to queue socket: 5, err: sending into a closed channel
2022-08-15T14:12:05.280393Z ERROR dispatcher_loop{self=MultiplexDisp(13)}: fluvio_socket::multiplexing: error sending to socket, no socket receiver founded for id: 2, abandoning sending
2022-09-02T21:45:14.949221Z  INFO run: fluvio::producer::partition_producer: partition producer end event received
2022-09-02T21:45:14.949248Z  INFO run: fluvio::producer::partition_producer: partition producer end
2022-09-02T21:45:14.949401Z  INFO dispatcher_loop{self=MultiplexDisp(9)}: fluvio_socket::multiplexing: multiplexer terminated
Error: Request(reqwest::Error { kind: Request, url: Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("api.github.com")), port: None, path: "/repos/infinyon/fluvio", query: None, fragment: None }, source: hyper::Error(IncompleteMessage) })

Please investigate the cause of the failure.

ajhunyady avatar Sep 02 '22 23:09 ajhunyady