influxdb-relay icon indicating copy to clipboard operation
influxdb-relay copied to clipboard

Wrong rp in influx write causing ingest issues

Open monitoringit opened this issue 6 years ago • 2 comments

A client was writing data to backend influxdbs through relay using wrong retention policy (rp). Both backend Influxdbs returned 5xx errors for it. Relay then kept accruing these data points in its buffer eventually filling the buffers and all other valid writes from other clients started failing.

This implies any bad player out there can impact filling up relay buffers...is there a way for relay to forget these errors and not keep them in memory. A human error on client side config can impact the whole relay by eventually choking up its memory.

It may be by design but want to confirm ....

monitoringit avatar Dec 19 '18 12:12 monitoringit

Hello @monitoringit you can find the reason here : https://github.com/vente-privee/influxdb-relay/blob/master/relay/retry.go#L65.

We're working on a fork, feel free to make issue / MR to help us improve the daemon.

rockyluke avatar Dec 20 '18 09:12 rockyluke

Discussion on the fork : https://github.com/vente-privee/influxdb-relay/issues/12

lucas-santoni avatar Dec 21 '18 10:12 lucas-santoni