lzfhust
lzfhust
此外,在ReadThriftStruct的时候,是不是得try-catch一下?我们发现,client在ProcessThriftResponse的时候,有可能会出现ReadThriftStruct的exception,进而导致core。
We debug this problem and find out that this case could be fixed by using writeRequestCtxPool in sendStaleSeries function. So we commit a pull request: https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3669
> @lzfhust , see also the follow-up commit [68463c9](https://github.com/VictoriaMetrics/VictoriaMetrics/commit/68463c9e87303a587a9af1d054aa32c9efeae31a) , which should further reduce memory usage spikes when big number of scrape targets disappear at once. It limits the number...
> Both improvements - [d79f1b1](https://github.com/VictoriaMetrics/VictoriaMetrics/commit/d79f1b106c2fd60d8760419fc4acb57d39cfd1c2) and [68463c9](https://github.com/VictoriaMetrics/VictoriaMetrics/commit/68463c9e87303a587a9af1d054aa32c9efeae31a) - have been included in [vmagent v1.86.2](https://github.com/VictoriaMetrics/VictoriaMetrics/releases). @lzfhust , could you confirm that `vmagent v1.86.2` doesn't have memory spikes when big number of...
> I'm guessing the series record is missing from the WAL but there are still sample records. > > Are you passing any flags to the agent mode to customize...
> Can you try deleting the WAL used by the agent and seeing if this happens again? @rfratto I have already tried this again, and this happened again.
> How quickly is it happening from process start time without an existing WAL in place? It is a little strange. There are two prometheus agent to scrape metrics. One...
Now, it looks like in appending data to wal, the series data may be missing while the sample data is ok? But how can it be? In the commit, the...
> > > This is my start up command: @rfratto /bin/prometheus --config.file=/prometheus/prometheus-hash.yml --enable-feature=agent --web.listen-address=:9090 --web.enable-lifecycle --web.enable-admin-api --enable-feature=new-service-discovery-manager --enable-feature=extra-scrape-metrics --enable-feature=expand-external-labels --enable-feature=auto-gomaxprocs > > Hi @lzfhust, would you mind sharing the contents...