Aliaksandr Valialkin

Results 626 comments of Aliaksandr Valialkin

> I'd love to see snapshots be able to be written directly to S3 or GCS. One step backup and truncation of data. Unfortunately this isn't easy as it sounds....

> Yes, exactly @MaxDiOrio that's what I'm looking for because I'd like to test this project in a Kubernetes or with (high) scalability context without having to do stateful. It...

It shouldn't be too hard to store VictoriaMetrics' data in object storage if the storage supports the following operations: 1) Streaming writing to a file without limits on file size....

There is yet another approach for adding ability to use Object Storage as a store for VictoriaMetrics data: to write a thin layer between file API and Object Storage API,...

There should be native functionality implemented for each supported protocol. Probably https://github.com/minio/minio-go could simplify the integration.

FYI, there is [vmbackup](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmbackup/README.md) tool for full and incremental backups of VictoriaMetrics data on S3 and GCS. The tool will be included into the next VictoriaMetrics release. Now it can...

Published an article about `vmbackup` tool - https://medium.com/@valyala/speeding-up-backups-for-big-time-series-databases-533c1a927883

https://objectivefs.com/ looks promising for transparently storing VictoriaMetrics data on object storage such as S3, GCS or various s3-compatible on-prem systems.

[Streaming aggregation](https://docs.victoriametrics.com/stream-aggregation/) is usually used as a replacement for [recording rules](https://docs.victoriametrics.com/vmalert/#recording-rules). It is important to understand that the `interval` option at [stream aggregation config](https://docs.victoriametrics.com/stream-aggregation/#stream-aggregation-config) must be equal to the `interval`...

FYI, the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6547 should reduce the probability of unexpectedly high [`histogram_quantile()`](https://docs.victoriametrics.com/metricsql/#histogram_quantile) values when streaming aggregation generates unaligned histogram buckets.