Giedrius Statkevičius

I think it's in part due to https://github.com/prometheus/prometheus/issues/11882. (1) idea there is feasible. Let me try to upstream something.

I wonder how we could reproduce this locally ourselves :thinking:

What storage providers are you using? AWS S3 or some other implementation?

I had a similar idea. We could use this https://github.com/cristalhq/hedgedhttp HTTP client to implement this. Just before that, we could make it better by estimating the 90th percentile and automatically...

@Vanshikav123 sure. https://github.com/cristalhq/hedgedhttp/pull/52 that client now supports dynamic thresholds/durations so shouldn't be too hard to implement with t-digest :thinking:

Please submit everything through the LFX website 😊

Implemented a PoC for this, works really well. A few caveats: - `tenant` in Receiver HTTP metrics is embedded into the `http.Handler` so now what I see is that everything...

Yeah, sorry for the confusion 🤦 hedging between two different systems doesn't make sense. Cache operations are supposed to be ultra fast. I believe the original issue is that with...

@verejoel check out https://github.com/thanos-io/thanos/pull/7256

I've personally seen this problem come up time and time again. But this sounds like a bug in `minio-go` - it returns success whereas the uploading fails. I wonder if...