Ganesh Vernekar

Looking at the links you shared, looks like the error is in the last file, where the file is empty. That is something Prometheus can recover from reliably. (If it...

Goes without saying: patches welcome! Pointers: https://github.com/prometheus/prometheus/blob/409a5e792287ec09621e4811a898f1949895f4d2/tsdb/chunks/head_chunks.go#L312-L318 Here, if it is _the last file_ and either the first check errors out OR The magic number is 0, we close and...

@colega thank you for working on this! Your approach is definitely promising and worth exploring. I will take a look at open question in coming days. @gouthamve you had mentioned...

We at Grafana Labs are planning to invest some time at building a solution for this, something along the lines @colega described above. We will propose a design for this...

Last time I discussed, it was about ingesting parallel out of order stream with each stream getting samples in order (maintained per series). So it could be years old as...

We (@jesusvazquez, @Dieterbe, @codesome) are currently working on a MVP for this as part of [Mimir](https://github.com/grafana/mimir). Our ongoing work lives in the [`out-of-order` branch of `grafana/mimir-prometheus`](https://github.com/grafana/mimir-prometheus/tree/out-of-order) (still in early stages,...

An update: We have [the design doc](https://docs.google.com/document/d/1Kppm7qL9C-BJB1j6yb6-9ObG3AbdZnFUBYPNNWwDBYM/edit?usp=sharing) implemented and working in [this branch](https://github.com/grafana/mimir-prometheus/tree/out-of-order). We have tested it in our dev env via Mimir for a few weeks now. We will...

We are not planning to support isolation in the first iteration since the out of order support without isolation itself is a little complex. We will take a dig at...

https://github.com/prometheus/prometheus/pull/11075 👀🔥

Oh, ignore my above comment. I see what you did with series creation. Not all happens in the sharded goroutine.