Bukhtawar Khan

@Hronom Thanks for opening this issue. To better understand your use case, have you looked at below ctor for `SearchRequest` https://github.com/opensearch-project/OpenSearch/blob/62523702c15fc37822c3a31b4ad4d448363b76f8/server/src/main/java/org/opensearch/action/search/SearchRequest.java#L123-L130

I would avoid a polling service to start with, I gave a basic pass wondering how is this substantially different from a snapshot custom entry where different shards undergo snapshots...

There are more use case like Remote store using a metadata store and we really need to think about the store capabilities for instance optimistic concurrency control/conditional updates/transactions which is...

The major caveat in auto-recovering is cases around network partitioning and ensuring we don't have an isolated writer acknowledging write requests while we auto-recover the shard data on some other...

We'll need to try to repro here. I'll see if I can pick this up, any help from any community member would be of great help too

I'll try to see if I can repro..

Tagging the meta issue https://github.com/opensearch-project/OpenSearch/issues/8098 for better visibility.

Thanks for the proposal. @nknize @reta @VachaShah Just catching up have we evaluated [ION](https://github.com/amazon-ion/ion-java) as an alternative. Do we think we can run into problems with [large data](https://protobuf.dev/programming-guides/techniques/#large-data). The one...

Another one that I guess should be considered in favour of low garbage https://github.com/OpenHFT/Chronicle-Wire

Thanks Kunal, lets evaluate what are the current set of checksums we have today, for instance when all parts are completely downloaded but before we open the file we should...