tomchlee

> Adding [@shwetathareja](https://github.com/shwetathareja) [@sachinpkale](https://github.com/sachinpkale) [@Bukhtawar](https://github.com/Bukhtawar) to please take a look and provide some insights. [@tomchlee](https://github.com/tomchlee) is there way this can be reproduced with some steps ? @prudhvigodithi I have updated...

We haven't tried upgrading to 2.19.1 as this symptom has only manifested itself in our production clusters which have indices of that size. We could look into upgrading to 2.19.1...

> [@tomchlee](https://github.com/tomchlee) this looks like an issue with stale shard deletion. It may require bouncing the OpenSearch process on data nodes as temporary mitigation in case it happen in your...

> [@tomchlee](https://github.com/tomchlee) If possible, I think it would be super helpful if you could get a thread dump when one of these threads is stuck in the active state ([jstack](https://www.baeldung.com/java-thread-dump#1-jstack)...

> Thanks for reporting the issue [@tomchlee](https://github.com/tomchlee). I have couple of questions: > > 2. Can you share the exact command for the update repository that led to list snapshot...

After upgrading our lab clusters to 2.19.1, "Connection pool shut down" issue no longer occurs.

We have upgraded production clusters that were exhibiting snapshot deletion thread count stuck at non-zero to version 2.19.1 but the stuck thread count behavior is still occurring.

@ashking94 that is the only type of log lines i see that were snapshot related. there was nothing about what caused the failed to delete.

> > [@ashking94](https://github.com/ashking94) that is the only type of log lines i see that were snapshot related. there was nothing about what caused the failed to delete. > > Are...

> Hi [@tomchlee](https://github.com/tomchlee), are you still seeing the issue? If so, can you tell share the debug logs? @ashking94 we're still seeing same issue on both 2.18.0 and 2.19.1 with...