OpenSearch

OpenSearch copied to clipboard

[BUG] illegal state: trying to move shard from primary mode to replica mode (Index-type: remote_snapshot)

2

### Describe the bug During restart, OpenSearch appears to attempt to relocate the Primary-shard of a `remote_snapshot` type Index and fails. This might be an instance of the problem mentioned...

etgraylog

[Feature Request] Make use of dynamic pruning for faster cardinality aggregations

4

### Is your feature request related to a problem? Please describe Dynamic pruning algorithms work by dynamically adding negating filters into the query as disjunctions which are non-competitive( or found...

rishabhmaurya

[Feature Request] [Segment Replication] Balanced primary count across all nodes during rebalancing

9

### Is your feature request related to a problem? Please describe Currently in our system, we only have [contraint](https://github.com/opensearch-project/OpenSearch/blob/a0b519826b2dab19f022e16e613f630a0bce253e/server/src/main/java/org/opensearch/cluster/routing/allocation/RebalanceConstraints.java#L32) for the primary shards rebalance at an index level which was...

Arpit-Bandejiya

### Describe the bug org.opensearch.transport.RemoteClusterClientTests.testConnectAndExecuteRequest seems to be able to get network exceptions during this workflow ``` 2> junit.framework.AssertionFailedError: Unexpected exception type, expected ActionNotFoundTransportException but got NodeDisconnectedException[[remote_node][127.0.0.1:10600][indices:data/read/scroll] disconnected] at org.apache.lucene.tests.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2894)...

peternied

[BUG] [Snapshot Interop] Optimize batch async blob cleanup during snapshot deletion for remote store enabled indices.

1

### Describe the bug Currently, During snapshot deletion we asynchronously try to cleanup shard blobs by creating batches of 1000 blobs at a time. If the index is remote store...

harishbhakuni

[BUG] org.opensearch.index.shard.SegmentReplicationWithNodeToNodeIndexShardTests.testReplicaClosesWhileReplicating_AfterGetCheckpoint is flaky

1

### Describe the bug The test case `org.opensearch.index.shard.SegmentReplicationWithNodeToNodeIndexShardTests.testReplicaClosesWhileReplicating_AfterGetCheckpoint` is flaky: ``` org.opensearch.index.shard.SegmentReplicationWithNodeToNodeIndexShardTests.testReplicaClosesWhileReplicating_AfterGetCheckpoint java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1} at __randomizedtesting.SeedInfo.seed([F01091562017B4DF:6D7E22AC42A8EDFB]:0) at org.apache.lucene.tests.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:876) at org.apache.lucene.store.FilterDirectory.close(FilterDirectory.java:111) at...

reta

### Is your feature request related to a problem? Please describe - During snapshot restore, individual shards can fail during restore, leading to red index. - Although the index is...

linuxpi

[BUG] Remote Purge threadpool taking too much memory in case of too much deleted indices cleanup

2

### Describe the bug  We use `Remote Purge` threadpool to delete segments data for deleted indices in shallow snapshots. When the number of such indices are huge, as...

gbbafna

### Is your feature request related to a problem? Please describe To enable migration of document replication clusters to remote store backed clusters, we will need to allow mixed mode...

gbbafna

### Describe the bug The test case `org.opensearch.snapshots.CloneSnapshotIT.testCloneSnapshotIndex` is flaky: ``` org.opensearch.snapshots.CloneSnapshotIT.testCloneSnapshotIndex java.lang.AssertionError: java.lang.AssertionError: Expected: a value less than or equal to but: was greater than at __randomizedtesting.SeedInfo.seed([96FFD5CDDE9CB328:31772ABECCB3C59F]:0) at org.opensearch.repositories.blobstore.BlobStoreTestUtil.assertConsistency(BlobStoreTestUtil.java:154)...

reta