documentation-website icon indicating copy to clipboard operation
documentation-website copied to clipboard

[DOC] k-NN Clear Cache API

Open naveentatikonda opened this issue 2 years ago • 10 comments
trafficstars

What do you want to do?

  • [ ] Request a change to existing documentation
  • [x] Add new documentation
  • [ ] Report a technical problem with the documentation
  • [ ] Other

Tell us about your request. Provide a summary of the request and all versions that are affected. As of today, we don’t have an API to evict a given K-NN index out of native memory. Currently, the possible ways to clear indices out of the cache is by either deleting the index or by setting a couple of knn cluster settings which will remove the indices out of cache if they are idle for a given amount of time.

Adding this external API will help users to clear the cache of their k-NN indices by themselves. As of now, we are planning to release this feature in v2.12 or later due to AppSec.

What other resources are available? Provide links to related issues, POCs, steps for testing, etc. https://github.com/opensearch-project/k-NN/issues/333

naveentatikonda avatar Jun 15 '23 18:06 naveentatikonda

Moved to 2.11 per SME

kolchfa-aws avatar Aug 21 '23 15:08 kolchfa-aws

Please change the label to v2.12

naveentatikonda avatar Oct 02 '23 22:10 naveentatikonda

Will add new release label once we have clarity on the release for this feature

vamshin avatar Oct 05 '23 02:10 vamshin

From Naveen: This feature still needs to go through AppSec and it is not getting prioritized by AppSec engineers due to ReInvent. Might go in 2.12 or will be postponed to future releases.

hdhalter avatar Oct 24 '23 17:10 hdhalter

Tagging as 2.12 just in case.

hdhalter avatar Oct 26 '23 19:10 hdhalter

Vamshi confirmed that this is not 2.12.

hdhalter avatar Nov 07 '23 00:11 hdhalter

@vamshin - Confirming that this going out in 2.13? The associated issue has 2.13 as the release train. Thanks!

hdhalter avatar Mar 06 '24 00:03 hdhalter

@hdhalter This feature won't be released in 2.13 due to pending AppSec review. Please change the label to 2.14 for now. Thanks!

naveentatikonda avatar Mar 06 '24 01:03 naveentatikonda

Hi @naveentatikonda - Is this feature going in 2.14?

hdhalter avatar Apr 24 '24 23:04 hdhalter

Hi @naveentatikonda - Is this feature going in 2.14?

yes @hdhalter. I will create the PR for documentation by Friday. Thanks!

naveentatikonda avatar Apr 25 '24 00:04 naveentatikonda