vald icon indicating copy to clipboard operation
vald copied to clipboard

[Impl] SwissMap wrapper library for large scale data

Open vankichi opened this issue 4 months ago • 0 comments

Is your feature request related to a problem? Please describe.:

Increasing the number of indexes in Vald can significantly increase Agent memory requirements, leading to higher infrastructure costs when handling large-scale data. To optimize resource usage and maintain performance, we've enabled SwissMap.

Describe the solution you'd like:

Introducing SwissMap

Describe alternatives you've considered:

  • Implement a wrapper to use SwissMap with Vald
  • Prepare options for using SwissMap (including Helm)
  • Run performance tests and output the differences

vankichi avatar Sep 30 '24 08:09 vankichi