qdrant-web-ui icon indicating copy to clipboard operation
qdrant-web-ui copied to clipboard

Add support for WASM based tSNE

Open J16N opened this issue 6 months ago • 0 comments

This PR introduces support for data visualization using t-SNE, now accelerated by Rust for enhanced performance. Key features include:

  • Efficient Multithreading: Computation is optimized through multithreading, significantly improving processing speed.
  • On-Demand Rendering: Implements "on-demand rendering" as outlined in the original proposal.
  • Pre-computed Distance Matrix Support: Added functionality to accept a pre-computed distance matrix as input, producing lower-dimensional vectors as output.
  • Performance Enhancements: Utilizes SharedArrayBuffer to efficiently transfer results from worker thread to the main thread, further boosting performance.

J16N avatar Aug 14 '24 10:08 J16N