Donny Bertucci
Donny Bertucci
Awesome!
and option to change scale (like log scale)? Idk adding scale too might be too many options
Hmm good thought. I like the idea with the distill functions.
Yeah but for stuff that needs the full data to compute, we would need a different system. Like tsne could not work on distill unless we allow people to define...
Depending on the data format yeah disk space would not be too bad. Sidenote: it could be better to use parquet when caching columns for that [extra compression](https://youtube.com/watch?v=u4rsA5ZiTls&feature=shares&t=721).
I do like your idea. I think I'll give that a shot next.
There is also something else to think about: should users be able to mess with tsne parameters (like perplexity)? Should the user be able to recompute tsne? Given how [different...
Also if there dataset is too large and tsne ends up taking the eternities, what then? That would favor our current method where they can just load one tsne instead...
Shoot ran into a separate issue: In a separate project the embedding-atlas workers are being blocked by Cross-Origin-Embedder-Policy. If you have any tips, would be very thankful! update: can solve...
Oh I see. yeah It's probably because I'm running bun workspaces so the worker file is outside the scope of the vite server (node_modules in parent) so my browser thinks...