Mohammad Tariqul Islam
Mohammad Tariqul Islam
Thanks. I will try pynndescent. I also think it overflows memory. I tried to compute an accurate nearest neighbor matrix for this data and observed crashing. The following overflows memory:...
I'm not sure if this is correct, if you are running two UMAP instances one after another, some memory from previous instances may still be occupied. But chance of this...
Also, you may check whether the issue is happening in UMAP or pynndescent. pynndescent is sometimes dataset dependent. I vaguely remember a twitter thread regarding this.