libTLDA icon indicating copy to clipboard operation
libTLDA copied to clipboard

Published 20 hours ago • verified publisher icon wmkouw

Need too much memory？

Open yanshuaibupt opened this issue 4 years ago • 1 comments

X: memory usage: 705.4+ MB, Z: memory usage: 350.5+ MB, I encountered this error ( MemoryError: Unable to allocate 1010. GiB for an array with shape (368104, 368104) and data type float64 ) when I use tca, How to solve this problem？Looking forward to your reply.

yanshuaibupt avatar Jun 18 '20 01:06 yanshuaibupt

You have too many samples. TCA is a kernel-based method, meaning its memory cost is quadratic+. The standard approach is to subsample your data; take every 10th, 100th or 1000th sample.

wmkouw avatar Jul 02 '20 19:07 wmkouw