Deep-Kernel-GP icon indicating copy to clipboard operation
Deep-Kernel-GP copied to clipboard

Memory Error:

Open kroscek opened this issue 7 years ago • 1 comments

Hi. I have 64GB RAM UBUNTU

Not sure but when I'm trying to fit per column basis, I get an error: tmp=X[:,i].reshape(1,-1)-X[:,i].reshape(-1,1) MemoryError

My dataset shape is: (187630,14) numerical values The error refers to the code in : https://github.com/maka89/Deep-Kernel-GP/blob/cff31dd419c9e2da999afbe16320fd7f62c5f0ef/dknet/layers/dense.py#L127

kroscek avatar Feb 15 '18 07:02 kroscek

Thats a pretty big dataset to use the standard DKL... GP methods create a kernel matrix size (nxn). Typically no more than a couple thousand datapoints are used unless the big data approximations from for instance Wilsons paper are used.

maka89 avatar May 20 '18 20:05 maka89