tomotopy icon indicating copy to clipboard operation
tomotopy copied to clipboard

Published 20 hours ago • verified publisher icon bab2min

Bad Allocation using DTModel

Open jlevy44 opened this issue 3 years ago • 5 comments

Hi there, I am running into an issue right now when following dtm.py. My jupyter notebook returns:

RuntimeError: bad allocation

when attempting to training the model.

Document loading appears to be okay, but not sure why this is happening. Are there some expensive array initializations? Thanks!

jlevy44 avatar Sep 23 '21 20:09 jlevy44

Removed DTModel and replaced with LDAModel and worked just fine.

jlevy44 avatar Sep 23 '21 20:09 jlevy44

Can you please assist with DTModel? Is anyone running into this issue?

jlevy44 avatar Sep 30 '21 16:09 jlevy44

Hi @jlevy44 Sorry for late reply. Could you share more detail about your environment including OS, Python version and tomotopy version?

bab2min avatar Sep 30 '21 17:09 bab2min

I'll get back to you, as this is work with a collaborator. Do you have any tips of things to try when this happens?

jlevy44 avatar Jan 23 '22 17:01 jlevy44

Hi @jlevy44 bad_alloc exception is thrown usually when the memory allocation is failed. But I think system memory is enough to train DTM in most of use case. So we need to determine if this problem is due to an unusual case that requires a lot of memory, or a case where the system memory is very low, or if it is a memory allocation bug in tomotopy. If you could share a minimal reproducible piece of code or data, it would be helpful in finding out the cause.

bab2min avatar Jan 24 '22 16:01 bab2min