tsai icon indicating copy to clipboard operation
tsai copied to clipboard

output nan

Open CHonChou opened this issue 2 years ago • 1 comments

image

Hi, when I train the regression model using tsai, I get nan output on my own data, but when I change the arch to TSTPlus the result is normal again. Looking forward to receiving your reply!

CHonChou avatar Aug 30 '22 15:08 CHonChou

What about InceptionTimePlus?

vrodriguezf avatar Sep 05 '22 15:09 vrodriguezf

it happens to me when i set the device="cpu"
(i need to set it to cpu - because of the MPSNDArray.mm:782: failed assertion `[MPSNDArray, initWithBuffer:descriptor:] Error: buffer is not large enough. Must be 486400 bytes)

123mitnik avatar Oct 10 '22 21:10 123mitnik

Hi @123mitnik, I've never seen that issue before. Could you please post a short code snippet to try and reproduce this error?

oguiza avatar Oct 21 '22 13:10 oguiza

@oguiza Hi Ignacio,

This is from pytorch. So, it has nothing to do with tsai - https://github.com/pytorch/pytorch/issues/86152

This is just because I can't run it with the nightly build of pytorch (where m1 apple silicon is supported). Tsai is not yet compatible with it (some printing issues - but I never had time to dig into it), so i'm running it on CPU. As for the @CHonChou issue - the nans may be coming from -inf values or nan inside the dataset.

123mitnik avatar Oct 21 '22 13:10 123mitnik

Once Pytorch and fastai fully support the new apple chips we'll make tsai compatible as well. But I'm afraid there's not much we can do for now.

oguiza avatar Dec 07 '22 09:12 oguiza