torch-interpol icon indicating copy to clipboard operation
torch-interpol copied to clipboard

Published 20 hours ago • verified publisher icon balbasty

Fallback of jit compilation

Open MBPhys opened this issue 2 years ago • 3 comments

Hi,

first of all, congratulation to this amazing project :smile: Unfortunately the jit compilation doesn't work. There is a fallback.

image

It seems that the Bound_class is the problem, because it is not a tensor directly.

Do you have an idea how we can fix them?

Best regards

Marc

MBPhys avatar Aug 05 '22 10:08 MBPhys

Hi Marc

Thanks for reporting this. Could you please tell me which version of PyTorch (and which platform) you are using?

(edit: and how you call the function: inputs, etc)

Thanks Yael

balbasty avatar Aug 09 '22 17:08 balbasty

This issue seems to be related to https://github.com/pytorch/pytorch/issues/82889 It only happens in recent versions of pytorch (I reproduced it on 1.12, but I don't know when it was introduced).

In the meantime, the suggested workaround (set the environment variable PYTORCH_JIT_USE_NNC_NOT_NVFUSER=1) seems to work. I could set it from inside torch-interpol (on import) but I am not sure it's the best solution.

balbasty avatar Sep 02 '22 18:09 balbasty

Too add, I also was having some issues with NVFUSER but torch 2.0.X seems to have fixed whatever the issue was.

ZacharyVarley avatar Aug 31 '23 13:08 ZacharyVarley