apex icon indicating copy to clipboard operation
apex copied to clipboard

AttributeError: module 'torch.compiler' has no attribute 'is_compiling'

Open LukeLIN-web opened this issue 1 year ago • 6 comments

Describe the Bug

Minimal Steps/Code to Reproduce the Bug

.conda/envs/opensora/lib/python3.9/site-packages/apex/normalization/fused_layer_norm.py", line 412, in forward if torch.jit.is_tracing() or torch.jit.is_scripting() or torch.compiler.is_compiling() or not input.is_cuda: AttributeError: module 'torch.compiler' has no attribute 'is_compiling'

pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --config-settings "--build-option=--cpp_ext" --config-settings "--build-option=--cuda_ext" git+https://github.com/NVIDIA/apex.git I installed torch 2.2.2

Environment

apex 0.1
Versions of relevant libraries: [pip3] galore-torch==1.0 [pip3] numpy==1.26.4 [pip3] rotary-embedding-torch==0.5.3 [pip3] torch==2.2.2 [pip3] torchvision==0.17.2 [pip3] triton==2.2.0 [conda] galore-torch 1.0 pypi_0 pypi [conda] numpy 1.26.4 pypi_0 pypi [conda] rotary-embedding-torch 0.5.3 pypi_0 pypi [conda] torch 2.2.2 pypi_0 pypi [conda] torchvision 0.17.2 pypi_0 pypi [conda] triton 2.2.0 pypi_0 pypi

LukeLIN-web avatar Nov 15 '24 23:11 LukeLIN-web

I am also running in to this. I also had to had to upgrade diffusers to 0.31.0 to even get the models to download. But now when I try their multigpu example I run in to the "AttributeError: module 'torch.compiler' has no attribute 'is_compiling'" error

venom8898 avatar Nov 16 '24 11:11 venom8898

Instead of using the master, checking-out a previous tag (https://github.com/NVIDIA/apex/tree/24.04.01) before building, solved this for me.

kkahatapitiya avatar Nov 20 '24 01:11 kkahatapitiya

Instead of using the master, checking-out a previous tag (https://github.com/NVIDIA/apex/tree/24.04.01) before building, solved this for me. Have you solved this? Are you compiling apex packages before 24.01.01?

zyang6 avatar Nov 20 '24 03:11 zyang6

Yes, using the version with tag 24.01.01 (git checkout tags/24.01.01), and building from source solved this issue for me.

kkahatapitiya avatar Nov 20 '24 04:11 kkahatapitiya

Yes, using the version with tag 24.01.01 (git checkout tags/24.01.01), and building from source solved this issue for me.

Thank you !I'll give it a try

zyang6 avatar Nov 20 '24 05:11 zyang6

Yes, using the version with tag 24.01.01 (git checkout tags/24.01.01), and building from source solved this issue for me.

Correcting the typo: 24.04.01

yinghuozijin avatar Jan 23 '25 11:01 yinghuozijin