JittorLLMs icon indicating copy to clipboard operation
JittorLLMs copied to clipboard

module 'jittor.nn' has no attribute 'SiLU'

Open lzg188 opened this issue 1 year ago • 2 comments

python JittorLLMs/models/qwen2/main.py 报错。

[i 0224 11:34:33.960974 56 compiler.py:956] Jittor(1.3.8.5) src: /opt/conda/envs/jittor/lib/python3.10/site-packages/jittor [i 0224 11:34:33.982588 56 compiler.py:957] g++ at /usr/bin/g++(9.4.0) [i 0224 11:34:33.982730 56 compiler.py:958] cache_path: /root/.cache/jittor/jt1.3.8/g++9.4.0/py3.10.16/Linux-5.15.0-1x25/IntelRXeonRGolx38/default [i 0224 11:34:34.002127 56 init.py:411] Found nvcc(11.8.89) at /usr/local/cuda/bin/nvcc. [i 0224 11:34:34.019441 56 init.py:411] Found addr2line(2.34) at /usr/bin/addr2line. [i 0224 11:34:34.475528 56 compiler.py:1011] cuda key:cu11.8.89_sm_75_89 [i 0224 11:34:35.005984 56 init.py:227] Total mem: 991.77GB, using 16 procs for compiling. [i 0224 11:34:35.136715 56 jit_compiler.cc:28] Load cc_path: /usr/bin/g++ [i 0224 11:34:35.400391 56 init.cc:62] Found cuda archs: [89,75,] [i 0224 11:34:35.527280 56 init.py:411] Found mpicc(4.1.5) at /usr/local/mpi/bin/mpicc. [w 0224 11:34:35.689088 56 compile_extern.py:203] CUDA related path found in LD_LIBRARY_PATH or PATH(['/opt/conda/lib/python3.8/site-packages/torch/lib', '/opt/conda/lib/python3.8/site-packages/torch_tensorrt/lib', '/usr/local/cuda/compat/lib', '/usr/local/nvidia/lib', '/usr/local/nvidia/lib64', '/usr/local/nvm/versions/node/v16.15.1/bin', '/usr/local/nvm/versions/node/v16.15.1/bin', '/root/.vscode-server/bin/33fc5a94a3f99ebe7087e8fe79fbe1d37a251016/bin/remote-cli', '/opt/conda/envs/jittor/bin', '/opt/conda/condabin', '/usr/local/nvm/versions/node/v16.15.1/bin', '/opt/conda/lib/python3.8/site-packages/torch_tensorrt/bin', '/opt/conda/bin', '/usr/local/mpi/bin', '/usr/local/nvidia/bin', '/usr/local/cuda/bin', '/usr/local/sbin', '/usr/local/bin', '/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/ucx/bin', '/opt/tensorrt/bin', '/root/.vscode-server/bin/33fc5a94a3f99ebe7087e8fe79fbe1d37a251016/bin/remote-cli', '/opt/conda/bin', '/opt/conda/condabin', '/usr/local/nvm/versions/node/v16.15.1/bin', '/opt/conda/lib/python3.8/site-packages/torch_tensorrt/bin', '/opt/conda/bin', '/usr/local/mpi/bin', '/usr/local/nvidia/bin', '/usr/local/cuda/bin', '/usr/local/sbin', '/usr/local/bin', '/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/ucx/bin', '/opt/tensorrt/bin']), This path may cause jittor found the wrong libs, please unset LD_LIBRARY_PATH and remove cuda lib path in Path. Or you can let jittor install cuda for you: python3.x -m jittor_utils.install_cuda [i 0224 11:34:36.040282 56 cuda_flags.cc:49] CUDA enabled. Traceback (most recent call last): File "/LocalRun/zhiguo.li/JittorLLMs/./models/qwen2/main.py", line 70, in main() File "/LocalRun/zhiguo.li/JittorLLMs/./models/qwen2/main.py", line 13, in main model = Qwen2ForCausalLM() File "/LocalRun/zhiguo.li/JittorLLMs/models/qwen2/qwen2_jt/modeling_qwen2.py", line 476, in init self.model = Qwen2Model(config) File "/LocalRun/zhiguo.li/JittorLLMs/models/qwen2/qwen2_jt/modeling_qwen2.py", line 411, in init [Qwen2DecoderLayer(config, layer_idx) for layer_idx in range(config.num_hidden_layers)] File "/LocalRun/zhiguo.li/JittorLLMs/models/qwen2/qwen2_jt/modeling_qwen2.py", line 411, in [Qwen2DecoderLayer(config, layer_idx) for layer_idx in range(config.num_hidden_layers)] File "/LocalRun/zhiguo.li/JittorLLMs/models/qwen2/qwen2_jt/modeling_qwen2.py", line 257, in init self.mlp = Qwen2MLP(config) File "/LocalRun/zhiguo.li/JittorLLMs/models/qwen2/qwen2_jt/modeling_qwen2.py", line 130, in init self.act_fn = nn.SiLU() AttributeError: module 'jittor.nn' has no attribute 'SiLU'

lzg188 avatar Feb 24 '25 11:02 lzg188

依赖的环境都已安装 pip list | grep torch jtorch 0.1.7 torch 2.0.0 torchvision 0.15

lzg188 avatar Feb 24 '25 11:02 lzg188

您好,请问您解决了么

AbyssGio avatar Apr 19 '25 09:04 AbyssGio