fishaudio
undefined symbol
您好， 在推理的时候提示 /flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi， 怎么解决这个问题， 尝试pip uninstall flash-attn FLASH_ATTENTION_FORCE_BUILD=TRUE pip install flash-attn， 还是不可以
确保你装的cuda版本在12.1以上, pytorch装的版本和cuda版本一致，选择abi=FALSE的包体
您好，cuda更新到12.1， pytorch是2.3.0.dev20240217+cu121， 但是运行 python tools/llama/generate.py时候， 提示/usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status ， 执行nvcc -V 时候显示cuda是12.1
我需要更多的信息，比如截图、详细报错等 万分感谢， 运行tools/llama/generate.py 提示下面的错误。 2024-02-18 17:02:12.379 | INFO | main:main:413 - Loading model ... 2024-02-18 17:02:12.963 | INFO | main:load_model:359 - Restored model from checkpoint 2024-02-18 17:02:12.968 | INFO | main:main:419 - Time to load model: 0.59 seconds Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Building prefix dict from the default dictionary ... Loading model from cache /tmp/jieba.cache Loading model cost 0.532 seconds. Prefix dict has been built successfully. 2024-02-18 17:02:18.903 | INFO | main:main:439 - Encoded prompt shape: torch.Size([5, 823]) 0%| | 0/3272 [00:00<?, ?it/s]/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/backends/cuda/init.py:342: FutureWarning: torch.backends.cuda.sdp_kernel() is deprecated. In the future, this context manager will be removed. Please see, torch.nn.attention.sdpa_kernel() for the new context manager, with updated signature. warnings.warn( /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status //usrusr//binbin//ldld:: cannotcannot findfind -lcuda -lcuda collect2: error: ld returned 1 exit status collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status 0%| | 0/3272 [01:04<?, ?it/s] /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status Traceback (most recent call last): File "/media/user/96351a1e-7b15-4a2a-8126-53546427a74a/zqy_data/fish-speech/tools/llama/generate.py", line 491, in
main() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/click/core.py", line 1157, in call return self.main(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/click/core.py", line 1078, in main rv = self.invoke(ctx) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, **ctx.params) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/click/core.py", line 783, in invoke return __callback(*args, **kwargs) File "/media/user/96351a1e-7b15-4a2a-8126-53546427a74a/zqy_data/fish-speech/tools/llama/generate.py", line 454, in main y = generate( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/media/user/96351a1e-7b15-4a2a-8126-53546427a74a/zqy_data/fish-speech/tools/llama/generate.py", line 247, in generate x = decode_n_tokens( File "/media/user/96351a1e-7b15-4a2a-8126-53546427a74a/zqy_data/fish-speech/tools/llama/generate.py", line 182, in decode_n_tokens next_token = decode_one_token( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 455, in _fn return fn(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 912, in catch_errors return callback(frame, cache_entry, hooks, frame_state, skip=1) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 398, in _convert_frame_assert return _compile( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 669, in _compile guarded_code = compile_inner(code, one_graph, hooks, transform) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 542, in compile_inner out_code = transform_code_object(code, transform) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/bytecode_transformation.py", line 1033, in transform_code_object transformations(instructions, code_options) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 163, in _fn return fn(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 507, in transform tracer.run() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2130, in run super().run() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 793, in run and self.step() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 756, in step getattr(self, inst.opname)(inst) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2249, in RETURN_VALUE self.output.compile_subgraph( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 931, in compile_subgraph self.compile_and_call_fx_graph(tx, list(reversed(stack_values)), root) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 1102, in compile_and_call_fx_graph compiled_fn = self.call_user_compiler(gm) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 1175, in call_user_compiler raise BackendCompilerFailed(self.compiler_fn, e).with_traceback( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 1156, in call_user_compiler compiled_fn = compiler_fn(gm, self.example_inputs()) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/dynamo/repro/after_dynamo.py", line 117, in debug_wrapper compiled_gm = compiler_fn(gm, example_inputs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/dynamo/repro/after_dynamo.py", line 117, in debug_wrapper compiled_gm = compiler_fn(gm, example_inputs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/init.py", line 1730, in call return compile_fx(model, inputs, config_patches=self.config) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 1106, in compile_fx return compile_fx( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 1332, in compile_fx return aot_autograd( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/backends/common.py", line 57, in compiler_fn cg = aot_module_simplified(gm, example_inputs, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_functorch/aot_autograd.py", line 879, in aot_module_simplified compiled_fn = create_aot_dispatcher_function( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_functorch/aot_autograd.py", line 604, in create_aot_dispatcher_function compiled_fn = compiler_fn(flat_fn, fake_flat_args, aot_config, fw_metadata=fw_metadata) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/runtime_wrappers.py", line 434, in aot_wrapper_dedupe return compiler_fn(flat_fn, leaf_flat_args, aot_config, fw_metadata=fw_metadata) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/runtime_wrappers.py", line 639, in aot_wrapper_synthetic_base return compiler_fn(flat_fn, flat_args, aot_config, fw_metadata=fw_metadata) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/jit_compile_runtime_wrappers.py", line 97, in aot_dispatch_base compiled_fw = compiler(fw_module, updated_flat_args) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 1260, in fw_compiler_base return inner_compile( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/repro/after_aot.py", line 83, in debug_wrapper inner_compiled_fn = compiler_fn(gm, example_inputs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/debug.py", line 304, in inner return fn(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 426, in compile_fx_inner compiled_graph = FxGraphCache.load( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 759, in load compiled_graph = compile_fx_fn(gm, example_inputs, **fx_kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 698, in fx_codegen_and_compile compiled_fn = graph.compile_to_fn() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/graph.py", line 1226, in compile_to_fn return self.compile_to_module().call File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/graph.py", line 1178, in compile_to_module mod = PyCodeCache.load_by_key_path( File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 2081, in load_by_key_path exec(code, mod.dict, mod.dict) File "/tmp/torchinductor_user/xd/cxd43s3dgwih5pn5tnzehoc3vrgdmpn3ciha5h6pd5qdw6bgcke5.py", line 3003, in async_compile.wait(globals()) File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 2636, in wait scope[key] = result.result() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 2443, in result self.future.result() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/concurrent/futures/_base.py", line 458, in result return self.__get_result() File "/home/user/miniconda3/envs/fish-speech/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result raise self._exception torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised: CalledProcessError: Command '['/usr/bin/gcc', '/tmp/tmpxlxx_o80/main.c', '-O3', '-shared', '-fPIC', '-o', '/tmp/tmpxlxx_o80/cuda_utils.cpython-310-x86_64-linux-gnu.so', '-lcuda', '-L/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/triton/backends/nvidia/lib', '-I/home/user/miniconda3/envs/fish-speech/lib/python3.10/site-packages/triton/backends/nvidia/include', '-I/tmp/tmpxlxx_o80', '-I/home/user/miniconda3/envs/fish-speech/include/python3.10']' returned non-zero exit status 1.
Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information
You can suppress this exception and fall back to eager by setting: import torch._dynamo torch._dynamo.config.suppress_errors = True
/usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: cannot find -lcuda collect2: error: ld returned 1 exit status
感觉是cuda的环境变量没配置好，你有按照官网的指示执行安装命令么？以及，设置.bashrc的内容，并且source激活nvcc, cudatoolkit。还有，你如果要装flash-attn, 需要你的显卡架构支持.这边你需要描述gpu的信息
感觉是cuda的环境变量没配置好，你有按照官网的指示执行安装命令么？以及，设置.bashrc的内容，并且source激活nvcc, cudatoolkit。还有，你如果要装flash-attn, 需要你的显卡架构支持.这边你需要描述gpu的信息 输入nvcc -V nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2023 NVIDIA Corporation Built on Tue_Feb__7_19:32:13_PST_2023 Cuda compilation tools, release 12.1, V12.1.66 Build cuda_12.1.r12.1/compiler.32415258_0 环境是按照官网给的说明按照的。 运行python3 tools/llama/generate.py 还是提示 /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status 0%| | 0/3271 [02:31<?, ?it/s] Traceback (most recent call last): File "/home/zhaoqiuyu/workspace/fish-speech/tools/llama/generate.py", line 491, in
main() File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/click/core.py", line 1157, in call return self.main(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/click/core.py", line 1078, in main rv = self.invoke(ctx) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, **ctx.params) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/click/core.py", line 783, in invoke return __callback(*args, **kwargs) File "/home/zhaoqiuyu/workspace/fish-speech/tools/llama/generate.py", line 454, in main y = generate( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/zhaoqiuyu/workspace/fish-speech/tools/llama/generate.py", line 247, in generate x = decode_n_tokens( File "/home/zhaoqiuyu/workspace/fish-speech/tools/llama/generate.py", line 182, in decode_n_tokens next_token = decode_one_token( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 455, in _fn return fn(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 912, in catch_errors return callback(frame, cache_entry, hooks, frame_state, skip=1) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 398, in _convert_frame_assert return _compile( File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 669, in _compile guarded_code = compile_inner(code, one_graph, hooks, transform) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 542, in compile_inner out_code = transform_code_object(code, transform) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/bytecode_transformation.py", line 1033, in transform_code_object transformations(instructions, code_options) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 163, in _fn return fn(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/convert_frame.py", line 507, in transform tracer.run() File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2130, in run super().run() File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 793, in run and self.step() File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 756, in step getattr(self, inst.opname)(inst) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2249, in RETURN_VALUE self.output.compile_subgraph( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 931, in compile_subgraph self.compile_and_call_fx_graph(tx, list(reversed(stack_values)), root) File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 1102, in compile_and_call_fx_graph compiled_fn = self.call_user_compiler(gm) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 1175, in call_user_compiler raise BackendCompilerFailed(self.compiler_fn, e).with_traceback( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/output_graph.py", line 1156, in call_user_compiler compiled_fn = compiler_fn(gm, self.example_inputs()) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/dynamo/repro/after_dynamo.py", line 117, in debug_wrapper compiled_gm = compiler_fn(gm, example_inputs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/dynamo/repro/after_dynamo.py", line 117, in debug_wrapper compiled_gm = compiler_fn(gm, example_inputs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/init.py", line 1730, in call return compile_fx(model, inputs, config_patches=self.config) File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 1106, in compile_fx return compile_fx( File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 1332, in compile_fx return aot_autograd( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/backends/common.py", line 57, in compiler_fn cg = aot_module_simplified(gm, example_inputs, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_functorch/aot_autograd.py", line 879, in aot_module_simplified compiled_fn = create_aot_dispatcher_function( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_functorch/aot_autograd.py", line 604, in create_aot_dispatcher_function compiled_fn = compiler_fn(flat_fn, fake_flat_args, aot_config, fw_metadata=fw_metadata) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/runtime_wrappers.py", line 434, in aot_wrapper_dedupe return compiler_fn(flat_fn, leaf_flat_args, aot_config, fw_metadata=fw_metadata) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/runtime_wrappers.py", line 639, in aot_wrapper_synthetic_base return compiler_fn(flat_fn, flat_args, aot_config, fw_metadata=fw_metadata) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/jit_compile_runtime_wrappers.py", line 97, in aot_dispatch_base compiled_fw = compiler(fw_module, updated_flat_args) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 1260, in fw_compiler_base return inner_compile( File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/repro/after_aot.py", line 83, in debug_wrapper inner_compiled_fn = compiler_fn(gm, example_inputs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/debug.py", line 304, in inner return fn(*args, **kwargs) File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner return func(*args, **kwds) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 426, in compile_fx_inner compiled_graph = FxGraphCache.load( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 759, in load compiled_graph = compile_fx_fn(gm, example_inputs, **fx_kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 698, in fx_codegen_and_compile compiled_fn = graph.compile_to_fn() File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/graph.py", line 1226, in compile_to_fn return self.compile_to_module().call File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 256, in time_wrapper r = func(*args, **kwargs) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/graph.py", line 1178, in compile_to_module mod = PyCodeCache.load_by_key_path( File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 2081, in load_by_key_path exec(code, mod.dict, mod.dict) File "/tmp/torchinductor_zhaoqiuyu/t2/ct23ynpvsrkccib7skyhwprkgfrvjzaya4d35o73tgpd2nsmuius.py", line 3003, in async_compile.wait(globals()) File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 2636, in wait scope[key] = result.result() File "/home/zhaoqiuyu/.local/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 2443, in result self.future.result() File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 458, in result return self.__get_result() File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result raise self._exception torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised: CalledProcessError: Command '['/usr/bin/gcc', '/tmp/tmpxj8o9021/main.c', '-O3', '-shared', '-fPIC', '-o', '/tmp/tmpxj8o9021/cuda_utils.cpython-310-x86_64-linux-gnu.so', '-lcuda', '-L/home/zhaoqiuyu/.local/lib/python3.10/site-packages/triton/backends/nvidia/lib', '-I/home/zhaoqiuyu/.local/lib/python3.10/site-packages/triton/backends/nvidia/include', '-I/tmp/tmpxj8o9021', '-I/usr/local/include/python3.10']' returned non-zero exit status 1.
Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information
You can suppress this exception and fall back to eager by setting: import torch._dynamo torch._dynamo.config.suppress_errors = True
/usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status /usr/bin/ld: 找不到 -lcuda collect2: error: ld returned 1 exit status
