dave

Actually, the nvcc is ok to run as these: root@f8c2e06fbf8b:/mnt/vllm# nvcc -v nvcc fatal : No input files specified; use option --help for more information root@f8c2e06fbf8b:/mnt/vllm# nvcc -V nvcc: NVIDIA...

there is cuda: root@f8c2e06fbf8b:/mnt/vllm# echo $CUDA_HOME /usr/local/cuda root@f8c2e06fbf8b:/mnt/vllm# type nvcc nvcc is /usr/local/cuda/bin/nvcc github.com/vllm# python3 -c "import torch; print(torch.cuda.is_available()); print(torch.__version__);" True 2.1.0a0+32f93b1