Bakht-Ullah

[Installation]: Error occured while installing vllm

1

### Your current environment `My current environment is window ``` pip install vllm ### How you are installing vllm creating build\bdist.win-amd64\wheel\vllm\model_executor\layers copying build\lib\vllm\model_executor\layers\activation.py -> build\bdist.win-amd64\wheel\.\vllm\model_executor\layers creating build\bdist.win-amd64\wheel\vllm\model_executor\layers\fused_moe creating build\bdist.win-amd64\wheel\vllm\model_executor\layers\fused_moe\configs copying...

[Bug]: RuntimeError: ('Quantization scheme is not supported for ', 'the current GPU. Min capability: 80. ', 'Current capability: 75.')

2

### Your current environment I am using google colab T4 GPU ### 🐛 Describe the bug from vllm.assets.audio import AudioAsset from vllm import LLM, SamplingParams # Load your local audio...

### Your current environment ``collect_env.py 100%[============================================================>] 25.64K --.-KB/s in 0.009s 2025-03-07 15:32:12 (2.72 MB/s) - ‘collect_env.py’ saved [26257/26257] Collecting environment information... PyTorch version: 2.5.1+cu124 Is debug build: False CUDA used...