ShubhamVerma16

Results 2 issues of ShubhamVerma16

openai:error_code=None error_message='Too many inputs for model None. The max number of inputs is 1.

7 comment

while using llama_index GPTSimpleVectorIndex I am reading a pdf file using SimpleDirectoryReader. I am unable to create index for the file and it is generating the below error: **INFO:openai:error_code=None error_message='Too...

[Feature]: GPTQ/AWQ quantization is not fully optimized yet. The speed can be slower than non-quantized models.

9 comment

### 🚀 The feature, motivation and pitch While running the vLLM server with quantized models specifying the quantization type, the below mentioned Warning is shown: ``` WARNING 04-25 12:26:07 config.py:169]...

feature request