TT

Cant change DTYPE inside VLLM settings

2

**LocalAI version:** latest **Environment, CPU architecture, OS, and Version:** Linux srv3 5.19.0-1010-nvidia-lowlatency #10-Ubuntu SMP PREEMPT_DYNAMIC Wed Apr 26 00:40:27 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux **Describe the bug** Cant set...

Unexpected keyword argument 'base_api'

1

I'm currently attempting to run a project locally that utilizes a VLLM OpenAI compatible instance, but I've encountered a stumbling block. Whenever I try to initiate the project, I'm met...