Nan Qin
Results
13
comments of
Nan Qin
thank you @DarkLight1337 ! Are there anything else you would like me to do for this pr?
@toilaluan I have a [branch](https://github.com/Nan2018/vllm/tree/embedding-completion-api) for sending prompt embeddings to the openai completions endpoint. Instead of text I used b64 encoding. ``` prompt_embeds = [] for input_embeds in inputs_embeds: #...
does setting `FAIL_ON_INIT_ERROR` to true work?