Han Lim comments

Repositories
Issues
Comments

Results 3 comments of


                                            Han Lim

[FEATURE] How to add headers when creating opean-ai chat object. like python's langchain “default_headers” property.

It'll be great to have this ability since I'm trying to use the same OpenAI client to query OpenAI via an LLM proxy service but the proxy service requires some...

[FEATURE] How to add headers when creating opean-ai chat object. like python's langchain “default_headers” property.

~@langchain4j could I have write access to the [repo](https://github.com/ai-for-java/openai4j) ? I'm trying to create a PR for this change~ Nvm, should have forked this repo instead 😄 - here's the...

GPTQ / Quantization support?

@chu-tianxiang I tried forking your `vllm-gptq` branch and was successful deploying the `TheBloke/Llama-2-13b-Chat-GPTQ` model. However, when I tried the `TheBloke/Llama-2-7b-Chat-GPTQ` model, it threw the following exception whenever I made a...