context icon indicating copy to clipboard operation
context copied to clipboard

Add usage of any OpenAI endpoint

Open bartowski1182 opened this issue 1 year ago • 0 comments

I run my LLMs on text-generation-webui which also provides an openai-compatible endpoint, it would be great if we could provide our own generation parameters since it's unhappy with the max_length being passed as -1 when trying to use --local

If this is already in the pipeline, great! If not I may try to investigate and open a PR with potential fixes

bartowski1182 avatar Nov 23 '23 03:11 bartowski1182