Timon Käch

I have the same issue and would love to get a fix. I'm on linux ubuntu 20.04

Also, custom_stopping_strings don't seem to work either. params['custom_stopping_strings'] = ["\n"] Does nothing

> To get the API working you need to use http://{address}:{Port}/run/textgen (http://127.0.0.1:7860/run/textgen) to work with the Gradio API. Example link: https://github.com/oobabooga/text-generation-webui/blob/main/api-example.py > > you don't want to use the API...

How does this work with streaming?

Closing as this is fixed with the new api extension

> I've already fixed this bug. It's on PR now I've tried this but it still doesn't stop. Are you sure this works with the latest commit?

Closing this as it is fixed with the new api

Yeah this looks awesome! I check this out today!

Thank you very very much for this api! It works flawless! I hope this get's merged soon.

> So cool. This just works with auto-gpt out of the box: Run matatonic/text-generation-webui server with --openai Run Gdev91/Auto-GPT with OPENAI_API_BASE_URL=http://127.0.0.1:5001/ in .env I used EMBED_DIM=5120 in .env with eachadea_vicuna-13b-1.1...