Daniyal khan

same

@microsoft-github-policy-service agree

https://github.com/oobabooga/text-generation-webui/pull/2709 updated

I can add unit testing ASAP and token healing does work but not acceleration however I can implement that and testing by tommorow

Update unit tests and improved functionality were added

> @slundberg is this going to be merged? I'd like to get feedback regarding any concerns with the pull request but haven't heard much, maybe should open new one?

Thanks for the feedback, I should have put guards on API routes and I should pull the latest changes for TGWUI. I am a little confused with getting inital feedback...

Sounds good, will add further units tests, documention, error handling, etc. I might want to open a new pr just bc I've changed so much code between commits expect to...

> Will this be merged or is there existing functionality that now exists within Guidance to support text-generation-web-ui or using external LLMs via API requests? I plan on pushing these...

> How did you figure out these flags btw? trial and error + a bit of help from GPT, also verified by running file on the finished build