DeSinc

if I can weigh in, if you just updated, at least for me with the API, something has changed somehow such that slow performance has manifested itself. where I was...

Yep I'm seeing same issues. My custom stopping strings that were working before are now all nonfunctional. I had a look at the api.py changes and reverted that code but...

> I used the reference making sure I don't have any wrong parameter names. All other parameters seems to work just fine except stopping_strings. Guys, you're talking past each other....

> Hello ! I was working on a similar project but I'm not able to use the api correctly. I wanted to use the api in chat mode but everytime...

Edit: solved by basically re-creating what the chat ui was doing. formatting the input prompt with a brief at least 5+ message long history of messages separated by newlines etc....

> > Edit: solved by basically re-creating what the chat ui was doing. formatting the input prompt with a brief at least 5+ message long history of messages separated by...

The problem remaining with the above is that the API seems to IGNORE stopping_strings so it does NOT stop generating and it just hallucinates a bunch of simulated conversation with...

the default API is terrible and almost totally disfunctional. Even if you get it working, there is something wrong on a core level that causes hashtag psychosis, where the bot...

yep that's why. it uses kobold ai format and is compatible with tavern AI, is what I've seen about a dozen people say about it after doing pages and pages...

> @DeSinc @mouchourider, did you ever figure out stopping strings? yeah nope still not working, even using --extensions api. never works. it's just not functioning. have half a mind to...