Blake Wyatt

I've just released a major update which brings the bot back up to date with webui. Let me know if you still have this issue.

Gotcha! Let me know when EdgeGPT starts working for you in webui and we can revisit this

Thanks, I've been able to reproduce on my end. I made everything deterministic to see if there was a parameter I was missing, but with the same parameters, context, and...

I removed all the async code, discord bot stuff, any other unnecessary code to run the prompt, and called the API directly. Now I'm getting 6.15 tokens/s. I guess it's...

I found the issue. [This](https://github.com/xNul/chat-llama-discord-bot/blob/main/bot.py#L135) line of code for streaming the text generation to Discord is blocking the token generation, slowing it down. Since Python async is concurrent and uses...

Since the `Client` object in discord.py can't be serialized, it can't be moved to another process and used to make edits. This means that in order to keep performance and...

I think this was happening due to how the guild fix was being implemented. It should work now though.

@grar21 no idea because I've never experienced this error before

honestly, you should be moving the whole save folder. There could be more files that are affected

You sir are a genius! I've been looking for this information since I first made the script! I really appreciate you opening the issue and I'll be adding it to...