Already subscribed but still having an error message
I already paid and subscribed to Chat UI plus but still having an error message. What do I need to do?
@mckaywrigley , I reduced my API usage costs by 98% through two key actions;
a) Quick code change to limit conversation history And b) Rephraser PULL request from @fkesheh https://github.com/mckaywrigley/chatbot-ui/pull/1518
For a) Some users just use a single conversation that is months old, this means for every single message, even as simple as "what model is this?", the entire conversation is sent back and forth in each API query which can be many thousands of tokens. Costs a friggin bomb. Found this by using CloudFlares AI gateway.
Given your user volume, you may also benefit from caching, refer https://github.com/mckaywrigley/chatbot-ui/discussions/1527