chatbot-ui icon indicating copy to clipboard operation
chatbot-ui copied to clipboard

Already subscribed but still having an error message

Open Katniss27 opened this issue 2 years ago • 1 comments

I already paid and subscribed to Chat UI plus but still having an error message. What do I need to do?

Screenshot 2024-04-02 165427 image_720 image

Katniss27 avatar Apr 02 '24 23:04 Katniss27

@mckaywrigley , I reduced my API usage costs by 98% through two key actions;

a) Quick code change to limit conversation history And b) Rephraser PULL request from @fkesheh https://github.com/mckaywrigley/chatbot-ui/pull/1518

For a) Some users just use a single conversation that is months old, this means for every single message, even as simple as "what model is this?", the entire conversation is sent back and forth in each API query which can be many thousands of tokens. Costs a friggin bomb. Found this by using CloudFlares AI gateway.

Given your user volume, you may also benefit from caching, refer https://github.com/mckaywrigley/chatbot-ui/discussions/1527

spammenotinoz avatar Apr 03 '24 00:04 spammenotinoz