puter
puter copied to clipboard
HeyPuter
Better Usage Limit Handling
A thread from Discord:
It would be great if when recources are used up, it would simply respond with exactly same json structure as the response from any model, but with custom message telling the user about end of recourses and suggest to upgrade the account or buy more resources if doable.
That's not a bad idea. It would be kind of annoying to implement though since usage limits are supposed to be a concept that's general to all driver interfaces rather than just AI chat, but maybe each interface can define a "when usage has run out" implementation.
So, that's the idea behind this issue; add an implementation of the puter-chat-completion interface that informs the user that their allotted amount for costly services has run out. We have a fake chat service (for test_mode and when moderation fails) that might be a good reference for this.
@KernelDeimos I'd like to take this on! I'm new to open source so I'm happy to work with someone else if anyone is interested
@KernelDeimos I'd like to take this on! I'm new to open source so I'm happy to work with someone else if anyone is interested
Hi Andrew! I am new to open source as well. I would be interested in working on this task as well with you! Let's collaborate and work together.
Hello, I've assigned @Awnder first since they were the first to comment. Awnder, lmk if I have the go-ahead to also assign @RadoBoiii if you'll be working together on this.
I had to rebase and create a branch because we were committing to main 🤦. My bad. @RadoBoiii and @KernelDeimos I've fix this and created a PR.