cocalc-docker icon indicating copy to clipboard operation
cocalc-docker copied to clipboard

Change/adjust/disable Token limit per user or globally not possible?

Open bombaglad opened this issue 1 year ago • 2 comments

Hi! Relating to Issue #217 , after solving the payment issue and using ChatGPT for a while, there's a new error which I can't seem to be able to fix via the settings-GUI.

"Error: You may use at most 50000 tokens per hour. Please try again later."

It's definitely NOT a limitation by the OpenAI-API, as a different user on the same server is still able to use ChatGPT normally.

Is there a proper way to disable the check on a self-hosted docker instace, or to change the limits? I couldn't find it in the documentation.

image

Seems to me like it is related to some of these files, to prevent abuse and high costs: src/packages/server/llm However I am basically the only user on this server and want to use the API as much as I need, while keeping track of the costs through OpenAI's website myself.

Thanks in advance!!

bombaglad avatar Feb 04 '24 10:02 bombaglad