postgres-new icon indicating copy to clipboard operation
postgres-new copied to clipboard

Disable rate limiting when running locally

Open gregnr opened this issue 1 year ago • 0 comments
trafficstars

Right now you have to use the rate limiter, even for local development or self hosting. Find a good way to allow developers to disable this (eg. simply omitting KV_REST_API_URL/KV_REST_API_TOKEN env vars) so that the LLM can be used unrestricted.

gregnr avatar Oct 30 '24 23:10 gregnr