webaverse icon indicating copy to clipboard operation
webaverse copied to clipboard

Choose between returning a cached and new agent response

Open soulofmischief opened this issue 2 years ago • 0 comments

Sometimes to save resources, we should return a cached response. It can be either an exact match which is already cached based on a hashed prompt, or it can be a near-match based on tags.

### Tasks
- [ ] Tag prompt input and route agent response accordingly

soulofmischief avatar Feb 20 '23 06:02 soulofmischief