FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

Can GPTCache be used in FastChat?

Open 3togo opened this issue 1 year ago • 0 comments
trafficstars

I am looking for a mean to use GPTCache in FastChat to speed up the LLM processes. Any pointer?

3togo avatar Jun 23 '24 08:06 3togo