autolabel icon indicating copy to clipboard operation
autolabel copied to clipboard

Published 20 hours ago • verified publisher icon refuel-ai

[Feature Request]: Generation cache should lookup on the prompt hash instead of entire prompt

Open yadavsahil197 opened this issue 9 months ago • 1 comments

Is your feature request related to a problem? Please describe. The cache lookup happens by doing string comparison for the prompt. This can be optimized by doing lookups on hash instead of strings.

yadavsahil197 avatar Sep 08 '23 01:09 yadavsahil197

What impact will this change have?

rishabh-bhargava avatar Sep 08 '23 01:09 rishabh-bhargava