autolabel icon indicating copy to clipboard operation
autolabel copied to clipboard

Published 20 hours ago • verified publisher icon refuel-ai

Disable caching properly

Open rajasbansal opened this issue 2 years ago • 1 comments

  • Write the cache to a consistent location to make it easier to find
  • Allow clearing the cache
  • Make the use of cache = False consistent. @rishabh-bhargava any thoughts on what the behaviour here should be. Should we call it llm_cache and just control the llm call caching with this parameter. Or should this also disable task creation?

rajasbansal avatar Jun 08 '23 05:06 rajasbansal

Fixed llm cache clearing with cache = False in #257.

Currently, we have two concepts, the LLM Cache and Task creation. Cache = False just handles the LLM cache being turned off. However, we want no task to be created or saved when we set cache = False. Follow up PR to work on this.

Cache = False seems like an unintuitive name for not creating a task. @yadavsahil197 @nihit @rishabh-bhargava any thoughts on a name that could be good for this flag?

rajasbansal avatar Jun 09 '23 23:06 rajasbansal