crawl4ai icon indicating copy to clipboard operation
crawl4ai copied to clipboard

Storing cache in a custom directory

Open jkwiecien765 opened this issue 1 year ago • 1 comments

Hello!

I'm trying to store the cache in my project directory using base_directory parameter in 'AsyncWebCrawler'. It does create a .crawl4ai/cache directory but sends the data to home/.crawl4ai anyway. Am I doing sth wrong or it's a bug?

jkwiecien765 avatar Nov 12 '24 14:11 jkwiecien765

@jkwiecien765 Thanks for using our library. In our upcoming release (0.3.74), available today or tomorrow, you'll also be able to set the default cache folder via an environment variable CRAWL4_AI_BASE_DIRECTORY.

unclecode avatar Nov 14 '24 08:11 unclecode