crawl4ai
crawl4ai copied to clipboard
Storing cache in a custom directory
Hello!
I'm trying to store the cache in my project directory using base_directory parameter in 'AsyncWebCrawler'. It does create a .crawl4ai/cache directory but sends the data to home/.crawl4ai anyway. Am I doing sth wrong or it's a bug?
@jkwiecien765 Thanks for using our library. In our upcoming release (0.3.74), available today or tomorrow, you'll also be able to set the default cache folder via an environment variable CRAWL4_AI_BASE_DIRECTORY.