Aavache

Results 1 repositories owned by Aavache

LLMWebCrawler

64
Stars
7
Forks
Watchers

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.