llm-applications
llm-applications copied to clipboard
A comprehensive guide to building RAG-based LLM applications for production.
Hi @GokuMohandas @pcmoritz, Noticed you're calling the openai chat completions endpoint. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and wanted to see how i...
I want to use map_batches update the database obtained by langchain FAISS, but I can not get correct answer. Is it because the distributed approach is not suitable for this...
On the notebook, calling ``` # Embed chunks embedding_model_name = "thenlper/gte-base" embedded_chunks = chunks_ds.map_batches( EmbedChunks, fn_constructor_kwargs={"model_name": embedding_model_name}, batch_size=100, num_gpus=1, compute=ActorPoolStrategy(size=2)) # Sample sample = embedded_chunks.take(1) ``` results to: ``` ========...
Updates RAG notebook to use LlamaIndex