langserve icon indicating copy to clipboard operation
langserve copied to clipboard

Published 20 hours ago • verified publisher icon langchain-ai

LangServe playground crashes on browser due to out of memory

Open explocion opened this issue 7 months ago • 1 comments

Description: I was trying to build a RAG application where the retrieved context is HUGE. When I run it from the langserve playground, my browser crashes due to out of memory. I suspect it was because saving the stream log in the frontend was using to much memory (64 chunks with 2000 characters per chunk).

Steps to Reproduce:

  1. Build a RAG application
  2. Retrieve with a large context

Attempted Solution: Reducing the number of chunks works, but I really need a huge number of chunks for my application.

explocion avatar Jun 30 '24 05:06 explocion