Abhinav Singh

icon company Onfinace AI icon location bengaluru icon location Software Eningeering * Machine Learning

Results 1 issues of Abhinav Singh

RuntimeError: torch.cuda.MemPool doesn't currently support expandable_segments during vLLM model initialization

3 comment

Description ## Summary When training a LangGraph agent with `openpipe-art[backend,langgraph]`, the process fails at model initialization with the following error: RuntimeError: torch.cuda.MemPool doesn't currently support expandable_segments. The error occurs inside...