rags icon indicating copy to clipboard operation
rags copied to clipboard

implement using llamacpp as LLM model

Open adeelhasan19 opened this issue 1 year ago • 4 comments

i am trying to implement using open source llm model with llamacpp but getting this error

"ValueError: Must pass in vector index for CondensePlusContextChatEngine." i am new to llamaindex also can anyone help me what exactly i need to configure in order to run the RAGs

adeelhasan19 avatar Nov 24 '23 12:11 adeelhasan19

see our customization tutorial here (specifically the part about customizing LLMs): https://docs.llamaindex.ai/en/latest/getting_started/customization.html

also llms: https://docs.llamaindex.ai/en/latest/module_guides/models/llms.html

jerryjliu avatar Nov 25 '23 08:11 jerryjliu

Try ask chat-gpt 4.0

cocoa126 avatar Nov 26 '23 12:11 cocoa126

i am trying to implement using open source llm model with llamacpp but getting this error

"ValueError: Must pass in vector index for CondensePlusContextChatEngine." i am new to llamaindex also can anyone help me what exactly i need to configure in order to run the RAGs

Try ask gpt4

cocoa126 avatar Nov 26 '23 12:11 cocoa126

@adeelhasan19 did u successfully loaded local llm with llamacpp ??

khalilxg avatar Dec 24 '23 21:12 khalilxg