ChatPDF icon indicating copy to clipboard operation
ChatPDF copied to clipboard

Published 20 hours ago • verified publisher icon Anil-matcha

use LLM from huggingface

Open stl2015 opened this issue 11 months ago • 0 comments

Hi, I'm trying to use some LLM model from huggingface, for example "lmsys/vicuna-13b-v1.3". The model could be fetched through AutoModelForCausalLM.from_pretrained. However, what's the best way to wrap the model for integration with load_qa_chain?

stl2015 avatar Jul 20 '23 02:07 stl2015