yhliu
Results
1
comments of
yhliu
我也有相同的问题,否则下面代码无法连接起来用,求详细指导@cxfcxf model_id = '/home/admin/huggingface/THUDM/chatglm-6b-int4' tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True, revision="") model = AutoModelForSeq2SeqLM.from_pretrained(model_id, trust_remote_code=True, revision="").half().float() model = model.eval() pipe = pipeline("text2text-generation", model=model, tokenizer=tokenizer, max_length=800) local_llm = HuggingFacePipeline(pipeline=pipe) llm_chain = LLMChain( llm=local_llm,...