Shengye Wang

> Hi guys, > > I understand the proper solution to trigger rebuilds of the Docker images will be to check the newly available debian pkg versions (sorry if this...

I see. I thought Docker Hub has a cache mechanism works the in the same way as docker local — my bad. In that case, automatically PR and embedding version...

只是为了能够推理的话，我这样解决的 ``` from peft import PeftModel ``` ``` model = AutoModelForCausalLM.from_pretrained( "baichuan-inc/Baichuan2-7B-Chat", trust_remote_code=True ) peft_path = '/path/to/output/checkpoint-max' model = PeftModel.from_pretrained(model, peft_path) model.half() model.cuda() ```