Nurul Fhakri
Nurul Fhakri
Thanks for checking. For merging, I used: model.save_pretrained_merged(new_model_local, tokenizer, save_method="merged_16bit") After merging, I loaded the model and ran inference with the same input and system prompt as before merging. However,...
Hey, it's working now. I have it figured it out.
> I was going through the same notebook yesterday. Did you figure out what was causing it [@raising-heart](https://github.com/raising-heart) ? I tried it before merging but did not have a look...