Greg Schoeninger

What would it take to support GPT2 models in merge_and_unload? Getting the error: "GPT2 models are not supported for merging LORA layers"

No plans to yet, but you can always wget from the releases page and load into docker

Hey @marcellodesales I cannot view the link you provided above, is it private?

Added this flag in a PR, still need to document but it will be in the next release. I’m curious about your use case if you don’t mind me asking!...