Hao Zhang
Hao Zhang
I don't think we have any official support for GPTQ-4bit. But I'll take a look at GPTQ this week and update on this issue.
This is non-trivial to do. I discussed with @merrymercy and he will update on this issue.
Any forms of contributions about OPT-IML are welcome
@AhmedMAlbreiki Please submit a PR so we can help review, thanks!
@frankxyy are you saying the exactly same training setting can work on 1x4 GPUs but not on 2x4 GPUs?
@huanzhizun Could you give more details about the Dreambooth implementation?
@GHGmc2 Feel free to design a new algorithm that can search over the global space (for the new H100 cluster)!
May I get an update regarding the status of this PR? It seems the author stopped working on it?
related with #5
@zuston Thanks for your interest! Yes, WIP!