Sofian Mejjoute
Sofian Mejjoute
Might be relevant https://github.com/yuan1615/AdaVocoder
Regarding finding good hyperparameters, I think this might be useful. https://github.com/optuna/optuna
LoRA? https://github.com/microsoft/LoRA LION as the optimizer? https://github.com/lucidrains/lion-pytorch (Quite new, mileage may vary) https://github.com/hpcaitech/ColossalAI [FlashAttention](https://github.com/HazyResearch/flash-attention) if not used already
> I doubt any of the model code from ColossalAI is directly applicable -- am I wrong? Probably not directly but I think it could be adapted https://colossalai.org/docs/basics/engine_trainer Not sure...
> LoRA is a great idea, but it might be difficult to implement (I've never done LoRA related code myself) https://github.com/cccntu/minLoRA/ > ### minLoRA > A minimal, but versatile PyTorch...
@152334H thoughts about https://github.com/wl-zhao/UniPC ?
Examples on images https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/7710
@pepinu have you made any progress on this?
Might be interesting https://onnxruntime.ai/docs/performance/tune-performance.html
Looks like you're in the tortoise-tts-fast\scripts folder, you should be in the tortoise-tts-fast folder