Is there anyone can train customized model base on Phi3.5-mini-instrcut on 4060TI 8GB?

Open WormStan opened this issue 9 months ago • 1 comments

Mar 07 '25 02:03 WormStan

Hi @WormStan 8GB GPU memory is NOT suitable to fine tune any model. To fine-tune the Phi-3.5 model, you'll need a GPU with at least 40 GB of dedicated RAM. For optimal performance, it's recommended to use GPUs like the NVIDIA A100 or H100, which are designed for high-performance computing and deep learning tasks. These are available under cloud providers such as Microsoft Azure.

Mar 07 '25 16:03 leestott