palladium123

### Describe the bug When I attempt to use the training tab to train LoRA for the above model I get the error message as per 'Logs' below. Essentially can't...

Phi4 MM will not perform text generation tasks

1

Hi all I tried using the code from the coobook for text inference with HF as found here: [https://github.com/microsoft/PhiCookBook/blob/main/md/01.Introduction/02/01.HF.md](url) When the model is set to `Phi4- Mini- Instruct` things work...

### System Info RTX 3090, Driver 561.09. Win 11 Python 3.12 Pytorch 2.6.0 +Cu124 (Cuda 12.4) Transformers 4.51.1 BNB 0.45.5 ### Reproduction Running into some trouble with quantizing Phi 4...