Richard Palethorpe
Richard Palethorpe
I've tested this with NVIDIA and did not experience this issue. All I can think is that it is an upstream issue that is highly sensitive to environmental inputs and...
Getting a black rectangle on flux :-/
the problem persists after reverting to the main branch. I changed it so the clip is kept on CPU as in the upstream tutorial and now it works. I'm not...
I seem to be still hitting this bug in 2025.11.x ``` !pip list | grep unsloth unsloth 2025.11.2 unsloth_zoo 2025.11.3 ```
Here is the problem ``` File "/tmp/ipython-input-773422404.py", line 1, in trainer_stats = trainer.train() File "/content/unsloth_compiled_cache/UnslothSFTTrainer.py", line 53, in wrapper self.model.for_training() File "/usr/local/lib/python3.12/dist-packages/unsloth/models/vision.py", line 1234, in for_training os.environ["UNSLOTH_RETURN_LOGITS"] = "0" File...
arm64 cuda 13 failure appears to be a connection timeout
Taking a look
fixed in #7771
I have added the model to the gallery and it also requires the development version of the SD GGML backend until the next LocalAI release. I added the quants created...
What about create a backend that exports VRAM info instead of doing inference? Then suggest the user installs that next to the RAM usage if they have a GPU.