stable-diffusion-webui-forge icon indicating copy to clipboard operation
stable-diffusion-webui-forge copied to clipboard
verified publisher icon lllyasviel

Blue screen when running FLUX.1 [dev]

Open Atoli opened this issue 1 year ago • 2 comments

Specs:

OS: W10 LTSC GPU: Nvidia RTX 3060 12gb VRAM RAM: 16gb Forge version: f2.0.1v1.10.1-previous-260-gaadc0f04 Commit: aadc0f04c48eb19475752a4206420ea2004e2f42

Issue:

FLUX.1 [dev] will crash PC and blue screen it every time i try to run it.

Expected outcome:

No blue screen.

Steps to recreate:

  1. t5xxl_fp8_e4m3fn.safetensors and clip_l.safetensors in text_encoder folder.
  2. flux1Dev_v10.safetensors on models.
  3. ae.safetensors on VAE.
  4. Generate using these settings. fluxsettings

If press generate ONCE i get the message AssertionError: You do not have CLIP state dict! and if press generate again it will IMMEDIATELY bluescreen. Tried multiple times and it always bluescreens the second time i press the button. What am i doing wrong that is causing such a harsh system restart?

Atoli avatar Aug 15 '24 02:08 Atoli

I experienced the same thing (blue screen with memory error) when attempting to use anything in the VAE/Text encoder field. I have a 12GB 3060 as well. Everything worked fine when I used one of the "all in one" models that have those included, removed my extra extensions from the extensions folder (not the built in ones), and uninstalled xformers (wouldn't gen with it installed due to an error about tensors matching). Would recommend trying that (new model, removing extensions, uninstalling xformers) and see if it works. All of that may not be necessary, but it was for me.

Also using a different commit, so that could be it too.

Links to the models I used Full flux-dev NF4: https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4/blob/main/flux1-dev-bnb-nf4-v2.safetensors Schnell: https://huggingface.co/silveroxides/flux1-nf4-weights/blob/main/flux1-schnell-bnb-nf4.safetensors

Python 3.10.9 | packaged by Anaconda, Inc. | (main, Mar 1 2023, 18:18:15) [MSC v.1916 64 bit (AMD64)] Version: f2.0.1v1.10.1-previous-267-g70a5acd8 Commit hash: 70a5acd8ad02579531bb25aa352c57d7991a2cde image image

rpgnut2910 avatar Aug 15 '24 15:08 rpgnut2910

flux1Dev_v10.safetensors that is definitly going to run out of vram and crash

Full flux-dev NF4

flux1-dev-Q4_0.gguf

currently there is a memory leak at this time. however it should load with these inside your memory constraints

https://huggingface.co/city96/FLUX.1-dev-gguf

Tom-Neverwinter avatar Aug 16 '24 23:08 Tom-Neverwinter