krita-ai-diffusion icon indicating copy to clipboard operation
krita-ai-diffusion copied to clipboard

8GB Flux coming?

Open nigelp opened this issue 1 year ago • 8 comments

Is there any chance of Flux model support in Krita Ai for 8GB RTX 4060 VRAM?

nigelp avatar Aug 12 '24 12:08 nigelp

maybe in 6 months but i doubt it

Serasul1984 avatar Aug 12 '24 15:08 Serasul1984

maybe in 6 months but i doubt it

https://openart.ai/workflows/cgtips/comfyui---flux-nf4-model---lighter-and-faster/xgXUBq2E14uoHdyx2LTe https://www.youtube.com/watch?v=L5BjuPgF1Ds

it happen, just need acly to add the support

Streamtabulous avatar Aug 13 '24 08:08 Streamtabulous

NF4 still uses ~10.5GB on my system. I am not sure it will fit entirely into 8GB. (It will probably work, but very slow)

Acly avatar Aug 13 '24 09:08 Acly

image I found that my laptop 3070 graphics card 8GB can also calculate, and it takes about 70 seconds to capture a 1024 resolution image

syl1130 avatar Aug 13 '24 10:08 syl1130

Oh interesting. But this is using Krita AI or standalone?

On Tue, 13 Aug 2024, 11:47 syl1130, @.***> wrote:

image.png (view on web) https://github.com/user-attachments/assets/5a54b811-646e-4b69-bf60-8b5b8c26c0b7 I found that my laptop 3070 graphics card 8GB can also calculate, and it takes about 70 seconds to capture a 1024 resolution image

— Reply to this email directly, view it on GitHub https://github.com/Acly/krita-ai-diffusion/issues/1067#issuecomment-2285945626, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAAX43IARZUPEANNSGZXG5DZRHP5PAVCNFSM6AAAAABMMDK57OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBVHE2DKNRSGY . You are receiving this because you authored the thread.Message ID: @.***>

nigelp avatar Aug 13 '24 10:08 nigelp

image I found that my laptop 3070 graphics card 8GB can also calculate, and it takes about 70 seconds to capture a 1024 resolution image

70sec is quick, normal flux is 5 to 10 minutes

Streamtabulous avatar Aug 13 '24 23:08 Streamtabulous

lllyasviel flux1-dev-bnb-nf4 v2! is now available:

https://civitai.com/models/645429 https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4

GKartist75 avatar Aug 14 '24 14:08 GKartist75

NF4 still uses ~10.5GB on my system. I am not sure it will fit entirely into 8GB. (It will probably work, but very slow)

i get 5min on schnell at 1024x1024 while watching YouTube on my rtx3060, any decrease in wait time would be a win even if its 2min ...

Streamtabulous avatar Aug 15 '24 07:08 Streamtabulous

See https://github.com/Acly/krita-ai-diffusion/discussions/1176 for current state on low-VRAM models.

Acly avatar Sep 13 '24 11:09 Acly