nunchaku icon indicating copy to clipboard operation
nunchaku copied to clipboard

Published 20 hours ago • verified publisher icon mit-han-lab

load the int4 schnell model spend 190s for 1.04

Open T8mars opened this issue 8 months ago • 1 comments
trafficstars

190S

Image

T8mars avatar Mar 09 '25 06:03 T8mars

How much VRAM do you have? You can try disabling the cpu_offload for better speed.

lmxyy avatar Mar 11 '25 06:03 lmxyy

See our FAQ:

Try upgrading your CUDA driver and try setting the environment variable NUNCHAKU_LOAD_METHOD to either READ or READNOPIN. Some references: #249 #311 #276

I'll close this issue for now. If the error persists or you encounter any other problems, feel free to open a new issue.

lmxyy avatar Apr 27 '25 04:04 lmxyy