nunchaku

nunchaku copied to clipboard

请问怎么确定实际使用的时候是fp4或者int4推理呢？

1

zfnice

[Bug] Assertion error "lora_act_out.shape[1] == rank_down" related to LoRAs with missing blocks

4

### Checklist - [x] 1. I have searched for related issues and FAQs (https://github.com/mit-han-lab/nunchaku/discussions/262) but was unable to find a solution. - [x] 2. The issue persists in the latest...

EricBCoding

linux python=3.10.15, torch2.5, 使用 Nunchaku-0.2.0 %2Btorch2.5-cp310-cp310-linux_x86_64.whl 安装了 nunchaku，但插件导入仍然失败

2

0.0 seconds (IMPORT FAILED): /root/ComfyUI/custom_nodes/ComfyUI-nunchaku 环境都已经安装完成 linux python=3.10.15, torch2.5, 使用 Nunchaku-0.2.0 %2Btorch2.5-cp310-cp310-linux_x86_64.whl 安装了 nunchaku，但插件导入仍然失败

bruce7048

Nunchaku April Development Roadmap

25

Hello everyone, As promised, last month we brought multiple-LoRA and ControlNet-Union-Pro support with faster generation speed. Additionally, we expanded support for 20-series GPUs. We understand some of you may still...

lmxyy

Fix GPU memory allocation issues

1

Previously, the following would not properly clear all memory: ```py import gc, torch del pipeline, transformer torch.cuda.empty_cache() ``` This PR fixes that by resetting the internal quantized model state on...

Ednaordinary

feat: expose norm1 layer to support TeaCache

15

Fixes https://github.com/mit-han-lab/nunchaku/issues/233 This PR exposes the `norm1` layer from the transformer blocks, which is used by TeaCache. In this way, SVDQuant and TeaCache can be combined to get an even...

andreaferretti

[Feature] Add support for HiDream-I1

10

### Checklist - [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/mit-han-lab/nunchaku/discussions/new/choose. Otherwise, it will be closed. - [x]...

Aunali321

special_lora_error

8

I successfully installed it but still encountered the same issue as before. I can guarantee that this model works in the normal dev mode and performs better than the original...

taiczhi

[Feature] 兼容 alimama-creative/FLUX.1-dev-Controlnet-Inpainting-Beta

4

### Checklist - [ ] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/mit-han-lab/nunchaku/discussions/new/choose. Otherwise, it will be closed. -...

mihunter

### Motivation https://github.com/bytedance/UNO ### Related resources _No response_

andchir