q-diffusion
q-diffusion copied to clipboard
errors in executing in LSUN-bed w8a8 quantization
my cmd:
python scripts/sample_diffusion_ldm.py -r models/ldm/lsun_beds256/model.ckpt -n 32 --batch_size 16 -c 50 -e 0.0 --seed 41 --ptq --weight_bit 8 --quant_act --act_bit 8 --a_sym --resume -l log/ --cali_ckpt bedroom_w8a8_ckpt.pth
the error:
RuntimeError: Error(s) in loading state_dict for QuantModel:
Unexpected key(s) in state_dict: "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_q.delta", "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_q.zero_point", "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_k.delta",....
I guess the w8a8.pth aren't updated in the cloud?