q-diffusion icon indicating copy to clipboard operation
q-diffusion copied to clipboard

errors in executing in LSUN-bed w8a8 quantization

Open Sugar929 opened this issue 1 year ago • 0 comments

my cmd: python scripts/sample_diffusion_ldm.py -r models/ldm/lsun_beds256/model.ckpt -n 32 --batch_size 16 -c 50 -e 0.0 --seed 41 --ptq --weight_bit 8 --quant_act --act_bit 8 --a_sym --resume -l log/ --cali_ckpt bedroom_w8a8_ckpt.pth

the error:

RuntimeError: Error(s) in loading state_dict for QuantModel:
        Unexpected key(s) in state_dict: "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_q.delta", "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_q.zero_point", "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_k.delta",....

I guess the w8a8.pth aren't updated in the cloud?

Sugar929 avatar Oct 12 '23 12:10 Sugar929