linshuijin comments

Repositories
Issues
Comments

Results 2 comments of


                                            linshuijin

用quant_with_alpaca.py量化微调过的llama2-13b报错AttributeError: 'QuantLinear' object has no attribute 'q4'

我也遇到了该问题，请问你解决了吗，是怎么解决的

[BUG] Cutlass cannot be compiled with the `-G` flag for some of the latter examples.

> [@mrakgr](https://github.com/mrakgr) The issue is fixed in 4.3.0 dev release. Hello, I have upgraded CUTLASS to version 4.3.1. but still cannot be compiled with the -G flag for 72a_blackwell_nvfp4_bf16_gemm. Here...