Well Lee comments

Repositories
Issues
Comments

Results 1 comments of


                                            Well Lee

采用int4量化模型出现以下错误：AttributeError: 'NoneType' object has no attribute 'int4WeightExtractionFloat'

model = AutoModel.from_pretrained("localpath", trust_remote_code=True).float().to('mps') func = kernels.int4WeightExtractionHalf AttributeError: 'NoneType' object has no attribute 'int4WeightExtractionHalf'