seeyourcell

AttributeError: 'LlamaModel' object has no attribute 'split_gpus'

1

when I try CUDA_VISIBLE_DEVICES=0 python llama_simquant.py --abits 4 --nsamples 16 --seqlen 2048 --nuq --fisher --quantize --include_sparse --sparsity-threshold 0.99 --quantizer_path quantizers.pickle ; get this error AttributeError: 'LlamaModel' object has no attribute...