shidanwangya
Results
1
issues of
shidanwangya
环境:Win11下,wsl2,Ubuntu22.04  配置:2080ti,wsl2分配了16gb内存 1.加了4bit量化: "quantization_bit": 4, "quantization_type": "nf4", "double_quantization": true, "quantization_method": "bitsandbytes", 2.type改成 "dtype": torch.float16,因为2080ti显卡不支持bflo, 3. 量化与显存限制也开了。 "gpu_memory_utilization": 0.85, "quantization": "bitsandbytes", "load_format": "bitsandbytes", 运行后(.venv) root@D-NO1:/home/ace/WeClone# weclone-cli make-dataset INFO 05-18 00:55:37...