shidanwangya

Results 1 issues of shidanwangya

环境:Win11下,wsl2,Ubuntu22.04 ![Image](https://github.com/user-attachments/assets/7805a4dd-2e76-4a25-9eb4-c682f745c318) 配置:2080ti,wsl2分配了16gb内存 1.加了4bit量化: "quantization_bit": 4, "quantization_type": "nf4", "double_quantization": true, "quantization_method": "bitsandbytes", 2.type改成 "dtype": torch.float16,因为2080ti显卡不支持bflo, 3. 量化与显存限制也开了。 "gpu_memory_utilization": 0.85, "quantization": "bitsandbytes", "load_format": "bitsandbytes", 运行后(.venv) root@D-NO1:/home/ace/WeClone# weclone-cli make-dataset INFO 05-18 00:55:37...