airllm icon indicating copy to clipboard operation
airllm copied to clipboard

请问修改哪些参数qlora就会变成lora?

Open dongteng opened this issue 1 year ago • 1 comments

dongteng avatar Jul 25 '23 07:07 dongteng

quantization_config=BitsAndBytesConfig( load_in_4bit=args.bits == 4, load_in_8bit=args.bits == 8, llm_int8_threshold=6.0, llm_int8_has_fp16_weight=False, bnb_4bit_compute_dtype=compute_dtype, bnb_4bit_use_double_quant=args.double_quant, bnb_4bit_quant_type=args.quant_type ),

这个部分去掉就可以。

lyogavin avatar Sep 12 '23 14:09 lyogavin