Rangehow
Rangehow
+1,希望可以在日志里加上衡量吞吐性能的指标
Similar issue in text process ```python tokenizer=AutoTokenizer.from_pretrained(model_dir[args.model]) train_dataset=datasets.load_from_disk(dataset_dir[args.dataset],keep_in_memory=True)['train'] train_dataset=train_dataset.map(partial(dname2func[args.dataset],tokenizer=tokenizer),batched=True,num_proc =50,remove_columns=train_dataset.features.keys(),desc='tokenize',keep_in_memory=True) ``` After this train_dataset will be like ```python Dataset({ features: ['input_ids', 'labels'], num_rows: 51760 }) ``` In which input_ids and...
I found the possible cause, in hf we can use model.add_adapter(lora_config) or model=get_peft_model(model,lora_config) to convert a model to peft model. But the former will cause the error while the latter...