xin0623

AttributeError: 'BF16_Optimizer' object has no attribute 'cur_scale'

2

The error occurred when I tried to fine-tune in single_modality Traceback (most recent call last): File "run_finetuning.py", line 719, in main(opts, ds_init) File "run_finetuning.py", line 636, in main train_stats =...

How to get the score of each token when using pipeline

1

pipe = pipeline( "text-generation", model=model, tokenizer=tokenizer, max_new_tokens=512, do_sample=True, temperature=0.7, top_p=0.95, top_k=40, repetition_penalty=1.1, output_scores=True ) The model I use is Qwen2-7B-Instruct. When I try to output the score of each token...

CUDNN_STATUS_NOT_INITIALIZED.

1

【处理中】开始提取字幕信息，此步骤可能花费较长时间，请耐心等待... (External) CUDNN error(1), CUDNN_STATUS_NOT_INITIALIZED. | 0/3795 [00:00

pipe = pipeline( "text-generation", model=model, tokenizer=tokenizer, max_new_tokens=10, do_sample=False, temperature=None, top_p=None, top_k=None, repetition_penalty=1.1, output_scores=True, output_logits=True ) 没效果