ChatGLM2-6B icon indicating copy to clipboard operation
ChatGLM2-6B copied to clipboard

[BUG/Help] 微调时build_inputs_with_special_tokens一定要加吗

Open boundles opened this issue 1 year ago • 0 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Current Behavior

这个函数的作用是在input_ids前面加两个特殊的token,微调训练时一定要加上这个吗,作用是什么

Expected Behavior

no

Steps To Reproduce

no

Environment

- OS:
- Python:
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :

Anything else?

no

boundles avatar Jun 28 '23 11:06 boundles