LMFlow icon indicating copy to clipboard operation
LMFlow copied to clipboard

[BUG]unexpected behavior on qwen 2.5 series templates

Open xypan0 opened this issue 10 months ago • 1 comments

Describe the bug When using qwen 2.5 series templates, tokenizer.apply_chat_template throw Jinja error

To Reproduce Steps to reproduce the behavior:

  1. Create a conversation dataset without a system prompt
  2. use qwen 2.5 series template
  3. The error occurs.

Additional context https://github.com/OptimalScale/LMFlow/blob/main/src/lmflow/tokenization/hf_decoder_model.py#L160 Here the code does not handle None system prompt properly.

xypan0 avatar Feb 26 '25 17:02 xypan0

Thanks for reporting this issue ❤ , and should be fixed in PR #935 .

wheresmyhair avatar Feb 27 '25 13:02 wheresmyhair