LMFlow
LMFlow copied to clipboard
[BUG]unexpected behavior on qwen 2.5 series templates
Describe the bug When using qwen 2.5 series templates, tokenizer.apply_chat_template throw Jinja error
To Reproduce Steps to reproduce the behavior:
- Create a conversation dataset without a system prompt
- use qwen 2.5 series template
- The error occurs.
Additional context https://github.com/OptimalScale/LMFlow/blob/main/src/lmflow/tokenization/hf_decoder_model.py#L160 Here the code does not handle None system prompt properly.
Thanks for reporting this issue ❤ , and should be fixed in PR #935 .