llama-recipes
llama-recipes copied to clipboard
Mismatch in Llama Guard 2 prompt between llama.meta.com and code - `begin_text`
System Info
This is independent of torch version.
Information
- [X] The official example scripts
- [ ] My own modified scripts
🐛 Describe the bug
The llama.meta.com / ... / meta-llama-guard-2/ docs includes the <|begin_of_text|>
text/tokens in it's usage ;
The current inference/prompt_format_utils.py code does not use this for Llama Guard 2.
Should these beginning tokens be or not used for Llama Guard 2?
Error logs
No error.
Expected behavior
Documentation matches code utils.