llama-recipes icon indicating copy to clipboard operation
llama-recipes copied to clipboard

Mismatch in Llama Guard 2 prompt between llama.meta.com and code - `begin_text`

Open BrunoGomesCoelho opened this issue 6 months ago • 2 comments

System Info

This is independent of torch version.

Information

  • [X] The official example scripts
  • [ ] My own modified scripts

🐛 Describe the bug

The llama.meta.com / ... / meta-llama-guard-2/ docs includes the <|begin_of_text|> text/tokens in it's usage ;

The current inference/prompt_format_utils.py code does not use this for Llama Guard 2.

Should these beginning tokens be or not used for Llama Guard 2?

Error logs

No error.

Expected behavior

Documentation matches code utils.

BrunoGomesCoelho avatar Jul 30 '24 14:07 BrunoGomesCoelho