gongliym
Results
1
issues of
gongliym
I found the special tokens are not correctly set in tokenizer when i'm using `decapoda-research/llama-7b-hf`. Here is the code from [train.py](https://github.com/tatsu-lab/stanford_alpaca/blob/main/train.py) line[198](https://github.com/tatsu-lab/stanford_alpaca/blob/65512697dc67779a6e53c267488aba0ec4d7c02a/train.py#L198)-[206](https://github.com/tatsu-lab/stanford_alpaca/blob/65512697dc67779a6e53c267488aba0ec4d7c02a/train.py#L206) ``` special_tokens_dict = dict() if tokenizer.pad_token is None:...