Hsiao-Chien Tsai

**In trainer.py, ignore the last token is not suitable for all situations.** ```python def tokenize_sample(self, item, max_seq_length, add_eos_token=True): assert self.tokenizer is not None result = self.tokenizer( item["text"], truncation=True, max_length=max_seq_length, padding="max_length",...