gpu/generate.py error

[Singapore-mor]

        torch.cuda.synchronize()
        stats.phase("decode" if use_cuda_graphs else "total")

        eos_id = self.tokenizer.eot_id

error： AttributeError: 'Tokenizer' object has no attribute 'eot_id'. Did you mean: 'eos_id'?

is code wrong? should it be eos_id = self.tokenizer.eos_id?

[junhuihe-hjh]

Did you miss the --chat-format parameter?

[Singapore-mor]

Did you miss the --chat-format parameter?

oh sorry, I just check I use the wrong command '--chatformat' , and you mean '--chat_format'?

[junhuihe-hjh]

Actually, both --chat-format (with a hyphen) and --chat_format (with an underscore) are valid.