llama icon indicating copy to clipboard operation
llama copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

LLAMA tokenizer

Open YuanLiuuuuuu opened this issue 1 year ago • 0 comments

Why there is negative index, e.g. -1, after the decoding of tokenizer?

YuanLiuuuuuu avatar Apr 15 '23 04:04 YuanLiuuuuuu