manjimin

Results 2 comments of manjimin

Same thing happening to me in Korean. @anhvth I can't seem to find _orig_tokenizer from the source code. Where Can I find it? Additionally, guaranteeing that prompt is decoded into...

update: using llamacpp instead of transformers solved the problem for me.