cwleungar comments

Repositories
Issues
Comments

Results 2 comments of


                                            cwleungar

Token loss for llama.tokenize() with mixed Chinese/English text

Thank you for the quick fix. However, after I updated to use the GitHub repo at commit 17978ee (instead of the version on pub.dev), I now get: ‘Llama init failed:...

Token loss for llama.tokenize() with mixed Chinese/English text

Hi, thank you again for your help. I tested the code on macOS ARM64, Android, and Windows x86. On macOS it works as expected and matches your output. However, on...