Mengwei Liu

Results 62 comments of Mengwei Liu

> Getting this error when running the llm runner with a HF tokenizer: > > ``` > failed to open encoder file: ~/.cache/huggingface/hub/models--google--gemma-3-1b-it/snapshots/dcc83ea841ab6100d6b47a070329e1ba4cf78752/tokenizer.json > E tokenizers:tiktoken.cpp:92] failed to open encoder...

@guangy10 https://github.com/pytorch/executorch/pull/10326 this should allow arbitrary tokenizer to be passed into runner.