electroglyph
electroglyph
oh shit, lol, i just created my own powershell version at https://github.com/0xDEADFED5/ps_tiny11
any chance the Windows code could be placed in a separate branch for testing? i was attempting to get it going, but ran into BigDL-core having only partial Windows support,...
looking forward to this too...
i think this is what you're looking for: https://github.com/mlc-ai/notebooks/blob/main/mlc-llm/tutorial_raw_text_generation.ipynb
Hope somebody much smarter than me can help tackle this =)
i can't reproduce this on Intel hardware, but i was hopeful =) i had to write my own benchmark because the `mlc_llm bench` command was removed. i averaged the results...
yes, i know, just adding more data. i'm on cellular as my only internet so I can't test that model. i bet if you did more benchmarks with more tokens...
clone the repo TVM is in https://github.com/mlc-ai/mlc-llm/tree/main/3rdparty MLC_LLM is there, too here's some of the output of mlc_llm compile --help ` --output OUTPUT, -o OUTPUT The path to the output...
related models, i believe: https://huggingface.co/Alibaba-NLP/gte-large-en-v1.5 https://huggingface.co/Alibaba-NLP/gte-base-en-v1.5
it looks weird, but if the race condition is happening because of the clock advance, it might be possible for it to fail on linux, too? i'm not 100% on...