Tianqi Chen
Tianqi Chen
Would love to hear from community about what kinds of developer API we are looking for. At the current moment libmlc_llm can indeed be leveraged as a local API, that...
#223
Thanks for the feedbacks, we didn't get our hand on other phones, but would love to continue improve. There is a recent update to reduce the RAM usage of APK...
Please check out the latest apk and feel free to open new issues
It is interesting that it happens in WSL, @Ox0400 likely you don't want to install libtvm.so to your system as the library is packaged along the python nightly package, try...
cc @MasterJH5574 who can help to set it up
If the ask is just serve the website from the local machine, you can just serve base url as web-llm(note the baseurl argument below). Here is one example that can...
@kadogo thank you for great discovery, do you mind send a PR to the tvm unity branch https://github.com/apache/tvm/tree/unity adding `{"powerPreference":"high-performance"}`.
what is your GPU RAM limit, since we are definitely pressure testing GPU a bit and if you do not have more than 6.5G of RAM, it might cause problems