Run Web LLM on a Linux on Android?

[HappyPony]

Hi,

Linux can be installed and run on Android smartphones. For example, I have Ubuntu Version 20.04.3 LTS (Focal Fossa) and Debian version_ID=10 (buster) - with certain restrictions under the UserLand app https://userland.tech/.

Could it be a promising approach to try to run Web-LLM on such a Linux instance?

[jinhongyii]

I'm not sure about this. You can have a try

[tqchen]

checkout android examples at https://mlc.ai/mlc-llm/docs/