mlc-llm
mlc-llm copied to clipboard
Request: release a library
The idea is a Java (or Kotlin) library (jar) that is decoupled from the Android gui. This way we could write our own gui in Java or Kotlin for Android. The library would take prompts as input (String, JSON or what ever) and would return the answer after computing (as Strings or better as Streams).
+1
Moving to #361