[Question] I followed the instructions to build for Orange Pi, but it seems outdated (ChatModule)

[LivingLinux]

❓ General Questions

I followed the instructions to build for Orange Pi. https://blog.mlc.ai/2024/04/20/GPU-Accelerated-LLM-on-Orange-Pi I have the Radxa Rock 5B with the same SoC, but I think that should be no problem.

I noticed that it has a section "Try out the CLI", but it ends with the verification, not an example to run it. It continues with the section "Try out the Python API", but the Python script still uses ChatModule, which is no longer available. https://github.com/mlc-ai/mlc-llm/issues/2217

Can you add an example to start the chat from the CLI? And with chat I mean I can continue the chat, and not having to execute a Python script per question.