Tianqi Chen

Results 637 comments of Tianqi Chen

Just want to note that it is not always possible to do such inference. ```python class IRModule: @T.prim_func def reshape(A : Buffer((2, 4)), B: Buffer((n, m)): def main(A: Buffer((2, 4))):...

I think this is mainly a design consideration here on what do we view the intended use of CreateCallTIR, in terms of different expectations we have on caller of the...

Thanks for pointing out the frontend case, I still think being explicit is helpful and aims for a consistency check with good error messages. Having such explicit argument makes the...

As suggested, please consider redownload the weight

I belive this may be a legacy code that is no longer needed, cc @CharlieFRuan @Neet-Nestor . let us cross check and confirm, if it is not needed, we should...

Did pm2 kill the original engine? The cancelled error in engine happens when requests get cancelled (e.g. you send a chat completion request, but did not iterate over all of...

Would be nice if you can confirm there is a local command to reproduce the issue. On latest mlc engine, I tried starting the engine with tp=2, and manually run...

Please folllow the Android SDK docs https://llm.mlc.ai/docs/deploy/android.html Likely this is related to JDK version and setup. You will need to use the jdk that comes with NDK. We strongly recommend...