Bob
Bob
I will get the error when I run `lmdeploy check_env` because I built lmdeploy on Jetson Orin. Below is the code, `from lmdeploy import pipeline, TurbomindEngineConfig, PytorchEngineConfig` `pipe = pipeline("./InternVL2_5-1B-MPO-4bit/",...
GPU memory size is 16GB, and I uploaded the log file. [log.txt](https://github.com/user-attachments/files/18796806/log.txt)
Yes, I built LMDeploy from source. By default, BUILD_MULTI_GPU is set to ON, but I modified it to OFF because there is only one GPU on the Jetson.
Thank you for your sharing. I want to test InternVL2.5, I can't downgrade to v0.4.0. @lzhangzz Do you have any clues on how to solve this issue?
I still encountered the same error after adding `max_prefill_token_num=2048`. However, when I also added`cache_max_entry_count=0.25`, the error did not occur, but I received `no kernel image is available for execution on...
No, MLDeploy seems to have limited compatibility with Jetson.