markluofd

I met the same problem [h264_rkmpp @ 0x55b8824a40] Failed to send packet to decoder (code = -11) Last message repeated 92 times [h264_rkmpp @ 0x55b8824a40] Decoder noticed an info change...

补充，参考 https://its201.com/article/m0_57459724/124209377 这篇帖子，在容器内重新编译安装python3.7后，交叉编译armv8可以了，但是交叉编译armv7报了新的错误  想请问有办法在with_python=on的情况下，x86上交叉编译armv7的wheel包吗？

Will intel cpu backend be equipped with AsyncLLMEngine? api_server is currently using AsyncLLMEngine

@bigPYJ1151 To imitate the code of https://github.com/vllm-project/vllm/pull/3814/files#diff-d1c5ec4ddd588e3b7cac13bde85a98ac5b20686dc16b9da3b1c324467c3be2b5 url, I added CPUExecutorAsync in cpu_executor.py. AsyncLLMEngine and api_server can work normally. I want to know if this method will affect the inference...

@bigPYJ1151 ok, thanks！There is another question , the introduction says that only bf16 and fp32 are supported. I found that if the dtype is fp16, the CPU backend can also...

@bigPYJ1151 I get it, thank you! I need to find a 4th generation CPU and test the performance of bf16. I also found that the overall utilization rate of the...