RoyaltyLJW
RoyaltyLJW
Hi, when I run the code below in a 4 CPU machine,Aborted (core dumped) happen. Error rate is 6/10. (Run 10 times and error occur 6 times). But in a...
Hi,I want to use BMF to extract video (yuv420p) frame with cpu, using demo shown in https://babitmf.github.io/docs/bmf/multiple_features/graph_mode/generatemode/ with generator mode. But It seems that it use more time than ffmpeg-python....
### Model Series Qwen2.5 ### What are the models used? Qwen2.5-32B-Instruct-AWQ ### What is the scenario where the problem happened? inference with vllm ### Is this a known issue? -...
### Your current environment vllm==0.6.1 ### How would you like to use vllm Steps to reproduce This happens to Qwen2.5-32B-Instruct-AWQ The problem can be reproduced with the following steps: start...