ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

vLLM offline_inference.py failed to run on CPU inference

Open eugeooi opened this issue 2 months ago • 1 comments

Failed to run python offline_inference.py from link for vLLM offline inference on CPU. It seems that llm.py has been removed in the previous version.

eugeooi avatar May 16 '24 10:05 eugeooi