ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Support for max_loaded_maps and num_parallel variables/parameter

Open jars101 opened this issue 1 month ago • 4 comments

It does not seem that ollama running on ipex-llm supports the most recent max_loaded_maps and num_parallel variables/parameters. Is it supported in current ollama version under llama-cpp? how does one enables it? thanks

jars101 avatar Jun 05 '24 10:06 jars101