ontogpt icon indicating copy to clipboard operation
ontogpt copied to clipboard

Published 20 hours ago • verified publisher icon monarch-initiative

Is there an option to use GPU for the LLM, the inference speed is a little too slow. My GPU utilization is almost zero.

Open doubleplusplus opened this issue 7 months ago • 4 comments

on local model

doubleplusplus avatar Nov 17 '23 08:11 doubleplusplus