Haydon Ryan
Results
22
comments of
Haydon Ryan
Totally agree on this. timeout needs to be increased.
100% i'm running a 16 core epyc as my LLM machine - it really chugs trying to load mixtral 8x22b even if loading of NVME into ram.