StewartAragon

Is NVIDIA CUDA installed on your system? I'm working through this at the moment, and encountered the same issue to discover that the CUDA toolkit needed to be installed.

I encountered the same issue following a query, and the response hung. After a few minutes the model responded.