Run API with just CPU for Fastchat t5

[djaffer]

trafficstars

I am trying to run the api just with cpu but getting error

chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 1145 │ │ return self._apply(convert) │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 1146 │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ /usr/local/lib/python3.8/site-packages/torch/cuda/init.py:247 in │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ _lazy_init │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 244 │ │ # are found or any other error occurs │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 245 │ │ if 'CUDA_MODULE_LOADING' not in os.environ: │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 246 │ │ │ os.environ['CUDA_MODULE_LOADING'] = 'LAZY' │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ ❱ 247 │ │ torch._C._cuda_init() │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 248 │ │ # Some of the queued calls may reentrantly call _lazy_init(); │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 249 │ │ # we need to just return without initializing in that case. │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | │ 250 │ │ # However, we must not let any other threads in! │ chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | ╰── ────────────────────────────────────────────────────────────────────────────╯chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | RuntimeError: Found no NVIDIA driver on your system. Please check that you have chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | an NVIDIA GPU and installed a driver from chatgpt-fastchat-model-worker-1 | 2023-05-05 10:11:46 | ERROR | stderr | http://www.nvidia.com/Download/index.aspx chatgpt-fastchat-model-worker-1 exited with code 1