AlpacaTag
AlpacaTag copied to clipboard
CUDA not supports
To enable the CUDA, All the worker processes (each one of them is pytorch model) in ZeroMQ have to inter-communicate. I couldn't resolve this issue yet. still fixing it.
Thus, to start the server, pls turn off the CUDA with CUDA_VISIBLE_DEVICES = " " alpaca-serving-start