AlpacaTag icon indicating copy to clipboard operation
AlpacaTag copied to clipboard

CUDA not supports

Open danny911kr opened this issue 6 years ago • 0 comments

To enable the CUDA, All the worker processes (each one of them is pytorch model) in ZeroMQ have to inter-communicate. I couldn't resolve this issue yet. still fixing it.

Thus, to start the server, pls turn off the CUDA with CUDA_VISIBLE_DEVICES = " " alpaca-serving-start

danny911kr avatar Jul 26 '19 12:07 danny911kr